You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The `generate` command analyzes your prompt file and automatically creates test cases to evaluate the prompt's behavior across different scenarios and edge cases. This helps ensure your prompts are robust and perform as expected.
97
97
98
-
##### Advanced options
99
-
100
-
You can customize the test generation process with various options:
101
-
102
-
```shell
103
-
# Specify effort level (low, medium, high)
104
-
gh models generate --effort high my_prompt.prompt.yml
# Custom instructions for specific generation phases
116
-
gh models generate --instruction-intent "Focus on edge cases" my_prompt.prompt.yml
117
-
```
118
-
119
-
The command supports custom instructions for different phases of test generation:
120
-
-`--instruction-intent`: Custom system instruction for intent generation
121
-
-`--instruction-inputspec`: Custom system instruction for input specification generation
122
-
-`--instruction-outputrules`: Custom system instruction for output rules generation
123
-
-`--instruction-inverseoutputrules`: Custom system instruction for inverse output rules generation
124
-
-`--instruction-tests`: Custom system instruction for tests generation
125
-
126
98
##### Understanding PromptPex
127
99
128
100
The `generate` command is based on [PromptPex](https://github.com/microsoft/promptpex), a Microsoft Research framework for systematic prompt testing. PromptPex follows a structured approach to generate comprehensive test cases by:
@@ -151,7 +123,36 @@ graph TD
151
123
OR ==> PPT
152
124
PUT ==> PPT
153
125
IOR ==> PPT
154
-
```
126
+
```
127
+
128
+
##### Advanced options
129
+
130
+
You can customize the test generation process with various options:
131
+
132
+
```shell
133
+
# Specify effort level (low, medium, high)
134
+
gh models generate --effort high my_prompt.prompt.yml
0 commit comments