ISTQB CT-GenAI
Prompt Structure and Prompting Techniques
Easy
Structure of structured prompts
- How many components does a structured prompt for testing tasks typically consist of?
- Which prompt component determines from which perspective the model should answer, for example as a test manager?
- Which component gives the model background knowledge about the test object and the function under test?
- A prompt contains the sentence "Design test cases for the boundary values of the discount field." Which component is this?
- How should the instruction in a prompt be worded?
- Which example belongs to the input data of a prompt?
- Which component sets limits the model must respect, such as "at most ten test cases"?
- "Deliver the test cases as a table with the columns ID, precondition, steps and expected result." Which component is this?
- Why is it worth giving the model detailed and well-organised input data?
Prompting techniques
- Which technique spreads a task across several consecutive prompts whose intermediate results are checked?
- What is a prompt called that contains no example at all and relies entirely on the model's prior knowledge?
- A prompt shows exactly one pair of input and desired result and then states the actual task. Which technique is this?
- For which tasks is few-shot prompting particularly suitable?
- In which technique does the language model itself draft or improve prompts?
- In meta prompting, the tester and the model work out a prompt together. How can this collaboration be described?
- Which statement about prompt chaining, few-shot and meta prompting is correct?
System and user prompt
Medium
Structure of structured prompts
- Which building blocks belong to the six components of a structured prompt? (Several answers correct)
- A prompt starts with "You are an experienced tester of banking apps." It continues with "The app allows transfers of up to 5000 euros per day; a freely selectable daily limit is new." Which components are these, in this order?
- Which examples count as input data of a prompt? (Several answers correct)
- Which statements are constraints in terms of prompt structure? (Several answers correct)
- What is the job of constraints in combination with the instruction and the input data?
- Which statements belong to the output format? (Several answers correct)
Prompting techniques
- Which characteristics belong to prompt chaining? (Several answers correct)
- When is prompt chaining particularly useful?
- How do zero-shot, one-shot and few-shot prompting differ?
- What do several examples in a few-shot prompt achieve? (Several answers correct)
- What advantages does meta prompting offer? (Several answers correct)
- How does meta prompting typically proceed?
- In which areas can working in a pair with an AI tool boost productivity and learning? (Several answers correct)
- "Here are three defect reports in the format title, steps, expected, actual. Write a report on the following observation in the same format." Which technique does this prompt use?
- What determines which prompting technique is combined with the six-part prompt structure?
System and user prompt
- Which parts of a structured prompt are typically suitable for the system prompt? (Several answers correct)
- Which examples are operating parameters that a system prompt can set? (Several answers correct)
- What does the model take into account for every answer in a chat with a system prompt?
- What should a good user prompt contain? (Several answers correct)
- How are system and user prompts usually used?
Hard
Structure of structured prompts
- A tester sends only "Generate test cases for the login." The answer is generic and does not fit the project. Which missing components most likely explain this? (Several answers correct)
- A prompt contains a screenshot of a form, the sentence "Derive test conditions.", the note "Consider mandatory fields only." and "Output as a numbered list." Which assignments are correct? (Several answers correct)
- "You are a test automation engineer. Write Playwright tests. Here is the page's HTML. Use only data-testid selectors. Output a TypeScript file." Which component is missing?
- A prompt for designing test cases contains no output format. Which consequences are typical? (Several answers correct)
Prompting techniques
- A team wants to use a model to first derive test conditions from a specification, check them, design test cases from them and finally generate test data. Which technique fits best and why?
- A prompt reads: "Example: postcode '1234' gives 'invalid, only four digits'. Now assess: '9A123'." Which technique is this?
- A tester writes: "I need test ideas for an accessibility check. Suggest a suitable prompt and ask what you are missing for it." Which technique is she using?
- A few-shot prompt contains three example test cases, all with valid inputs. The model returns almost only positive tests. What is the most obvious improvement?
- Which pairings of technique and characteristic are correct? (Several answers correct)
- A test manager finds prompt chaining too slow. He wants to put all the steps into one single large prompt. What is the main risk?
- Using meta prompting, a model has proposed a prompt for generating test data. What remains the tester's job? (Several answers correct)
- After the first step of a prompt chain, it turns out that the model has missed two acceptance criteria. How do you proceed in line with the technique?
- In which situation is zero-shot prompting most likely to be sufficient?
- In a team, the defect report titles suggested by a model should follow a uniform pattern. Which technique helps most with this?
- A team has the model suggest a prompt for deriving test data, adds two example records to it and uses it as the first step of a checked chain. Which techniques are used? (Several answers correct)
System and user prompt
- Which statements about the system prompt are correct? (Several answers correct)
- A company provides testers with an internal chatbot. Every answer should be formal and in English, and the model should not speculate. Where is this best defined?
- A team sets up a test assistant. What belongs in the user prompts rather than in the system prompt? (Several answers correct)
- Users of an internal test assistant complain that the answers are far too long. What is the best way to fix this for all users?
- Which statements about user prompts are correct? (Several answers correct)