ISTQB CT-GenAI

Prompt Structure and Prompting Techniques

60 questions

Easy

Structure of structured prompts

  1. How many components does a structured prompt for testing tasks typically consist of?
  2. Which prompt component determines from which perspective the model should answer, for example as a test manager?
  3. Which component gives the model background knowledge about the test object and the function under test?
  4. A prompt contains the sentence "Design test cases for the boundary values of the discount field." Which component is this?
  5. How should the instruction in a prompt be worded?
  6. Which example belongs to the input data of a prompt?
  7. Which component sets limits the model must respect, such as "at most ten test cases"?
  8. "Deliver the test cases as a table with the columns ID, precondition, steps and expected result." Which component is this?
  9. Why is it worth giving the model detailed and well-organised input data?

Prompting techniques

  1. Which technique spreads a task across several consecutive prompts whose intermediate results are checked?
  2. What is a prompt called that contains no example at all and relies entirely on the model's prior knowledge?
  3. A prompt shows exactly one pair of input and desired result and then states the actual task. Which technique is this?
  4. For which tasks is few-shot prompting particularly suitable?
  5. In which technique does the language model itself draft or improve prompts?
  6. In meta prompting, the tester and the model work out a prompt together. How can this collaboration be described?
  7. Which statement about prompt chaining, few-shot and meta prompting is correct?

System and user prompt

  1. Who typically defines the system prompt of a chatbot?
  2. Which prompt stays unchanged throughout an entire chat session?
  3. What is a user prompt?
  4. Which prompt can users of a chatbot neither see nor change in most interfaces?

Medium

Structure of structured prompts

  1. Which building blocks belong to the six components of a structured prompt? (Several answers correct)
  2. A prompt starts with "You are an experienced tester of banking apps." It continues with "The app allows transfers of up to 5000 euros per day; a freely selectable daily limit is new." Which components are these, in this order?
  3. Which examples count as input data of a prompt? (Several answers correct)
  4. Which statements are constraints in terms of prompt structure? (Several answers correct)
  5. What is the job of constraints in combination with the instruction and the input data?
  6. Which statements belong to the output format? (Several answers correct)

Prompting techniques

  1. Which characteristics belong to prompt chaining? (Several answers correct)
  2. When is prompt chaining particularly useful?
  3. How do zero-shot, one-shot and few-shot prompting differ?
  4. What do several examples in a few-shot prompt achieve? (Several answers correct)
  5. What advantages does meta prompting offer? (Several answers correct)
  6. How does meta prompting typically proceed?
  7. In which areas can working in a pair with an AI tool boost productivity and learning? (Several answers correct)
  8. "Here are three defect reports in the format title, steps, expected, actual. Write a report on the following observation in the same format." Which technique does this prompt use?
  9. What determines which prompting technique is combined with the six-part prompt structure?

System and user prompt

  1. Which parts of a structured prompt are typically suitable for the system prompt? (Several answers correct)
  2. Which examples are operating parameters that a system prompt can set? (Several answers correct)
  3. What does the model take into account for every answer in a chat with a system prompt?
  4. What should a good user prompt contain? (Several answers correct)
  5. How are system and user prompts usually used?

Hard

Structure of structured prompts

  1. A tester sends only "Generate test cases for the login." The answer is generic and does not fit the project. Which missing components most likely explain this? (Several answers correct)
  2. A prompt contains a screenshot of a form, the sentence "Derive test conditions.", the note "Consider mandatory fields only." and "Output as a numbered list." Which assignments are correct? (Several answers correct)
  3. "You are a test automation engineer. Write Playwright tests. Here is the page's HTML. Use only data-testid selectors. Output a TypeScript file." Which component is missing?
  4. A prompt for designing test cases contains no output format. Which consequences are typical? (Several answers correct)

Prompting techniques

  1. A team wants to use a model to first derive test conditions from a specification, check them, design test cases from them and finally generate test data. Which technique fits best and why?
  2. A prompt reads: "Example: postcode '1234' gives 'invalid, only four digits'. Now assess: '9A123'." Which technique is this?
  3. A tester writes: "I need test ideas for an accessibility check. Suggest a suitable prompt and ask what you are missing for it." Which technique is she using?
  4. A few-shot prompt contains three example test cases, all with valid inputs. The model returns almost only positive tests. What is the most obvious improvement?
  5. Which pairings of technique and characteristic are correct? (Several answers correct)
  6. A test manager finds prompt chaining too slow. He wants to put all the steps into one single large prompt. What is the main risk?
  7. Using meta prompting, a model has proposed a prompt for generating test data. What remains the tester's job? (Several answers correct)
  8. After the first step of a prompt chain, it turns out that the model has missed two acceptance criteria. How do you proceed in line with the technique?
  9. In which situation is zero-shot prompting most likely to be sufficient?
  10. In a team, the defect report titles suggested by a model should follow a uniform pattern. Which technique helps most with this?
  11. A team has the model suggest a prompt for deriving test data, adds two example records to it and uses it as the first step of a checked chain. Which techniques are used? (Several answers correct)

System and user prompt

  1. Which statements about the system prompt are correct? (Several answers correct)
  2. A company provides testers with an internal chatbot. Every answer should be formal and in English, and the model should not speculate. Where is this best defined?
  3. A team sets up a test assistant. What belongs in the user prompts rather than in the system prompt? (Several answers correct)
  4. Users of an internal test assistant complain that the answers are far too long. What is the best way to fix this for all users?
  5. Which statements about user prompts are correct? (Several answers correct)

Certifications & exams

Which exam comes next?

You can already practise for 51 exams, and 16 are up for a vote. See all certifications with their official information, cast your vote or suggest your exam.

See all certifications