ISTQB CT-GenAI

GenAI in Regression Testing and Test Monitoring

60 questions

Easy

Regression testing with GenAI

  1. Why are regression tests particularly well suited to automation?
  2. In which environment do automated regression tests typically run particularly often?
  3. In keyword-driven test automation, what does a keyword stand for?
  4. What is the purpose of a GenAI-supported impact analysis in regression testing?
  5. What is meant by self-healing tests?
  6. What can GenAI compile automatically for defect reports in regression testing?
  7. What applies to test scripts and reports that GenAI has produced in regression testing?
  8. Why do automated GUI tests often become unstable?
  9. Which change typically causes trouble for API regression tests?

Test monitoring and test control

  1. Where is the data for test monitoring often already available for GenAI to evaluate?
  2. What can GenAI achieve in test monitoring beyond plain numbers?
  3. How can GenAI support test control?
  4. What can GenAI contribute to test completion?
  5. What is the advantage of natural language summaries alongside a dashboard?
  6. Which metric is a typical result when an LLM prepares test data for monitoring?

Choosing a prompting technique

  1. For which tasks is prompt chaining particularly suitable?
  2. When is few-shot prompting the obvious choice?
  3. What is the core of meta prompting?
  4. May several prompting techniques be combined for a single test task?
  5. A team wants 40 test cases written in Gherkin format, always with the same structure. Which technique fits best?

Medium

Regression testing with GenAI

  1. A team has a keyword library for a lending app. How does an LLM help most when generating new regression scripts?
  2. Which prompting technique is well suited to having keyword-driven test scripts generated in a uniform form?
  3. In a bike rental app, only the price calculation for weekend rentals was changed. What does an AI-supported impact analysis provide?
  4. In a pharmacy web shop, the field "ZIP" is now called "Postal code"; the function is unchanged. What does a self-healing test do?
  5. What long-term goal do self-healing tests pursue?
  6. An LLM produces a report after each nightly regression run. What sensibly belongs in it?
  7. A regression run yields 30 failures. Which first step of a structured report analysis with an LLM makes sense?
  8. What is the purpose of a list of known anomalies in AI-supported analysis of regression results?
  9. A rental API will require a new authentication method. How can GenAI support the API regression tests?
  10. What is meant by dynamic locators to which GenAI can adapt GUI scripts?
  11. What forward-looking information can an AI-supported test report provide in regression testing?

Test monitoring and test control

  1. An LLM receives an export from the test management tool of a hospital app. Which result is most useful for test monitoring?
  2. Monitoring shows that tests for the medication list are far behind plan. Which GenAI help fits test control?
  3. What benefit do GenAI-created completion reports have beyond the individual project?
  4. What characterizes a dynamic dashboard that GenAI helps to build?
  5. An LLM has calculated metrics for the dashboard of a daycare management app from a tool export. What should happen before publication?

Choosing a prompting technique

  1. From user stories of a railway app, test conditions, then test cases and finally scripts are to be produced; each stage is to be checked. Which technique fits?
  2. A team wants log files examined for anomalies for the first time and has no suitable prompt yet. Which technique is a good start?
  3. Which sequence describes a sensible combination of the three prompting techniques?
  4. For which test task is meta prompting typically well suited?

Hard

Regression testing with GenAI

  1. After a change to the discount logic of a ticket shop, an AI impact analysis recommends only 12 of 400 regression tests. How does a test team best proceed?
  2. A self-healing test adapts because the "Order" button has disappeared and now clicks "Save for later". What does this case show?
  3. An LLM generates scripts for a keyword-driven framework, but some abort because keywords are misspelled. Which measure helps most specifically?
  4. A team sets up an AI assistant via a system prompt that checks and corrects keyword-driven scripts. Which detail most belongs in this system prompt?
  5. A structured analysis of regression results runs in a single LLM conversation. Which order makes most sense?
  6. An LLM groups 25 failed tests of an insurance app into three defect clusters. What risk exists here?
  7. For which types of regression tests can GenAI be used?
  8. A parcel tracking API now returns a "tracking" object with subfields instead of "status". What is important when adapting the tests with GenAI?
  9. Why does GenAI fit well with maintaining regression suites in fast release cycles?
  10. An AI-supported impact analysis is to select regression tests in a CI pipeline. Which prerequisite is most important for this?

Test monitoring and test control

  1. Based on the test data, an LLM reports that the defect rate in the "Billing" module is rising sharply. What is the best next step?
  2. Two weeks before release, an LLM suggests postponing low-risk tests to test critical areas more thoroughly. How should this be classified?
  3. What distinguishes test control from test monitoring when both are supported by GenAI?
  4. An LLM writes a summary of the test status for senior management. What is the greatest danger?
  5. Test data from several tools is partly unstructured, such as free-text comments. What is a typical contribution of GenAI to test monitoring?

Choosing a prompting technique

  1. A team wants weekly regression reports always in the same table format. Why is few-shot prompting superior to meta prompting here?
  2. Test scripts for a banking app are to be built step by step; each test step is to be checked for functional correctness. What speaks against one single large prompt?
  3. What risk exists if a prompt generated by meta prompting is used unchecked?
  4. Which property of a test task speaks most strongly for prompt chaining rather than few-shot prompting?
  5. In a prompt chain for a travel expense app, step 2 delivers test cases with wrong expected results. How do you proceed?

Certifications & exams

Which exam comes next?

You can already practise for 51 exams, and 16 are up for a vote. See all certifications with their official information, cast your vote or suggest your exam.

See all certifications