Study guide
4.3 Governance frameworks (NIST AI RMF, EU AI Act, model cards)
ISTQB Certified Tester — Testing with Generative AI CT-GenAI
Track your progress as you read
Finished sections get a check mark.
1 GenAI Foundations for Testers
1.1 Transformers, tokenization, embeddings & context window 1.2 Foundation models, temperature/sampling & prompting basics 1.3 RAG & agent architectures testers must understand
2 Quality Attributes for GenAI
2.1 Faithfulness, factuality, relevance, coherence & fluency 2.2 Safety, toxicity & bias 2.3 Robustness, privacy, latency & cost
3 Test Design for Non-Determinism
3.1 Controlling non-determinism (seeds, temperature, golden datasets) 3.2 Perturbation & metamorphic testing 3.3 Adversarial prompts & red-teaming
4 GenAI Risks & Mitigation
4.1 Hallucinations: detection & mitigation 4.2 Prompt injection, jailbreaks & training-data extraction 4.3 Governance frameworks (NIST AI RMF, EU AI Act, model cards)
5 Test Infrastructure & Tooling
5.1 Evaluation frameworks (Promptfoo, LangSmith, OpenAI Evals, RAGAS) 5.2 Automated metrics (BLEU/ROUGE/METEOR, embedding similarity, LLM-as-judge) 5.3 Guardrails & safety tooling (Llama Guard, NeMo Guardrails)
6 Organizational Adoption
6.1 Responsible AI governance & regression testing for GenAI 6.2 Continuous evaluation, synthetic test data & cost monitoring
4.3 Governance frameworks (NIST AI RMF, EU AI Act, model cards)
Key Takeaways Explain This Topic AI
NIST AI RMF is a voluntary framework with four functions: Govern, Map, Measure, and Manage; testing mainly feeds Measure.
The EU AI Act is binding law with four risk tiers: unacceptable (banned), high, limited (transparency), and minimal.
The EU AI Act entered into force on 1 August 2024; prohibitions apply from Feb 2025, GPAI from Aug 2025, most high-risk rules from Aug 2026.
Model cards and system cards document intended use, limitations, and evaluation results to provide transparency.
The tester's governance role is evidence and traceability: linking test results to requirements, risks, and regulatory obligations.
Last updated: July 2026
Why governance matters
Governance frameworks give organisations a structured, auditable way to manage AI risk, and they increasingly carry legal force. For a tester the practical consequence is the same across every framework: you must produce evidence that risks were identified, tested, and controlled, and keep that evidence traceable to requirements and to specific test results.
NIST AI Risk Management Framework
The NIST AI RMF 1.0 (released January 2023) is a voluntary framework organised around four core functions:
Govern — a cross-cutting function that establishes the culture, policies, roles, and accountability for managing AI risk throughout the organisation.
Map — establish the context and identify the risks for the specific AI system and its intended use.
Measure — analyse, assess, benchmark, and track the identified risks using quantitative and qualitative methods.
Manage — prioritise and act on the risks, allocating resources to treat, monitor, and respond to them.
Testing feeds mainly the Measure function: test results are the measurements that show whether risks such as bias, hallucination, and security exposure are within tolerance, while Govern sits across all of the other functions.
The framework is deliberately non-prescriptive: it does not mandate specific tests, so each organisation operationalises the functions with its own controls, supported by a companion Playbook and the Generative AI Profile that map concrete actions to each function. A central idea is that AI risk must be managed across the whole lifecycle — from design and data collection through deployment and decommissioning — not treated as a one-off release gate. For testers this means the four functions are continuous activities they contribute to repeatedly, rather than boxes ticked once before go-live.