Free iSQI CT-GenAI Practice Exam with Questions & Answers

Vision-Language Models (VLMs)represent a specialized subset of multimodal Large Language Models. Their defining characteristic is the ability to process, understand, and reason across both textual and visual modalities simultaneously. In the field of software testing, VLMs are revolutionary because they allow the AI to "see" a User Interface (UI). A tester can provide a screenshot of a web page alongside a natural language prompt, and the VLM can identify UI elements, detect visual regressions, or even validate that the visual layout matches a design specification. They are not a "superset" (Option C) of multimodal AI, but rather a specific implementation of it focused on the intersection of sight and language. Unlike traditional OCR or pixel-comparison tools used in legacy UI automation (Option B), VLMs understand thecontextof what they see—for instance, identifying a "broken" button icon that a human would recognize but a rule-based script might miss. This integration of visual and textual data is what makes them a vital component of modern, AI-augmented Quality Assurance strategies.

A hallucination refers to a phenomenon where a Large Language Model generates text that is grammatically correct and seemingly plausible but is factually incorrect or unsupported by the provided context or real-world data. In the context of software testing, this is a critical limitation. For example, an LLM might generate a test case for a software feature that does not exist or cite a non-existent API parameter. These errors occur because LLMs are probabilistic engines designed to predict the "most likely" next token rather than "reasoning" from a set of verified facts. They do not have a built-in "truth" mechanism. While a logical mistake (Option B) is a failure in reasoning and a systematic preference (Option D) describes bias, a hallucination is specifically about the fabrication of information. Testers must be particularly vigilant regarding hallucinations, as they can lead to "false confidence" in test coverage or the creation of invalid bug reports. Mitigations include grounding the model with Retrieval-Augmented Generation (RAG) and implementing rigorous "human-in-the-loop" verification of all AI-generated test artifacts.

Classical Machine Learning(which includes algorithms like Random Forests, Support Vector Machines, and Linear Regression) is characterized by its reliance onFeature Engineering. This is the process where human experts manually select, extract, and transform raw data into a set of "features" or variables that the algorithm can process. For instance, in a classical ML model predicting software defects, a tester might have to manually define features like "lines of code changed" or "number of previous bugs." In contrast,Deep Learningand its subset,Generative AI(Options B and D), utilize "Representation Learning." This means the multi-layered neural networks automatically identify and extract the relevant features from raw, often unstructured data (like text or images) without explicit human instruction.Symbolic AI(Option A) is based on hard-coded logical rules rather than data-driven learning. Understanding this distinction is fundamental for testers, as it determines the level of data preparation required: Classical ML requires high human effort in data structuring, while GenAI requires high effort in prompt engineering and grounding.

The environmental impact and sustainability of AI are increasingly important considerations in software engineering. The overall energy consumption of an LLM during inference (when the model is actually being used by a tester) is most directly influenced by thenumber of tokens processed. Every token generated or analyzed requires a massive amount of floating-point operations within the GPU clusters of a data center. Therefore, the "length" of the input prompt and the "length" of the AI’s response are the primary drivers of the power draw and, consequently, the carbon intensity of the query. This is a crucial concept for "Green AI" initiatives in testing; more efficient prompting—such as avoiding unnecessarily verbose context or limiting output lengths—can lead to more sustainable testing practices. While data center location (Option B) affects thetypeof energy used (renewable vs. fossil fuel), it does not determine the model's accuracy. Similarly, while cloud platforms (Option D) and session durations (Option C) play roles in operational logistics, the mathematical workload tied to token count remains the fundamental unit of energy expenditure in Generative AI.

LLMOps(Large Language Model Operations) is the set of practices used to manage the lifecycle of LLMs in production. When an organization integrates an AI chatbot into its test processes, the primary operational concern ismaintaining data privacy and minimizing security risks, especially if using third-party APIs. Unlike traditional software, LLMs are "black boxes" that process every piece of data sent to them. A core LLMOps responsibility is ensuring that any "Prompt Data" (code, requirements, or logs) is not used by the provider to train their public models and that the communication channels are fully secured. While scalability (Option A) and latency (Option C) are important technical metrics, they are secondary to the catastrophic legal and reputational risk of a data breach. LLMOps in a testing context involves implementing data masking tools, monitoring for "Prompt Injection" attacks, and managing the "Grounding" data in vector databases to ensure it remains current and protected. This ensures the AI remains a safe and reliable asset within the enterprise testing ecosystem, rather than a liability for the organization’s intellectual property.

According to the strategic frameworks for AI adoption (as detailed in the CT-GenAI and related ISO/IEC 42001 standards), the journey toward organizational AI maturity follows three primary phases. TheDiscoveryphase involves identifying potential use cases, assessing current technical readiness, and understanding the legal/risk landscape. TheInitiation and Usage Definitionphase is where the organization sets the "ground rules"—defining which tools are approved, establishing system prompts, creating prompt libraries, and training the staff on prompt engineering. This phase transitions the AI from a novelty into a structured capability. Finally, theUtilization and Iterationphase is the ongoing process where GenAI is used in daily testing activities, and its outputs are constantly monitored, measured, and improved through feedback loops. This ensures the strategy remains dynamic and adapts to new model capabilities or changing project requirements. Options B, C, and D represent standard project management or IT lifecycles but do not capture the specific "learning and refinement" nature required for successful Generative AI integration in a testing department.

Embeddingsare a fundamental concept in modern Natural Language Processing (NLP) and LLMs. They are high-dimensional numerical vectors—essentially lists of numbers—that represent the meaning (semantics) of a piece of text (a word, sentence, or document). Unlike traditional keyword matching, which looks for identical strings of characters, embeddings allow the model to understand the "closeness" of concepts. For example, in a vector space, the word "bug" would be mathematically closer to "defect" or "error" than to "feature" or "requirement." This captures the semantic relationship between terms. This technology is the backbone of Retrieval-Augmented Generation (RAG) used in testing: when a tester queries a documentation set, the system converts the query into an embedding and looks for other chunks of text with similar vector values. This allows the AI to retrieve relevant context even if the exact keywords do not match. It is not about logical rules (Option C) or groups of tokens (Option A), but rather a mathematical representation of language that enables machines to process human meaning.

This scenario describes a specialized form ofData Exfiltration(specifically targeting the model's internal "weights" or training memory). While data exfiltration usually refers to stealing data from a database, in the context of LLMs, it can also refer to techniques that force the model to "reveal" sensitive information it was trained on or data that exists within its current context window. By using long, repetitive, or specifically "crafted" prompts to overwhelm the model's normal attention mechanisms or safety filters, an attacker may cause the model to output verbatim snippets of proprietary information, PII, or internal documentation that should have remained confidential. This is different fromRequest Manipulation(Option D), which aims to change the model's behavior, orData Poisoning(Option A), which happens during training. In testing, this risk is high when models are fine-tuned on private company repositories. Testers must be aware that if a model is accessible to unauthorized users, those users might use adversarial prompting techniques to extract sensitive code or business logic through these types of data leakage attacks.

As Generative AI is integrated into the testing lifecycle, the role of the human tester undergoes a significant shift from "author" to "orchestrator and reviewer." In traditional testing, a significant portion of a tester's time is spent manually drafting test cases, scripts, and documentation. With GenAI, these artifacts can be generated in seconds. Consequently, the tester’s responsibility shifts towardreviewing, refining, and validatingthe AI-generated testware to ensure accuracy, relevance, and compliance with project goals. This "Human-in-the-Loop" (HITL) approach is critical because LLMs are prone to hallucinations and may lack the deep domain context of a human expert. Testers must apply their critical thinking to verify that the AI-generated scripts actually cover the necessary edge cases and do not contain logical errors. This evolution does not mean the end of human oversight (Option B) or a move exclusively to white-box testing (Option C). Instead, it elevates the tester to a higher-level analytical role, focusing on quality strategy and the final verification of AI outputs rather than the repetitive task of initial content creation.

ISO/IEC 42001:2023is the international standard for an AI Management System (AIMS). It is designed to help organizations develop, provide, or use AI systems responsibly by providing a certifiable framework of requirements and controls. In a software testing context, this standard is vital for establishing governance, ensuring that GenAI tools are used consistently and ethically across the lifecycle.NIST AI RMF 1.0(Option B) is a highly respected framework, but it is a set of voluntary guidelines for managing risk, not a "requirement standard" for a management system.ISO/IEC 23053:2022(Option C) provides a general framework for AI using machine learning but lacks the comprehensive "management system" scope found in 42001. Finally, theEU AI Act(Option D) is a regulation (law), not a technical standard. For a test organization looking to align its GenAI strategy with international best practices and achieve formal certification, ISO/IEC 42001 is the definitive standard to follow, as it covers the organizational processes, data handling, and risk management necessary for high-quality AI operations.