Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 12

In the context of AI, " hallucination " refers to the phenomenon where a model generates outputs that are plausible-sounding but are not grounded in reality or the training data. This problemoften occurs with large language models (LLMs) when they create information that sounds correct but is actually incorrect or fabricated.

Option B (Correct): " Hallucination " : This is the correct answer because the problem described involves generating content that sounds factual but is incorrect, which is characteristic of hallucination in generative AI models.

Option A: " Data leakage " is incorrect as it involves the model accidentally learning from data it shouldn ' t have access to, which does not match the problem of generating incorrect content.

Option C: " Overfitting " is incorrect because overfitting refers to a model that has learned the training data too well, including noise, and performs poorly on new data.

Option D: " Underfitting " is incorrect because underfitting occurs when a model is too simple to capture the underlying patterns in the data, which is not the issue here.

AWS AI Practitioner References:

Large Language Models on AWS: AWS discusses the challenge of hallucination in large language models and emphasizes techniques to mitigate it, such as using guardrails and fine-tuning.

The verified answer is B. Data leakage. The model exposes sensitive company information because that information was inadvertently included in training data. AWS guidance warns that using sensitive data to train models can cause unintended disclosure of data from model output, including data leakage during inference. This is exactly the scenario: sensitive information entered the training process and later appeared in model output after deployment.

AWS security reference guidance for generative AI model customization identifies sensitive information disclosure as a threat where a model trained on datasets containing PII leaks sensitive information during inference. Although the question says company information rather than PII specifically, the same security principle applies: protected data included in training or continued pre-training can be memorized or reproduced by the model later.

Jailbreaking is incorrect because jailbreaking refers to attempts to bypass model safety controls through adversarial prompts. The problem here is not that a user bypassed safety controls; the sensitive information was already embedded through training data.

Contextual grounding is incorrect because grounding is a technique for improving answer accuracy by connecting model responses to trusted context, such as RAG sources. It is not a security risk.

Prompt injection is incorrect because prompt injection involves malicious input that attempts to override or manipulate model behavior at inference time. The question does not describe a malicious prompt. It describes accidental exposure from training data.

Therefore, the correct security risk is data leakage.

The problem involves a simple probability calculation that can be handled efficiently by straightforward mathematical rules and computations. Using machine learning techniques would introduce unnecessary complexity and operational overhead.

Option C (Correct): " Use code that will calculate probability by using simple rules and computations " : This is the correct answer because it directly solves the problem with minimal overhead, using basic probability rules.

Option A: " Use supervised learning to create a regression model " is incorrect as it overcomplicates the solution for a simple probability problem.

Option B: " Use reinforcement learning to train a model " is incorrect because reinforcement learning is not needed for a simple probability calculation.

Option D: " Use unsupervised learning to create a model " is incorrect as unsupervised learning is not applicable to this task.

AWS AI Practitioner References:

Choosing the Right Solution for AI Tasks: AWS recommends using the simplest and most efficient approach to solve a given problem, avoiding unnecessary machine learning techniques for straightforward tasks.

The retail company wants to build an ML model for product recommendations using responsible practices to decrease model bias. Collecting balanced and diverse data ensures the model does not favor specific groups, reducing bias and promoting fairness, a key responsible AI practice.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

" To reduce model bias, it is critical to collect balanced and diverse data that represents various demographics and user groups. This practice ensures fairness and prevents the model from disproportionately favoring certain populations. "

(Source: AWS AI Practitioner Learning Path, Module on Responsible AI)

Detailed Explanation:

Option A: Use data from only customers who match the demography of the company ' s overall customer base.Limiting data to a specific demographic may reinforce existing biases, failing to address underrepresented groups and increasing bias.

Option B: Collect data from customers who have a past purchase history.Focusing only on customers with purchase history may exclude new users, potentially introducing bias, and does not address diversity.

Option C: Ensure that the data is balanced and collected from a diverse group.This is the correct answer. A balanced and diverse dataset reduces bias by ensuring the model learns from a representative sample, aligning with responsible AI practices.

Option D: Ensure that the data is from a publicly available dataset.Public datasets may not be diverse or representative of the company’s customer base and could introduce unrelated biases, failing to address fairness.

The verified answer is D. Enhanced ability to identify bias and improve model governance. Increasing model transparency improves the ability of technical teams, business stakeholders, risk teams, and compliance teams to understand how a model behaves, what factors influence its predictions, and whether it shows unfair or biased behavior. AWS SageMaker Clarify documentation states that SageMaker Clarify provides tools to help explain how machine learning models make predictions. These tools help modelers, developers, and internal stakeholders understand model characteristics before deployment and debug predictions after deployment.

AWS also connects transparency directly to fairness, bias detection, explainability, and governance. AWS guidance states that SageMaker Clarify can be used to create comprehensive reports on model fairness and explainability for stakeholders, including risk and compliance-aligned teams and external regulators. These reports document bias detection and mitigation efforts and provide transparency into responsible AI practices. This directly supports option D because transparency improves the organization’s ability to identify bias and strengthen governance.

Option A is incorrect because transparency does not reduce the need for validation. A transparent model still requires validation, testing, monitoring, and governance controls. Option B is incorrect because transparency does not eliminate regulatory compliance monitoring. In fact, transparency often supports and strengthens compliance monitoring rather than replacing it. Option C is incorrect because transparency does not automatically remove all bias. It helps teams detect, explain, measure, and mitigate bias, but bias mitigation still requires deliberate actions such as representative data preparation, metric evaluation, retraining, sampling changes, or governance review.

Therefore, the correct outcome of increasing model transparency is an improved ability to identify bias and improve model governance.

Creating an Amazon Bedrock knowledge base allows the integration of external or private data sources with a foundation model (FM) like Amazon Titan. This integration helps supplement the model with relevant data from the company ' s private data sources to enhance its responses.

Option C (Correct): " Create an Amazon Bedrock knowledge base " : This is the correct answer as it enables the company to incorporate private data into the FM to improve its effectiveness.

Option A: " Use a different FM " is incorrect because it does not address the need to supplement the current model with private data.

Option B: " Choose a lower temperature value " is incorrect as it affects output randomness, not the integration of private data.

Option D: " Enable model invocation logging " is incorrect because logging does not help in supplementing the model with additional data.

AWS AI Practitioner References:

Amazon Bedrock and Knowledge Integration: AWS explains how creating a knowledge base allows Amazon Bedrock to use external data sources to improve the FM’s relevance and accuracy.

To implement a large language model (LLM) responsibly, the firm should focus on fairness and mitigating bias, which are critical for ethical AI deployment.

A. Include Fairness Metrics for Model Evaluation:

Fairness metrics help ensure that the model ' s predictions are unbiased and do not unfairly discriminate against any group.

These metrics can measure disparities in model outcomes across different demographic groups, ensuring responsible AI practices.

C. Modify the Training Data to Mitigate Bias:

Adjusting training data to be more representative and balanced can help reduce bias in the model ' s predictions.

Mitigating bias at the data level ensures that the model learns from a diverse and fair dataset, reducing potential harms in deployment.

Why Other Options are Incorrect:

B. Adjust the temperature parameter of the model: Controls randomness in outputs but does not directly address fairness or bias.

D. Avoid overfitting on the training data: Important for model generalization but not directly related to responsible AI practices regarding fairness and bias.

E. Apply prompt engineering techniques: Useful for improving model outputs but not specifically for mitigating bias or ensuring fairness.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon Neptune is a fully managed graph database service optimized for storing and querying highly connected data.

AWS guidance highlights that graph databases are ideal for:

Fraud detection

Relationship analysis

Pattern discovery across entities such as users, transactions, and accounts

Amazon Neptune supports popular graph models and enables ML-driven investigations by efficiently traversing relationships, which is critical for fraud pattern analysis.

Why the other options are incorrect:

OpenSearch (A) is optimized for search and log analytics.

Aurora (B) is a relational database, not graph-based.

MemoryDB (D) is an in-memory data store for low-latency workloads.

AWS AI document references:

Amazon Neptune Overview

Graph-Based Fraud Detection on AWS

Using Graph Databases for Investigations

Reinforcement learning allows a model to learn and improve over time based on feedback from its environment. In this case, the chatbot can improve its responses by being rewarded for positive customer feedback, which aligns well with the goal of self-improvement based on past interactions and new information.

Option B (Correct): " Reinforcement learning with rewards for positive customer feedback " : This is the correct answer as reinforcement learning enables the chatbot to learn from feedback and adapt its behavior accordingly, providing self-improvement capabilities.

Option A: " Supervised learning with a manually curated dataset " is incorrect because it does not support continuous learning from new interactions.

Option C: " Unsupervised learning to find clusters of similar customer inquiries " is incorrect because unsupervised learning does not provide a mechanism for improving responses based on feedback.

Option D: " Supervised learning with a continuously updated FAQ database " is incorrect because it still relies on manually curated data rather than self-improvement from feedback.

AWS AI Practitioner References:

Reinforcement Learning on AWS: AWS provides reinforcement learning frameworks that can be used to train models to improve their performance based on feedback.

The correct answer is B – Use Amazon Bedrock batch inference, which allows asynchronous generation of large-scale model outputs through APIs without requiring low-latency performance. According to AWS Bedrock documentation, batch inference is ideal for high-volume workloads that can tolerate delay, such as bulk content generation or summarization jobs. Unlike real-time inference, it processes requests in bulk, reducing cost and operational load. AWS handles the queuing, processing, and scaling automatically. Bedrock Agents (option C) are for workflow orchestration, not large-scale generation. AWS Lambda (option D) can automate tasks but is not optimized for high-volume LLM calls. Batch inference provides cost efficiency, scalability, and simplicity for delayed, asynchronous generation needs.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Batch Inference

AWS ML Specialty Study Guide – Scalable Inference Options