Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 6

The correct answer is B because Amazon Bedrock Prompt Management supports tool use via tools configuration, which enables a prompt to define tools that can invoke external APIs or services.

According to the AWS documentation:

" You can use the tools configuration in Amazon Bedrock to specify external APIs that a foundation model can call during inference. This enables the model to interact with external services, such as invoking functions, retrieving real-time data, or executing workflows. "

The tools configuration allows a prompt to describe which external functions (APIs) are available, their parameters, and how they should be invoked, similar to OpenAI’s function calling or tool use pattern.

Overfitting occurs when an ML model learns the training data too well, including noise and patterns that do not generalize to new data. A key cause of overfitting is when the training dataset does not represent all possible input values, leading the model to over-specialize on the limited data it was trained on, failing to generalize to unseen data.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

" Overfitting often occurs when the training dataset is not representative of the broader population of possible inputs, causing the model to memorize specific patterns, including noise, rather than learning generalizable features. "

(Source: Amazon SageMaker Developer Guide, Model Evaluation and Overfitting)

Detailed Explanation:

Option A: The training dataset does not represent all possible input values.This is the correct answer. If the training dataset lacks diversity and does not cover the range of possible inputs, the model overfits by learning patterns specific to the training data, failing to generalize.

Option B: The model contains a regularization method.Regularization methods (e.g., L2 regularization) are used to prevent overfitting, not cause it. This option is incorrect.

Option C: The model training stops early because of an early stopping criterion.Early stopping is a technique to prevent overfitting by halting training when performance on a validation set degrades. It does not cause overfitting.

Option D: The training dataset contains too many features.While too many features can contribute to overfitting (e.g., by increasing model complexity), this is less directly tied to overfitting than a non-representative dataset. The dataset’s representativeness is the primary cause.

Amazon Bedrock is a fully managed service that provides access to foundation models (FMs) from various providers, enabling users to build and scale generative AI applications. It simplifies the process of integrating FMs into applications for tasks like text generation, chatbots, and more.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Amazon Bedrock is a fully managed service that makes foundation models (FMs) from leading AI providers available through a single API, enabling developers to build and scale generative AI applications with ease. "

(Source: AWS Bedrock User Guide, Introduction to Amazon Bedrock)

Detailed Explanation:

Option A: Amazon Q DeveloperAmazon Q Developer is an AI-powered assistant for coding and AWS service guidance, not a service for hosting or providing foundation models.

Option B: Amazon BedrockThis is the correct answer. Amazon Bedrock provides access to foundation models, making it the primary service for building and scaling generative AI applications.

Option C: Amazon KendraAmazon Kendra is an intelligent search service powered by machine learning, not a service for providing foundation models or building generative AI applications.

Option D: Amazon ComprehendAmazon Comprehend is an NLP service for text analysis tasks like sentiment analysis, not for providing foundation models or supporting generative AI.

To determine customer sentiments based on written customer reviews, the company can use Amazon Comprehend and Amazon Bedrock.

Amazon Comprehend:

A natural language processing (NLP) service that uses machine learning to uncover insights and relationships in text.

Can analyze customer reviews to detect sentiments (positive, negative, neutral, or mixed) automatically.

Amazon Bedrock:

Provides access to foundational models (FMs) from multiple AI companies for tasks such as text generation, summarization, and sentiment analysis.

The company can use a pre-trained sentiment analysis model available on Amazon Bedrock for processing customer reviews.

Why Other Options are Incorrect:

A. Amazon Lex: Used for building conversational interfaces like chatbots, not for sentiment analysis.

C. Amazon Polly: Converts text to speech; it doesn ' t analyze sentiment.

E. Amazon Rekognition: Analyzes images and videos, not text.

Fine-tuning involves training a pre-trained AI model on a labeled dataset specific to a particular task or domain, adapting it to industry terminology and requirements. This process adjusts the model’s parameters to better fit the target use case, such as understanding specialized vocabulary or meeting domain-specific needs.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Fine-tuning allows you to adapt a pre-trained foundation model to your specific use case by training it on a labeled dataset. This technique is commonly used to customize models forindustry-specific terminology, improving their accuracy for specialized tasks. "

(Source: AWS Bedrock User Guide, Model Customization)

Detailed Explanation:

Option A: Data augmentationData augmentation involves generating synthetic data to expand a training dataset, typically for tasks like image or text generation. It does not specifically adapt models to industry terminology or requirements.

Option B: Fine-tuningThis is the correct answer. Fine-tuning trains a pre-trained model on a labeled dataset tailored to the target domain, enabling it to learn industry-specific terminology and requirements, as described in the question.

Option C: Model quantizationModel quantization reduces the precision of a model’s weights to optimize it for deployment (e.g., on edge devices). It does not involve training on labeled datasets or adapting to industry terminology.

Option D: Continuous pre-trainingContinuous pre-training extends the initial training of a model on a large, general dataset. While it can improve general performance, it is not specifically tailored to industry requirements using labeled datasets, unlike fine-tuning.

Comprehensive and Detailed Explanation (AWS AI documents):

Overfitting occurs when an ML model learns patterns too closely from training data, including noise, and fails to generalize to unseen data. According to AWS ML fundamentals, a key indicator of overfitting is high training accuracy combined with reduced accuracy on new or test data.

Option A directly reflects this behavior: the model performs well during training but loses accuracy when evaluated on new data, which is a textbook symptom of overfitting.

Why the other options are not overfitting:

B describes an under-featured model (underfitting risk).

C indicates poor data representativeness, not overfitting.

D reflects limited feature selection, which may lead to underfitting or bias, not overfitting.

AWS AI Study Guide References:

AWS Machine Learning concepts: bias vs. variance

AWS training and evaluation best practices

Reinforcement learning from human feedback (RLHF) is the most effective approach to align large language models with company-specific values, ethics, and evolving moderation requirements. AWS documentation explains that RLHF uses direct human input to guide model behavior, enabling models to learn preferences that cannot be fully captured through static datasets or generic fine-tuning.

In this scenario, the company requires improvement within a short time frame of three months, alignment with organizational ethics, and adaptability to emerging trends and new forms of harmful content. RLHF meets these needs by incorporating real-time feedback from skilled human moderators, allowing the model to rapidly adjust its responses based on expert judgment.

AWS highlights that RLHF is particularly valuable for content moderation, safety alignment, and policy enforcement, where nuanced decisions and evolving standards are common. By rewarding desirable behaviors and penalizing undesirable outputs, the model continuously improves in a controlled and targeted manner.

The other options are less suitable. Continuous pre-training on large internet datasets is time-consuming, resource-intensive, and may introduce content misaligned with company values. Historical moderation datasets may not reflect new or emerging content patterns. Fine-tuning on general ethical guidelines lacks the specificity required for company-defined moderation policies and does not adapt quickly to new risks.

AWS positions RLHF as a key technique in responsible generative AI development, enabling organizations to maintain human oversight while improving model safety and alignment. Therefore, using RLHF with real-time input from skilled moderators is the most effective and compliant solution for this use case.

The least operational overhead comes from automated tools that can scan and evaluate LLM outputs for toxicity. AWS and SageMaker JumpStart support integrations with automatic evaluation tools and APIs (such as Amazon Comprehend or third-party toxicity classifiers).

B is correct: Automated evaluation provides quick, scalable, and repeatable analysis, requiring minimal human intervention.

A and C require manual effort, increasing operational overhead.

D (RLHF) is resource-intensive and not designed for rapid, automated model comparison.

" Automated evaluation can quickly assess generated text for specific attributes like toxicity, sentiment, or compliance using pre-trained classifiers, reducing human involvement and operational complexity. "

(Reference: AWS SageMaker JumpStart Evaluation, AWS AI Practitioner Guide)

To comply with the company ' s security policy, which restricts each team to access data for only their own customers, creating an Amazon Bedrock custom service role for each team is the correct solution.

Custom Service Role Per Team:

A custom service role for each team ensures that the access control is granular, allowing only specific teams to access their own customer data in Amazon S3.

This setup aligns with the principle of least privilege, ensuring teams can only interact with data they are authorized to access.

Why Option A is Correct:

Access Control: Allows precise access permissions for each team ' s data.

Security Compliance: Directly meets the company ' s security policy requirements by ensuring data segregation.

Why Other Options are Incorrect:

B. Custom service role with customer name specification: This approach is impractical as it relies on manual input, which is prone to errors and does not inherently enforce data access controls.

C. Redacting personal data and updating S3 bucket policy: Redaction does not solve the requirement for team-specific access, and updating bucket policies is less granular than creating roles.

D. One Bedrock role with full S3 access and IAM roles for teams: This setup does not meet the least privilege principle, as having a single role with full access is contrary to the company ' s security policy.

Thus, A is the correct answer to meet the company ' s security requirements.

Network isolation is a key security feature for SageMaker. It ensures that training and inference jobs run in a VPC and are not accessible from the internet. Per the official SageMaker documentation:

“When you enable network isolation, your model can’t make any outbound network calls. This is useful for security and regulatory compliance when working with sensitive data.”