Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 3

BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine-generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human translations.

Option A (Correct): "Bilingual Evaluation Understudy (BLEU)": This is the correct answer because BLEU is specifically designed to evaluate the quality of translations, making it suitable for the company's use case.

Option B: "Root mean squared error (RMSE)" is incorrect because RMSE is used for regression tasks to measure prediction errors, not translation quality.

Option C: "Recall-Oriented Understudy for Gisting Evaluation (ROUGE)" is incorrect as it is used to evaluate text summarization, not translation.

Option D: "F1 score" is incorrect because it is typically used for classification tasks, not for evaluating translation accuracy.

AWS AI Practitioner References:

Model Evaluation Metrics on AWS: AWS supports various metrics like BLEU for specific use cases, such as evaluating machine translation models.

Amazon SageMaker is AWS’s fully managed ML service that supports retraining and deploying models with new, recent data for continuous improvement. This directly meets the requirement to iterate and continuously improve model accuracy.

A is correct:

"Amazon SageMaker enables teams to retrain models using the most recent data, ensuring ongoing improvement in model accuracy."

(Reference: Amazon SageMaker Overview)

B (Amazon Personalize) is for recommendations, not general ML or waste reduction.

C (CloudWatch) is for monitoring, not ML training or deployment.

D (Rekognition) is for image/video analysis.

Amazon SageMaker Model Cards document model details, performance, intended use cases, and risk considerations. They support responsible AI by improving transparency and governance.

Rekognition is computer vision.

Comprehend is NLP for entity/sentiment.

Lex is conversational AI.

???? Reference:

AWS Documentation – SageMaker Model Cards

The correct answer is C, because Amazon Nova Micro is a smaller, lower-cost foundation model that is text-only, while Nova Lite is a more capable multimodal model that supports images, videos, and text. According to AWS Bedrock documentation, the Nova model family includes variants that differ in capability and cost. Nova Micro is optimized for lightweight text-based tasks, including summarization, question answering, and basic reasoning. This makes it cheaper to operate and well-suited for cost-sensitive workloads. Nova Lite, on the other hand, is a multimodal FM that can analyze documents, screenshots, photographs, charts, and videos, making it ideal for media companies requiring cross-format understanding. AWS clarifies that both Micro and Lite use transformer-based architectures, and run on managed infrastructure that abstracts hardware considerations. Therefore, the main differentiator is capability—and Nova Micro being text-only is the more cost-effective option. Nova Lite is appropriate only when image or video analysis is required.

Referenced AWS Documentation:

Amazon Bedrock – Nova Model Family Overview

AWS Generative AI Model Selection Guide

Diffusion models are state-of-the-art generative models for creating high-quality, realistic images from textual prompts or other forms of conditioning. These are the foundational technology behind tools like Amazon Bedrock Titan Image Generator and other generative image models.

Amazon SageMaker Canvas is a visual, no-code tool for building and deploying ML models. According to the official SageMaker Canvas documentation:

“SageMaker Canvas provides a visual point-and-click interface that allows business analysts to generate accurate ML predictions without writing any code.”

The correct answer is A – Data residency. AWS defines data residency as ensuring that regulated or sensitive data—such as patient medical records under healthcare laws—remains physically stored and processed within specific national or regional boundaries. This aligns with regulatory frameworks such as HIPAA, GDPR, and country-specific health data protection acts. AWS allows customers to deploy all ML workloads, including Amazon SageMaker, Amazon Bedrock, and Amazon S3, within a chosen AWS Region, ensuring no cross-border data movement unless explicitly configured. Data quality (B) refers to accuracy and consistency, discoverability (C) relates to cataloging, and enrichment (D) refers to enhancing datasets. None of these address the compliance requirement to prevent data from leaving the country. Data residency is a core component of AWS’s Shared Responsibility Model and foundational for healthcare AI compliance.

Referenced AWS Documentation:

AWS Data Privacy Whitepaper – Data Residency Controls

AWS Compliance Programs – Regional Data Handling Requirements

The F1 score is the harmonic mean of precision and recall, making it a balanced metric for evaluating model performance when there is an imbalance between false positives and false negatives. Speed, cost, and energy efficiency are unrelated to the F1 score. References: AWS Foundation Models Guide.

The correct answer is D because Few-shot prompting involves providing the LLM with a few examples of the expected input-output format. This helps the model learn and mimic the pattern or structure required in the response — such as generating product descriptions that follow a specific template.

From AWS documentation:

"Few-shot prompting helps guide the model to produce structured and domain-specific outputs by supplying a small number of example inputs and corresponding outputs."

Explanation of other options:

A. Zero-shot prompting provides no examples, which may lead to inconsistent formatting.

B. Chain-of-thought prompting is used to guide reasoning steps, not formatting.

C. One-shot prompting uses a single example, but few-shot typically yields better structure adherence.

Referenced AWS AI/ML Documents and Study Guides:

AWS Prompt Engineering Guide

Amazon Bedrock Developer Documentation – Prompting Techniques

AWS ML Specialty Study Guide – LLM Prompting Patterns

To manage the flow of data from Amazon S3 to SageMaker Studio notebooks securely, using a VPC with an S3 endpoint is the best solution.

Amazon SageMaker and S3 Integration:

Configuring SageMaker to use a Virtual Private Cloud (VPC) with an S3 endpoint allows the data flow between Amazon S3 and SageMaker Studio notebooks to occur over a private network.

This setup ensures that traffic between SageMaker and S3 does not traverse the public internet, enhancing security and performance.

Why Option C is Correct:

Secure Data Transfer: Ensures secure, private connectivity between SageMaker and S3, reducing exposure to potential security risks.

Direct Access to S3: Using an S3 endpoint in a VPC allows direct access to data in S3 without leaving the AWS network.

Why Other Options are Incorrect:

A. Amazon Inspector: Focuses on identifying security vulnerabilities, not managing data flow.

B. Amazon Macie: Monitors for sensitive data but does not manage data flow between S3 and SageMaker.

D. S3 Glacier Deep Archive: Is a storage class for archiving data, not for managing active data flow.