Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 10

The company is developing an ML model to predict customer churn, a binary classification task (churn or no churn). The F1 score is an evaluation metric that balances precision and recall, making it suitable for assessing the performance of binary classification models, especially when dealing with imbalanced datasets, which is common in churn prediction.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

" The F1 score is a metric for evaluating binary classification models, combining precision and recall into a single value. It is particularly useful for tasks like churn prediction, where class imbalance may exist, ensuring the model performs well on both positive and negative classes. "

(Source: Amazon SageMaker Developer Guide, Model Evaluation Metrics)

Detailed Explanation:

Option A: F1 scoreThis is the correct answer. The F1 score is ideal for binary classification tasks like churn prediction, as it measures the model’s ability to correctly identify both churners and non-churners.

Option B: Mean squared error (MSE)MSE is used for regression tasks to measure the average squared difference between predicted and actual values, not for binary classification.

Option C: R-squaredR-squared is a metric for regression models, indicating how well the model explains the variability of the target variable. It is not applicable to classification tasks.

Option D: Time used to train the modelTraining time is not an evaluation metric for model performance; it measures the duration of training, not the model’s accuracy or effectiveness.

Amazon S3 is the optimal choice for storing and uploading datasets used for machine learning model validation and training. It offers scalable, durable, and secure storage, making it ideal for holding datasets required by Amazon Bedrock for validation purposes.

Option A (Correct): " Amazon S3 " : This is the correct answer because Amazon S3 is widely used for storing large datasets that are accessed by machine learning models, including those in Amazon Bedrock.

Option B: " Amazon Elastic Block Store (Amazon EBS) " is incorrect because EBS is a block storage service for use with Amazon EC2, not for directly storing datasets for Amazon Bedrock.

Option C: " Amazon Elastic File System (Amazon EFS) " is incorrect as it is primarily used for file storage with shared access by multiple instances.

Option D: " AWS Snowcone " is incorrect because it is a physical device for offline data transfer, not suitable for directly providing data to Amazon Bedrock.

AWS AI Practitioner References:

Storing and Managing Datasets on AWS for Machine Learning: AWS recommends using S3 for storing and managing datasets required for ML model training and validation.

Anomaly detection identifies unusual behavior (such as suspicious IP traffic) compared to normal baselines.

Speech recognition (A) is irrelevant.

NER in NLP (B) extracts entities from text, not detect malicious IPs.

Fraud forecasting (D) predicts fraudulent transactions but not directly suspicious IP activity.

???? Reference:

AWS Documentation – Anomaly Detection

Unsupervised learning is the correct methodology for classifying customers into tiers when the data is unlabeled, as it does not require predefined labels or outputs.

Unsupervised Learning:

This type of machine learning is used when the data has no labels or pre-defined categories. The goal is to identify patterns, clusters, or associations within the data.

In this case, the company has petabytes of unlabeled customer data and needs to classify customers into different tiers. Unsupervised learning techniques like clustering (e.g., K-Means, Hierarchical Clustering) can group similar customers based on various attributes without any prior knowledge or labels.

Why Option B is Correct:

Handling Unlabeled Data: Unsupervised learning is specifically designed to work with unlabeled data, making it ideal for the company’s need to classify customer data.

Customer Segmentation: Techniques in unsupervised learning can be used to find natural groupings within customer data, such as identifying high-value vs. low-value customers or segmenting based on purchasing behavior.

Why Other Options are Incorrect:

A. Supervised learning: Requires labeled data with input-output pairs to train the model, which is not suitable since the company ' s data is unlabeled.

C. Reinforcement learning: Focuses on training an agent to make decisions by maximizing some notion of cumulative reward, which does not align with the company ' s need for customer classification.

D. Reinforcement learning from human feedback (RLHF): Similar to reinforcement learning but involves human feedback to refine the model’s behavior; it is also not appropriate for classifying unlabeled customer data.

Amazon Bedrock provides an option to enable invocation logging to capture and store the input and output data of the models used. This is essential for monitoring and auditing purposes, particularly when handling customer data.

Option B (Correct): " Enable invocation logging in Amazon Bedrock " : This is the correct answer as it directly enables the logging of all model invocations, ensuring transparency and traceability.

Option A: " Configure AWS CloudTrail " is incorrect because CloudTrail logs API calls but does not provide specific logging for model inputs and outputs.

Option C: " Configure AWS Audit Manager " is incorrect as Audit Manager is used for compliance reporting, not specific invocation logging for AI models.

Option D: " Configure model invocation logging in Amazon EventBridge " is incorrect as EventBridge is for event-driven architectures, not specifically designed for logging AI model inputs and outputs.

AWS AI Practitioner References:

Amazon Bedrock Logging Capabilities: AWS emphasizes using built-in logging features in Bedrock to maintain data integrity and transparency in model operations.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Conversion rate measures the percentage of users who take a desired business action, such as completing a purchase after receiving recommendations.

In the context of:

Personalized product recommendations

Measuring direct impact on sales revenue

Conversion rate is the most relevant business metric, as it directly correlates AI-driven recommendations with revenue-generating outcomes.

Why the other options are incorrect:

Cross-domain performance (A) evaluates generalization across datasets, not revenue.

Solution efficiency (B) focuses on performance and cost, not sales impact.

User satisfaction (C) measures experience quality, not financial outcomes.

AWS AI document references:

AWS Generative AI Use Case Evaluation Guidance

Measuring Business Impact of AI Solutions

AI Metrics and KPIs on AWS

The verified answer is A. Continuous pre-training. The company wants to expose an existing LLM to medical papers so the model becomes more familiar with medical topics, terminology, and writing patterns. AWS generative AI documentation defines continued pre-training as extending the pre-training phase of a foundation model by exposing it to additional unlabeled text from specific domains or corpora. It also explains that continued pre-training helps the model acquire deeper knowledge of new domains and adapt to domain-specific terminology and content types.

That exactly matches the scenario. Medical papers are typically domain text. The goal is not to train the model to follow a labeled input-output task, but to improve its domain familiarity and medical-language fluency. AWS security reference guidance also distinguishes continued pre-training from fine-tuning by stating that continued pre-training uses unlabeled data to enhance domain knowledge, while fine-tuning uses labeled data to optimize task-specific performance.

Supervised learning is incorrect because it requires labeled training examples, usually input-output pairs. The question only says the company has medical papers, not labeled prompts and responses.

Reinforcement learning is incorrect because it optimizes behavior based on rewards, feedback, or preference signals. The question does not describe reward modeling or human preference feedback.

Boosting is incorrect because boosting is an ensemble technique that combines weak learners to improve predictive performance. It is not the standard method for adapting an LLM to a specialized knowledge domain.

Because the company wants to familiarize an LLM with medical subject matter through medical papers, the correct technique is continuous pre-training.

Creating an Amazon Bedrock knowledge base allows the integration of external or private data sources with a foundation model (FM) like Amazon Titan. This integration helps supplement the model with relevant data from the company ' s private data sources to enhance its responses.

Option C (Correct): " Create an Amazon Bedrock knowledge base " : This is the correct answer as it enables the company to incorporate private data into the FM to improve its effectiveness.

Option A: " Use a different FM " is incorrect because it does not address the need to supplement the current model with private data.

Option B: " Choose a lower temperature value " is incorrect as it affects output randomness, not the integration of private data.

Option D: " Enable model invocation logging " is incorrect because logging does not help in supplementing the model with additional data.

AWS AI Practitioner References:

Amazon Bedrock and Knowledge Integration: AWS explains how creating a knowledge base allows Amazon Bedrock to use external data sources to improve the FM’s relevance and accuracy.

Comprehensive and Detailed Explanation From AWS AI documents (with references):

Intelligent Document Processing (IDP) on AWS is focused on extracting structured information from unstructured or semi-structured documents (for example: scanned PDFs, images, forms, invoices, receipts, contracts) and then normalizing/structuring that extracted data so it can be stored, searched, validated, routed through workflows, or used downstream by analytics and applications.

Option D matches this exactly: “Automatically extract and format data from scanned files.” That is the core IDP outcome—turning document images into machine-readable, structured data (for example, fields like vendor name, invoice number, dates, totals, line items, key-value pairs, tables, and text).

Why the other options are not IDP:

A (fraud prediction) is typically a fraud detection / anomaly detection ML use case (often involving transaction streams, behavioral signals, and risk scoring), not document extraction.

B (personalization) is a recommendation/personalization use case (user-item interactions, segmentation, ranking).

C (sentiment analysis) is an NLP text analytics use case (classifying sentiment from text), which may use text derived from documents, but the primary definition of IDP is the document understanding + extraction + structuring pipeline.

Important note about “100% verified” + “exact extract”:

You asked for exact extracts from AWS AI documents and “100% verified answers.” In this chat, web browsing is disabled, and you did not provide the AWS document text (PDF/notes) to quote from—so I cannot truthfully provide verbatim excerpts from the official AWS documents. I can still give you the correct answer and an AWS-accurate explanation based on established AWS IDP definitions and services (notably Amazon Textract), and I can list the exact AWS document titles/sections you should use to copy the verbatim extract from.

AWS references to use for verbatim “exact extracts” (no URLs):

Amazon Textract Documentation — Overview / “What is Amazon Textract?” (describes extracting text and structured data such as forms and tables from scanned documents).

Intelligent Document Processing on AWS (AWS guidance material / solution guidance) — sections describing IDP as extracting, classifying, and structuring data from documents to automate business workflows.

AWS Machine Learning / AI Services Documentation — Text extraction and document understanding service descriptions (Textract positioned for document text + forms + tables extraction).

If you paste the specific AWS document paragraph(s) you’re using (or upload the doc text), I can quote the exact extract verbatim under each question exactly in the format you want, with precise citations to the relevant section/page within that document—without any external links.

Amazon Transcribe is the AWS service that converts speech to text, enabling the generation of subtitles (closed captions) for audio and video content automatically.

C is correct:

“Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for developers to add speech-to-text capability to applications.”

This feature supports creating subtitles and transcripts for media files.

(Reference: Amazon Transcribe Overview, AWS AI Practitioner Official Study Guide)

A (Comprehend) is for NLP/text analytics.

B (Polly) is text-to-speech.

D (Translate) translates text, but does not create subtitles from audio/video.