Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers

The verified answer is C. F1 score. This is a classification problem: the model classifies transactions as fraudulent or non-fraudulent. AWS machine learning documentation identifies accuracy, precision, recall, and F1 score as classification evaluation metrics. F1 score is especially appropriate when the evaluation must consider both correct positive predictions and the cost of incorrect positive predictions. AWS defines F1 as the harmonic mean of precision and recall, which means it balances how many positive predictions are correct with how many actual positive cases are found.

The key issue in the question is minimizing false positives. In fraud detection, a false positive means a legitimate transaction is incorrectly classified as fraudulent. AWS documentation explains that precision evaluates how well the model avoids false positives by measuring the percentage of positive predictions that were actually correct. Because F1 includes precision, it penalizes models that generate too many false positives while also considering recall.

Accuracy is not the best answer because it only measures the overall fraction of correct predictions. In fraud detection, the dataset is often imbalanced, so a model can appear accurate while still performing poorly on fraud-related predictions. R-squared and RMSE are regression metrics, not classification metrics. R-squared measures how well a regression model explains variance, and RMSE measures prediction error magnitude for continuous numeric outputs.

Because the company needs a classification metric that reflects correct predictions and penalizes false-positive behavior, F1 score is the strongest option among the choices.

An anomaly detection system is suitable for identifying unusual patterns or behaviors, such as suspicious IP addresses, which might indicate a potential threat.

Anomaly Detection:

Anomaly detection uses machine learning algorithms to identify deviations from normal behavior, such as unexpected traffic from a suspicious IP address.

This is a common approach for identifying potential threats or malicious activity in cybersecurity applications.

Why Option C is Correct:

Detects Suspicious Behavior: An anomaly detection system can monitor and detect IP addresses that exhibit unusual or suspicious patterns.

Real-time Monitoring: Provides continuous analysis of network traffic to identify potential security threats.

Why Other Options are Incorrect:

A. Speech recognition system: Is unrelated to detecting suspicious IP addresses.

B. NLP named entity recognition: Focuses on identifying entities in text, not IP address analysis.

D. Fraud forecasting system: Generally used for predicting fraud, not directly applicable to identifying suspicious IPs.

Thus, C is the correct answer for detecting suspicious IP addresses.

Chain-of-thought prompting is a prompt engineering technique where you instruct the model to explain its reasoning step by step, which is particularly useful for tasks involving logic, math, or reasoning.

A is correct: Asking the model to " explain its reasoning step by step " directly invokes chain-of-thought prompting, as documented in AWS and generative AI literature.

B is unrelated (prompt injection is a security concern).

C (few-shot) provides examples, but doesn’t specifically require step-by-step reasoning.

D (templating) is about structuring the prompt format.

" Chain-of-thought prompting elicits step-by-step explanations from LLMs, which improves performance on complex reasoning tasks. "

(Reference: Amazon Bedrock Prompt Engineering Guide, AWS Certified AI Practitioner Study Guide)

Moderation APIs, such as Amazon Rekognition’s Content Moderation API, can help filter and block inappropriate or unwanted images from being returned by a chatbot. These APIs are specifically designed to detect and manage undesirable content in images.

Option A (Correct): " Implement moderation APIs " : This is the correct answer because moderation APIs are designed to identify and filter inappropriate content, ensuring the chatbot does not return unwanted images.

Option B: " Retrain the model with a general public dataset " is incorrect because retraining does not directly prevent inappropriate content from being returned.

Option C: " Perform model validation " is incorrect as it ensures model correctness, not content moderation.

Option D: " Automate user feedback integration " is incorrect because user feedback does not prevent inappropriate images in real-time.

AWS AI Practitioner References:

AWS Content Moderation Services: AWS provides moderation APIs for filtering unwanted content from applications.

Amazon Comprehend is the correct service to analyze customer support interactions and identify frequently asked questions and insights.

Amazon Comprehend:

A natural language processing (NLP) service that uses machine learning to uncover insights and relationships in text.

Capable of extracting key phrases, detecting entities, analyzing sentiment, and identifying topics from text data, making it ideal for analyzing customer support interactions.

Why Option B is Correct:

Text Analysis Capabilities: Can process large volumes of text to identify common topics, phrases, and sentiment, providing valuable insights.

Suitable for Customer Support Analysis: Specifically designed to understand the content and meaning of text, which is key for identifying frequently asked questions.

Why Other Options are Incorrect:

A. Amazon Lex: Used for building conversational interfaces, not for text analysis.

C. Amazon Transcribe: Converts speech to text but does not perform text analysis.

D. Amazon Translate: Used for translating text between languages, not for analyzing content.

Exploratory data analysis (EDA) involves understanding the data by visualizing it, calculating statistics, and creating correlation matrices. This stage helps identify patterns, relationships, and anomalies in the data, which can guide further steps in the ML pipeline.

Option C (Correct): " Exploratory data analysis " : This is the correct answer as the tasks described (correlation matrix, calculating statistics, visualizing data) are all part of the EDA process.

Option A: " Data pre-processing " is incorrect because it involves cleaning and transforming data, not initial analysis.

Option B: " Feature engineering " is incorrect because it involves creating new features from raw data, not analyzing the data ' s existing structure.

Option D: " Hyperparameter tuning " is incorrect because it refers to optimizing model parameters, not analyzing the data.

AWS AI Practitioner References:

Stages of the Machine Learning Pipeline: AWS outlines EDA as the initial phase of understanding and exploring data before moving to more specific preprocessing, feature engineering, and model training stages.

The company wants to fine-tune an ML model on Amazon Bedrock using sensitive data stored in private databases within a VPC, ensuring the data remains within its private network. AWS PrivateLink provides a secure, private connection between a VPC and AWS services like Amazon Bedrock, allowing data to stay within the company’s network without traversing the public internet. This meets the requirement for maintaining data privacy during fine-tuning.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" AWS PrivateLink enables you to securely connect your VPC to Amazon Bedrock without exposing data to the public internet. This is particularly useful for fine-tuning models with sensitive data, as it ensures that data remains within your private network. "

(Source: AWS Bedrock User Guide, Security and Networking)

Detailed Explanation:

Option A: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) service role.While IAM service roles control access to Amazon Bedrock, they do not address the requirement of keeping data within the private network during data transfer. This option is insufficient.

Option B: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) resource policy.IAM resource policies define permissions for Bedrock resources but do not ensure that data stays within the private network. This option is incorrect.

Option C: Use AWS PrivateLink to connect the VPC and Amazon Bedrock.This is the correct answer. AWS PrivateLink creates a secure, private connection between the VPC and Amazon Bedrock, ensuring that sensitive data does not leave the private network during fine-tuning, as required.

Option D: Use AWS Key Management Service (AWS KMS) keys to encrypt the data.While AWS KMS can encrypt data, encryption alone does not guarantee that data remains within the private network during transfer. This option does not fully meet the requirement.

The context window determines how much information can fit into a single prompt when using a large language model (LLM) like those on Amazon Bedrock.

Context Window:

The context window is the maximum amount of text (measured in tokens) that a language model can process in a single pass.

For LLM applications, the size of the context window limits how much input data, such as text for sentiment analysis, can be fed into the model at once.

Why Option B is Correct:

Determines Prompt Size: The context window size directly informs how much information (e.g., words or sentences) can fit in one prompt.

Model Capacity: The larger the context window, the more information the model can consider for generating outputs.

Why Other Options are Incorrect:

A. Temperature: Controls randomness in model outputs but does not affect the prompt size.

C. Batch size: Refers to the number of training samples processed in one iteration, not the amount of information in a prompt.

D. Model size: Refers to the number of parameters in the model, not the input size for a single prompt.

AWS documentation identifies ROUGE as a standard evaluation metric for text summarization tasks. ROUGE measures the overlap of n-grams, sequences, or word pairs between a machine-generated summary and a human-written reference summary, making it ideal for automated evaluation.

In this scenario, the company needs a metric that directly compares generated summaries with human references. ROUGE scores quantify how much of the reference content is captured by the model output, which aligns with AWS recommendations for evaluating summarization quality.

The other metrics are not appropriate. F1 score is typically used for classification tasks. Perplexity measures language model confidence but does not compare outputs to reference summaries. Fréchet Inception Distance is used for image generation tasks, not text.

AWS consistently recommends ROUGE for summarization evaluation, making it the correct choice.