Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 9

The correct answer is C because Continued Pre-training (also known as domain-adaptive pre-training) involves training a pre-trained model further on unlabeled domain-specific data. This method helps adapt the LLM to a specific domain without needing labeled datasets, making it ideal for cases where the goal is to enhance the model’s understanding of technical language or terminology.

From AWS documentation:

" Continued pre-training allows an LLM to ingest large volumes of domain-specific text without labels to improve contextual understanding in a particular area. This is effective when adapting a foundation model to new knowledge without altering the model architecture. "

Explanation of other options:

A. Full training refers to building a model from scratch, which is extremely resource-intensive and unnecessary if a strong base model already exists.

B. Supervised fine-tuning requires labeled data, which the scenario explicitly lacks.

D. RAG is a method to retrieve external information at inference time, not a training technique using unlabeled data.

Referenced AWS AI/ML Documents and Study Guides:

AWS Bedrock Model Customization Documentation – Continued Pre-training

Amazon SageMaker JumpStart – Domain Adaptation Techniques

AWS Machine Learning Specialty Study Guide – Foundation Model Customization Section

Precision is the metric that measures the proportion of true positives (actual frauds) among all flagged positives (flagged frauds). High precision ensures that most of the flagged cases are truly fraudulent, minimizing the number of false positives employees must review.

C is correct:

" Precision is the ratio of true positives to all predicted positives, and it answers: ‘Of all the cases flagged as fraud, how many were actually fraud?’ High precision means fewer non-fraudulent cases are sent for manual review. "

(Reference: AWS ML Concepts – Precision and Recall, AWS Certified AI Practitioner Study Guide)

A (Recall) measures how many actual frauds are caught, but does not minimize false positives.

B (Accuracy) can be misleading in imbalanced datasets (like fraud detection).

Measuring the model ' s accuracy against a predefined benchmark dataset is the correct strategy to evaluate the accuracy of a foundation model (FM) used in image classification tasks.

Model Accuracy Evaluation:

In image classification, the accuracy of a model is typically evaluated by comparing the predicted labels with the true labels in a benchmark dataset that is representative of the real-world data the model will encounter.

This approach provides a quantifiable measure of how well the model performs on known data and is a standard practice in machine learning.

Why Option B is Correct:

Benchmarking Accuracy: Using a predefined dataset allows for consistent and reliable evaluation of model performance.

Standard Practice: It is a widely accepted method for assessing the effectiveness of image classification models.

Why Other Options are Incorrect:

A. Total cost of resources: Does not measure model accuracy but rather the cost of operation.

C. Number of layers in the neural network: Does not directly correlate with the accuracy or performance of the model.

D. Color accuracy of images processed by the model: Is unrelated to the model’s classification accuracy.

The correct answer is B because K-means is an unsupervised learning algorithm used for clustering data points into groups (clusters) based on feature similarity. It is ideal for customer segmentation use cases where the goal is to discover natural groupings based on buying behavior and demographics without pre-labeled data.

From AWS documentation:

" K-means is a clustering algorithm that assigns data points to one of K groups based on feature similarity. It is commonly used in marketing and customer segmentation to group users with similar characteristics. "

Explanation of other options:

A. K-nearest neighbors is a supervised classification algorithm, not intended for clustering.

C. Decision tree is also a supervised learning method used for classification or regression tasks.

D. Support vector machine is used for classification and regression, not unsupervised clustering.

Referenced AWS AI/ML Documents and Study Guides:

AWS ML Specialty Guide – Unsupervised Learning and Clustering

AWS ML Algorithm Selection Guide

Amazon SageMaker Built-in Algorithms – K-means Clustering

The ML research team needs a mechanism to audit custom ML models while sharing model artifacts with other teams. Amazon SageMaker Model Cards provide a structured way todocument model details, including intended uses, training data, and inference performance, making them ideal for auditing and ensuring transparency when publishing models.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

" Amazon SageMaker Model Cards enable you to document critical details about your machine learning models, such as intended uses, training data, evaluation metrics, and inference details. Model Cards support auditing by providing a centralized record that can be reviewed by teams to understand model behavior and limitations. "

(Source: Amazon SageMaker Developer Guide, SageMaker Model Cards)

Detailed Explanation:

Option A: Create documents with the relevant information. Store the documents in Amazon S3.While storing documents in S3 is feasible, it lacks the structured format and integration with SageMaker that Model Cards provide, making it less suitable for auditing purposes.

Option B: Use AWS AI Service Cards for transparency and understanding models.AWS AI Service Cards are not a standard feature in AWS documentation. This option appears to be a distractor and is not a valid solution.

Option C: Create Amazon SageMaker Model Cards with Intended uses and training and inference details.This is the correct answer. SageMaker Model Cards are specifically designed to document model details for auditing, transparency, and collaboration, meeting the team’s requirements.

Option D: Create model training scripts. Commit the model training scripts to a Git repository.Sharing training scripts in a Git repository provides access to code but does not offer a structured auditing mechanism for model details like intended uses or inference performance.

Amazon SageMaker Clarify provides built-in tools to detect bias in data and models, and to generate detailed explainability reports for model predictions, including SHAP values and feature importance.

A is correct:

“Amazon SageMaker Clarify provides bias detection, explainability for ML models, and comprehensive reports to satisfy regulatory and ethical requirements.”

(Reference: Amazon SageMaker Clarify Overview)

B (Data Wrangler) is for data preparation, not bias/explainability.

C (Model Cards) document models, but don’t detect bias or explain predictions.

D (AI Service Cards) provide transparency for AWS AI services, not custom model explainability.

Model misuse is a key example of output vulnerability, where the output of a model can be intentionally or unintentionally used in ways that create harm or deviate from the model’s intended purpose. According to AWS Responsible AI guidance, output vulnerabilities refer to flaws or weaknesses in how a model’s predictions or generations are interpreted or used by external systems or users. This could involve using a generative model to produce harmful content, manipulate outputs to spread misinformation, or expose private information. AWS recommends that safeguards such as Guardrails, Human-in-the-Loop (HITL) validation, and ethical guidelines be enforced to mitigate these output risks. In contrast, data poisoning and data leakage are input-level vulnerabilities that corrupt model training, and parameter stealing is a model-level attack where internal configurations are extracted. Model misuse specifically reflects how outputs can be abused, making it a textbook example of output vulnerability.

Referenced AWS AI/ML Documents and Study Guides:

AWS Responsible AI Whitepaper – Output Vulnerabilities

Amazon Bedrock Documentation – Guardrails for Responsible Generation