Free Amazon Web Services AIF-C01 Practice Exam with Questions & Answers | Set: 12

Retrieval-Augmented Generation (RAG) integrates external knowledge sources (databases, vector stores, document repositories) with LLMs, enabling them to generate contextually accurate and up-to-date responses without retraining.

B is incorrect: RAG does not speed up training; it improves inference results.

C is incorrect: speech recognition is not an RAG use case.

D is incorrect: computer vision augmentation is unrelated to RAG.

???? Reference:

AWS Documentation – Knowledge Bases for RAG in Amazon Bedrock

Unsupervised learning involves discovering hidden patterns without labeled data. Example: clustering.

Image recognition (B) is supervised learning.

House price prediction (C) is regression (supervised).

The correct answer is A because model interpretability refers to the ability to understand and explain how an ML model arrives at a particular prediction or decision.

From AWS documentation:

" Model interpretability is the degree to which a human can understand the cause of a decision made by a machine learning model. Interpretability techniques help explain which features influenced a prediction and how much they contributed. "

This is essential in areas like financial services, healthcare, or compliance-heavy industries, where decision transparency is critical.

Explanation of other options:

B. Model training refers to the process of teaching a model from data and doesn’t explain how predictions are made.

C. Model interoperability refers to the ability of systems or models to work across different platforms or environments.

D. Model performance refers to how accurate or effective the model is but doesn’t relate to the explanation of its decisions.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker Clarify Documentation – Explainability and Bias Detection

AWS Machine Learning Specialty Study Guide – Responsible AI and Model Explainability

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Inference parameters control output behavior:

Higher temperature increases creativity and randomness

Shorter response length limits output size

AWS prompt and inference guidance recommends increasing temperature for creative tasks and reducing response length for concise outputs.

Why the other options are incorrect:

A reduces creativity.

B produces long outputs.

D produces deterministic and lengthy responses.

AWS AI document references:

Inference Parameters for Foundation Models

Controlling Creativity and Length in Text Generation

Prompt Engineering Best Practices

The correct answer is C, as conversion rate (how many users upgrade to premium) and retention rate (how many stay subscribed) are primary indicators of a generative AI system’s business impact and ROI. According to AWS documentation, evaluating AI performance should go beyond technical accuracy to include business metrics that show real-world value. For a premium service, higher conversion implies successful personalization that attracts free users, while strong retention reflects sustained engagement and user satisfaction. Metrics like ARPU or query reduction are secondary indicators. AWS emphasizes outcome-based measurement to ensure AI initiatives contribute measurable ROI tied to customer adoption, loyalty, and profitability. Therefore, tracking conversion and retention gives the clearest long-term measure of financial success from generative AI.

Referenced AWS AI/ML Documents and Study Guides:

AWS Machine Learning Specialty Guide – ML Business Metrics

AWS AI Adoption Framework – Value Realization and ROI Tracking

Step 1: Store meeting audio recordings in an Amazon S3 bucket.

Step 2: Convert meeting audio recordings to meeting text files by using Amazon Transcribe.

Step 3: Summarize meeting text files by using Amazon Bedrock.

The company wants to create an application to summarize meeting audio recordings, which requires a sequence of steps involving storage, speech-to-text conversion, and text summarization. Amazon S3 is the recommended storage service for audio files, Amazon Transcribe converts audio to text, and Amazon Bedrock provides generative AI capabilities for summarization. These three steps, in this order, create an efficient workflow for the application.

Exact Extract from AWS AI Documents:

From the Amazon Transcribe Developer Guide:

" Amazon Transcribe uses deep learning to convert audio files into text, supporting applications such as meeting transcription. Audio files can be stored in Amazon S3, and Transcribe can process them directly from an S3 bucket. "

From the AWS Bedrock User Guide:

" Amazon Bedrock provides foundation models that can perform text summarization, enabling developers to build applications that generate concise summaries from text data, such as meeting transcripts. "

(Source: Amazon Transcribe Developer Guide, Introduction to Amazon Transcribe; AWS Bedrock User Guide, Text Generation and Summarization)

Detailed Explanation:

Step 1: Store meeting audio recordings in an Amazon S3 bucket.Amazon S3 is the standard storage service for audio files in AWS workflows, especially for integration with services like Amazon Transcribe. Storing the recordings in S3 allows Transcribe to access and process them efficiently. This is the first logical step.

Step 2: Convert meeting audio recordings to meeting text files by using Amazon Transcribe.Amazon Transcribe is designed for automatic speech recognition (ASR), converting audio files (stored in S3) into text. This step is necessary to transform the meeting recordings into a format that can be summarized.

Step 3: Summarize meeting text files by using Amazon Bedrock.Amazon Bedrock provides foundation models capable of generative AI tasks like text summarization. Once the audio is converted to text, Bedrock can summarize the meeting transcripts, completing the application’s requirements.

Unused Options Analysis:

Convert meeting audio recordings to meeting text files by using Amazon Polly.Amazon Polly is a text-to-speech service, not for converting audio to text. This option is incorrect and not used.

Store meeting audio recordings in an Amazon Elastic Block Store (Amazon EBS) volume.Amazon EBS is for block storage, typically used for compute instances, not for storing files for processing by services like Transcribe. S3 is the better choice, so this option is not used.

Summarize meeting text files by using Amazon Lex.Amazon Lex is for building conversational interfaces (chatbots), not for text summarization. Bedrock is the appropriate service for summarization, so this option is not used.

Hotspot Selection Analysis:

The task requires selecting and ordering three steps from the list, with each step used exactly once or not at all. The selected steps—storing in S3, converting with Transcribe, and summarizing with Bedrock—form a complete and logical workflow for the application.

Directional stimulus prompting guides the foundation model to produce outputs aligned with business context. It’s particularly effective for aligning responses with public documents and improving coherence. From Bedrock Prompt Engineering Techniques documentation:

“Directional stimulus prompting provides structured prompts to steer the model output towards desired formats or behaviors using specific linguistic cues.”

To implement a large language model (LLM) responsibly, the firm should focus on fairness and mitigating bias, which are critical for ethical AI deployment.

A. Include Fairness Metrics for Model Evaluation:

Fairness metrics help ensure that the model ' s predictions are unbiased and do not unfairly discriminate against any group.

These metrics can measure disparities in model outcomes across different demographic groups, ensuring responsible AI practices.

C. Modify the Training Data to Mitigate Bias:

Adjusting training data to be more representative and balanced can help reduce bias in the model ' s predictions.

Mitigating bias at the data level ensures that the model learns from a diverse and fair dataset, reducing potential harms in deployment.

Why Other Options are Incorrect:

B. Adjust the temperature parameter of the model: Controls randomness in outputs but does not directly address fairness or bias.

D. Avoid overfitting on the training data: Important for model generalization but not directly related to responsible AI practices regarding fairness and bias.

E. Apply prompt engineering techniques: Useful for improving model outputs but not specifically for mitigating bias or ensuring fairness.

The verified answer is C. Faithfulness. The company is evaluating foundation models for a summarization task by using an LLM-as-a-judge evaluation job in Amazon Bedrock. AWS documentation states that with a model evaluation job that uses a judge model, Amazon Bedrock uses one LLM to score another model’s responses and provide an explanation of how it scored each prompt and response pair. AWS also states that Amazon Bedrock provides built-in metrics that can be selected for these judge-based evaluation jobs.

Among the answer choices, Faithfulness is the only valid built-in metric for an Amazon Bedrock LLM-as-a-judge model evaluation job. AWS API documentation lists the valid built-in metric names for LLM-as-a-judge evaluation jobs, including Correctness, Completeness, Faithfulness, Helpfulness, Coherence, Relevance, FollowingInstructions, ProfessionalStyleAndTone, and responsible AI metrics such as Harmfulness, Stereotyping, and Refusal. The same documentation identifies Summarization as a valid task type for model evaluation jobs. Therefore, Faithfulness is a valid built-in metric for evaluating whether generated summaries remain grounded in the source input rather than introducing unsupported claims.

Option A. Context relevance and option B. Context coverage are incorrect for this question because AWS lists those as metrics for knowledge base retrieval-only evaluation jobs, not general LLM-as-a-judge model evaluation of foundation model summarization output. These metrics evaluate retrieved context, not the quality of a summarization model’s generated response. Option D. RMSE is also incorrect because root mean square error is a regression metric. It is not a built-in LLM-as-a-judge metric for summarization in Amazon Bedrock.

Because the task is summarization and the evaluation job is LLM-as-a-judge, the correct built-in evaluation metric from the available choices is Faithfulness.

Domain adaptation fine-tuning involves training a foundation model (FM) further using a specific dataset that includes domain-specific terminology and content, such as scientific terms in research papers. This process allows the model to better understand and handle complex terminology, improving its performance on specialized tasks.

Option B (Correct): " Use domain adaptation fine-tuning to adapt the FM to complex scientific terms " : This is the correct answer because fine-tuning the model on domain-specific data helps it learn and adapt to the specific language and terms used in the research papers, resulting in better performance.

Option A: " Use few-shot prompting to define how the FM can answer the questions " is incorrect because while few-shot prompting can help in certain scenarios, it is less effective than fine-tuning for handling complex domain-specific terms.

Option C: " Change the FM inference parameters " is incorrect because adjusting inference parameters will not resolve the issue of the model ' s lack of understanding of complex scientific terminology.

Option D: " Clean the research paper data to remove complex scientific terms " is incorrect because removing the complex terms would result in the loss of important information and context, which is not a viable solution.

AWS AI Practitioner References:

Domain Adaptation in Amazon Bedrock: AWS recommends fine-tuning models with domain-specific data to improve their performance on specialized tasks involving unique terminology.