AI Engineering Interview Questions — Practice Library

23 problems
Problem
Tags
Type
Conversation History Compression for Long-Running Agents
Reported at AnthropicSWE (AI-Era)Hard
Coding
Resilient LLM API calls with exponential backoff retry logic
Reported at AnthropicSWE (AI-Era)Easy
Coding
Prompt Injection Vulnerability in Content Filter Implementation
Reported at AnthropicSWE (AI-Era)Medium
Code Comprehension
Evaluation Metric Misalignment: Faithfulness Scores Mask Semantic Errors
Reported at AnthropicAI EngineeringMedium
Code Comprehension
RAG Chatbot Ignoring Retrieved Documents, Using Training Data Instead
Reported at AnthropicAI EngineeringEasy
Code Comprehension
AI Agent Prompt Injection Attack Via Support Ticket Content
Reported at AnthropicSWE (AI-Era)Hard
Code Comprehension
RAG evaluation metrics masking real-world answer quality failures
Reported at AnthropicSWE (AI-Era)Medium
Code Comprehension
Model Context Protocol standardizes AI tool integration architecture
Reported at AnthropicAI EngineeringMedium
Theory
Building Customer Support Agent Evaluation Harness: Metrics Design and Contamination Prevention
Reported at AnthropicAI EngineeringMedium
Theory
Infinite Loop Detection: Root Cause Analysis and Design Prevention
Reported at AnthropicAI EngineeringMedium
Theory
Distributed Search System Architecture with LLM Inference at Scale
Reported at AnthropicML EngineeringHard
System Design
GenAI Safety: Building Trust Through Guardrails and Evaluation
Reported at AnthropicAI SecurityMedium
System Design
Domain Adaptation Strategies for Generative AI Models
Reported at AnthropicAI EngineeringMedium
System Design
Iterative refinement balancing clarity specificity and desired output format
Reported at AnthropicAI EngineeringEasy
Theory
Overconfident Model Hallucinations in High-Risk Conversational AI Contexts
Reported at AnthropicAI SecurityHard
System Design
Control generative AI model creativity through temperature and sampling parameters
Reported at AnthropicAI EngineeringEasy
Theory
End-to-end LLM query batching system design and optimization
Reported at AnthropicML EngineeringHard
System Design
GPU Inference Batching System Design with Synchronous User Requests
Reported at AnthropicML EngineeringHard
System Design
Adaptive agent architecture with dynamic task learning capabilities
Reported at AnthropicAI EngineeringHard
System Design
Generative AI safety: detecting and mitigating harmful content generation
Reported at AnthropicAI SecurityMedium
Theory
Scalable Token Generation Service Architecture for High-Throughput LLM
Reported at AnthropicML EngineeringHard
System Design
Mitigating Hallucinations In Production Generative AI Systems
Reported at AnthropicAI EngineeringMedium
System Design
Design a prompt injection defence architecture
Reported at AnthropicAI SecurityMedium
System Design