AI Engineering Interview Questions — Practice Library | Velocode

This week's hardest·Reported at MetaNext Word Prediction System Architecture Design→

19 problems

Problem

Tags

Type

Agent hallucinating confident incorrect data from tool composition failures

Reported at OpenAISWE (AI-Era)Hard

Code Comprehension

Silent data drift detection in production ML pipeline accuracy collapse

Reported at DatabricksSWE (AI-Era)Medium

Code Comprehension

Chatbot Ignores Prompt Instructions Despite Correct Configuration Setup

SWE (AI-Era)Easy

Code Comprehension

Silent Data Drift: Detecting Feature Distribution Changes Without Model Updates

Reported at DatabricksSWE (AI-Era)Medium

Code Comprehension

AI Agent Prompt Injection Attack Via Support Ticket Content

Reported at AnthropicSWE (AI-Era)Hard

Code Comprehension

Semantic Search Returns Identical Results Regardless Input Query

SWE (AI-Era)Easy

Code Comprehension

RAG evaluation metrics masking real-world answer quality failures

Reported at AnthropicSWE (AI-Era)Medium

Code Comprehension

Reranker degrades pipeline performance despite correct isolation testing behavior.

Reported at CohereSWE (AI-Era)Medium

Code Comprehension

Vector Embedding Space Mismatch Between Query And Document Processing

SWE (AI-Era)Easy

Code Comprehension

RAG Chatbot Fails to Answer Despite Successfully Retrieving Relevant Documents

Reported at GoogleSWE (AI-Era)Easy

Code Comprehension

RAG Evaluation Pipeline Failing to Filter Low Quality Responses

Reported at GoogleSWE (AI-Era)Hard

Code Comprehension

Cache overhead exceeds benefits due to poor invalidation strategy and key design

SWE (AI-Era)Medium

Code Comprehension

Embedding Model Version Mismatch Between Development Production Environments

Reported at OpenAISWE (AI-Era)Easy

Code Comprehension

LLM retry logic causes infinite loops on malformed API responses

Reported at MetaSWE (AI-Era)Easy

Code Comprehension

LLM Summarization Tool Cuts Off Mid-Sentence Completion Issue

SWE (AI-Era)Easy

Code Comprehension

Stateless Chatbot Losing Conversation History Between Turns

SWE (AI-Era)Easy

Code Comprehension

Agent infinite loops on tool due to missing success detection logic

SWE (AI-Era)Medium

Code Comprehension

LLM Quality Scoring System Returns Perfect Scores for All Outputs

SWE (AI-Era)Medium

Code Comprehension

LLM Summarizer Producing Hallucinated Content At High Failure Rate

SWE (AI-Era)Medium

Code Comprehension