MediumML EngineeringSystem DesignMLOps Monitoring & Drift

How do you log prompts and outputs for debugging and auditing?

Design a logging and observability system for a production LLM application that handles sensitive user data in a regulated industry (healthcare or finance).

Requirements

full prompt
output logging for debugging
audit trail for compliance
PII redaction before storage
cost tracking per request
latency breakdown by component
the ability to replay specific requests for debugging. How do you balance observability with privacy? What do you store
for how long
who has access? How do you use this data to improve the system?

Sign in to attempt this problem

Free account gives you full access to community problems with the complete solution reveal: golden answer, senior walkthrough, and score breakdown, after submission.

Start free →Already have an account? Sign in