InterviewSam
Log inStart free
Interview questions
Observability & operationsHardSDE-2

Your team shipped an AI support assistant that calls an LLM with retrieval. Normal APM shows 200 OK everywhere, yet users say answers are wrong and the monthly bill doubled. How would you make this system observable?

Asked at
FreshworksOpenAIZoho

Think first

Answer out loud as you would in the room — clarify, give numbers, name the trade-off — then compare with the model answer.

Go deeper

Design an LLM evaluation and observability platform Lesson: LLM tracing, evaluation and quality

Saved on this device. Create a free account to keep it on every device.

Practise this with Sam

A real mock interview, out loud, with an honest scorecard. Free to start.

Start free