Easy
DeepLearn
Categories
Resources
Progress
← Back to flashcards
1 / 214 · Score 0
Quiz —
LLMs & GenAI
Question 1
What SLIs / SLOs are typical for LLM serving?
A.
No SLOs
B.
TTFT P95, decode tok/s, success rate, cost/req; targets like TTFT P95 <1s, decode >30 tok/s, 99.9% availability; per-request traces
C.
Same as REST APIs
D.
Impossible to measure
Next question →