EasyDeepLearn

SLO / SLI / SLA for ML services.

medium

Answer

  • SLI (Service Level Indicator): metric measured (latency p99, error rate, accuracy).
  • SLO (Objective): target for SLI (p99 < 100ms 99.9% of time).
  • SLA (Agreement): contractual commitment to customer with financial penalties if breached.
  • ML-specific SLIs: prediction latency, freshness of features, model accuracy vs holdout, drift score.
  • Error budget = 1 - SLO: how much unreliability tolerated before halting risky deploys.
  • Standard SRE framework applied to ML.
Check yourself — multiple choice
  • Same thing
  • SLI = metric measured; SLO = target for SLI; SLA = contractual commitment; ML-specific: latency + freshness + accuracy + drift; error budget = 1-SLO; SRE framework for ML
  • Random
  • Not real

SLI/SLO/SLA: measure/target/contract; ML-specific + error budget.

#monitoring#observability

Practise MLOps & Data Quality

215 interview questions in this topic.

Related questions