Pick the Best Model That Fits a Latency Budget
Beginner
The problem, from first principles
Given several candidate models with different quality and latency, the goal usually isn't "the best model" in the abstract -- it's the best model that still meets a hard latency requirement (a user-facing endpoint with a 200ms SLA, say). A model that scores higher but blows the budget isn't a real option.
The task
Write pick_model_under_budget(models, latency_budget_ms), where each model is (name, quality_score, latency_ms). Return the name of the highest-quality model whose latency fits within the budget, or None if no model qualifies.
Keywords
production-systemsinference-optimization
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.