Batch vs Online Inference Pattern Selection
Spot the swapped logic in an inference-pattern selector.
Codepython
def choose_inference(latency_requirement_ms):
# Pick batch or online serving based on latency needs
if latency_requirement_ms < 100:
return "batch"
else:
return "online"
What is the bug in this pattern selector?