FlashcardAdvanced

Model Deployment Patterns

Models can be served in batch, online (real-time), or streaming modes depending on latency needs.

Question

What are batch, online, and streaming deployment patterns?

Click to reveal answer