Explore Library
FlashcardAdvanced

Inference Optimization Techniques

Quantization, pruning, and distillation shrink models to run faster and cheaper.

Question

What do quantization, pruning, and distillation do?

Click to reveal answer