Inference: Batching Techniques

Batching strategies for efficient inference: Static batching, Dynamic batching, Continuous batching, Speculative batching, and Adaptive batching.