Inference: Decoding Strategies
Advanced decoding strategies: Speculative Decoding, Staged Speculative Decoding, Lookahead Decoding, and Non-autoregressive decoding.
Advanced decoding strategies: Speculative Decoding, Staged Speculative Decoding, Lookahead Decoding, and Non-autoregressive decoding.