SKILL_MD
speculative-decoding
by chen-yu-hao
36

Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Ja…

MLOps / AI 工程Safe-ishScanned