推测解码(Speculative Decoding)原理与实战 - ZZC's Blog #6
Replies: 1 comment
|
这个证明是错的 你的公式左边草稿选x 接收x 右边草稿选x 拒绝x 然后残差分布选x(其实就是概率=0),哪有这么算概率的。 |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
推测解码(Speculative Decoding)原理与实战 - ZZC's Blog
AI Infra 工程师的技术博客 — 专注大模型推理系统优化,分享 SGLang、vLLM、FlashInfer 等技术深度解析
https://charlestar.github.io/2026/05/12/%E6%8E%A8%E6%B5%8B%E8%A7%A3%E7%A0%81SpeculativeDecoding%E5%8E%9F%E7%90%86%E4%B8%8E%E5%AE%9E%E8%B7%B5/
All reactions