Official Inference Code of EAGLE-4
Commits on main
fix(sglang): decode without speculation wherever speculation would be slower
df5a23a Seyfal Sultanov committed 29 days ago
docs: name the published 0.1.1 images in the release notes
ea02a3b Seyfal Sultanov committed 29 days ago
docs: lead the README with adaptive, always-on speculation
f71e245 Seyfal Sultanov committed 1 month ago
fix(pkg): hash CUDA redist archives without hashlib.file_digest
776da1a kevin9327 committed 1 month ago
fix(core): reject a stop_check workload shorter than concurrency x waves
573cb7c kevin9327 committed 1 month ago
fix(pkg): create simple/ before writing the index root page in mk_index
869bc3e kevin9327 committed 1 month ago
fix(pkg): keep added License-File headers out of a description-less METADATA
4f14a1f kevin9327 committed 1 month ago
docs: one-GPU quick start, 0.1.1 images and a full support matrix
9364c87 Seyfal Sultanov committed 1 month ago
docs: 0.1.1 release notes, release-stack numbers and limits
2ace92d Seyfal Sultanov committed 1 month ago
fix(sglang): keep the tree rule for chains narrower than 16 tokens
5686039 Seyfal Sultanov committed 1 month ago
fix(sglang): compile first-use kernels at startup and keep slow rounds out of live costs
c88d32d Seyfal Sultanov committed 1 month ago
feat(sglang): serve with only the draft path by default
733fa93 Seyfal Sultanov committed 1 month ago
fix(vllm): measure served tree acceptance and select the batch-size switch from weighted gains
576d5ef Seyfal Sultanov committed 1 month ago
fix(sglang): capture first-use graphs without flushing the allocator
d4cbd5d Seyfal Sultanov committed 1 month ago
build(sglang): hash-lock the SGLang CUDA runtime and pin image bases by digest
87a6fad Seyfal Sultanov committed 1 month ago
docs: split the harness and image versions in release.env for 0.1.1
1ed89d6 Seyfal Sultanov committed 1 month ago
fix(vllm): stop requiring vLLM's varlen verify-graph flag
bf8df90 Seyfal Sultanov committed 1 month ago
fix(pkg): stop sampling_check failing a no-spec server against itself
5bae2f8 Seyfal Sultanov committed 1 month ago
perf(sglang): use the engine's prefill CUDA graph in the release recipes
46a884e Seyfal Sultanov committed 1 month ago
docs: update the support matrix with measured release results
2e83d58 Seyfal Sultanov committed 1 month ago
perf(sglang): sample temperature-1 trees from recorded proposals in one fused draw
061a1d2 Seyfal Sultanov committed 1 month ago
fix(vllm): log the harness through vLLM's logger as it is when a record is made
18c7940 Seyfal Sultanov committed 1 month ago
feat(tokenspeed): negotiate the plugin contract by capabilities
6051551 Seyfal Sultanov committed 1 month ago
vllm: follow the final review-PR hook surface, keep the 0.1.0 engine
3ba24b6 Seyfal Sultanov committed 1 month ago
feat(core)!: remove the inactive eval, ragged and moe_gate_acc options
7b7b5a5 Seyfal Sultanov committed 1 month ago