DeepSeek's DeepInfer inference engine
- DeepSeek published DeepInfer, the inference stack behind DeepSeek-V4.1-Flash, under Apache 2.0 on October 20, 2026, drawing over 6,300 GitHub stars in eight hours.
- Rebuilt bottom-up from vLLM in C++, it omits load balancing, KV cache management, and online serving; analysts describe it as a reference implementation, while Interconnects.ai estimated up to 90% gross margins on token sales and projected wide adoption would drive down ecosystem token prices.
- The U.S.
- Department of Homeland Security separately ordered civilian federal agencies to remove DeepSeek products from their systems.
DeepInfer gives outside developers direct access to the inference techniques DeepSeek uses in production, which experts say is expected to push efficiency improvements into general-purpose frameworks like vLLM and SGLang. The DHS removal order marks a concrete regulatory response to DeepSeek's presence in U.S. government systems.