DeepSeek comprehensive open-source inference framework DeepInfer compatible with Huawei Ascend

DeepSeek announced the full open-source of its internal inference framework DeepInfer, and simultaneously open-sourced the production-level token encoding and decoding component deepseek-recipe. DeepInfer integrates high-performance operators and a deeply optimized inference engine, supporting distributed inference, speculative decoding, SWA Bounded Replay, and structured output, compatible with NVIDIA and Huawei Ascend platforms.

DeepSeek stated that it has implemented high throughput and low latency large-scale inference services for DeepSeek V4.1 Flash based on DeepInfer, and future inference code and optimizations for new models will continue to be updated here. deepseek-recipe is fully aligned with the processing logic of the DeepSeek official API, aiming to ensure that the community receives an experience consistent with the official deployment. The open-source repository and technical report have been released simultaneously.