DeepSeek open-source Ascend basic components, covering compilation, computation, and communication libraries

The artificial intelligence company DeepSeek has officially open-sourced infrastructure components for the Huawei Ascend computing platform, covering the TileLang high-level language compilation tool, computing libraries, and distributed communication libraries, corresponding to the previously open-sourced components for the NVIDIA platform. TileLang aims to provide a general-purpose, simpler programming language that can achieve the hardware performance limits, improving development efficiency and simplifying logic compared to CUDA, while its programming model can also leverage chip features.

The TileLang route was first validated on the NVIDIA platform and has already supported the implementation of most operators in the training of the DeepSeek V4 series models. The open-sourced Ascend version encapsulates the underlying instructions of the Ascend C, providing a high-level programming approach without sacrificing hardware performance. Currently, every TileLang operator used in DeepSeek's training has a corresponding high-performance implementation on Ascend.

The components open-sourced at the same time also include DeepGEMM, DeepEP, TileKernels, FlashMLA, and DeepSelect, which are used for general matrix operations, large-scale cross-device communication, conventional vector calculations and memory access, long-context sparse attention, and data filtering, respectively. DeepSeek claims that in multiple key tests, the related computing and communication performance has approached hardware limits; during the R&D process, the Huawei team provided support, and both parties collaborated to advance the 128-card supernode solution based on Ascend 950, with deep optimizations made for computing and communication.