DeepSeek 开源六个面向华为昇腾的项目,矩阵算子达到芯片峰值速度的 99.8%。核心项目 TileLang 是 DeepSeek 编写 GPU kernel 的编程语言,训练 V4 模型所用的多数算子已有昇腾版本,同一份源码可编译到华为芯片而非 NVIDIA 芯片。
DeepSeek open-sourced six Huawei Ascend projects whose matrix kernels hit 99.8% of the chip's peak speed.
this will help reduce reliance on Nvidia further for them.
The headline project is TileLang, the programming language DeepSeek writes its own GPU kernels in.
Most of the operators that trained its V4 models are written in TileLang, and each now has an Ascend version. That means the same source code can compile for Huawei chips instead of Nvidia ones.
a 2nd repo, DeepGEMM-Ascend, does matrix multiplication and reports 431 BF16 TFLOPS against a 432 ceiling.
DeepEP-Ascend, which moves data between chips, shipped with no license file while the rest are MIT, so nobody can legally reuse it yet.
Liang Wenfeng told investors Huawei could start delivering training chips this quarter.
来源:Rohan Paul · x.com