| Huawei PanGu | |
|---|---|
 | |
| Developer | Huawei |
| Initial release | 1.0, July 2021; 4 years ago (2021-07) |
| Stable release | 5.5 / June 20, 2025; 5 months ago (2025-06-20) |
| Repository | gitcode |
| Available in | Chinese,English,Russian |
| Type | Large language model |
| License | Open source |
Huawei PanGu,PanGu,PanGu-Σ,PanGu-π also known asopenPangu (Chinese:盘古大模型;pinyin:pángǔ dà móxíng) is amultimodallarge language model developed byHuawei. It was officially launched on July 2021.[1]
The name of the large learning language model,PanGu, was derived from the Chinese mythology and folklore ofPangu, a primordial character related to the creation of the world.[2]
In April 2023, Huawei released a paper detailing the development of PanGu-Σ, a colossal language model featuring 1.085 trillion parameters. Developed within Huawei'sMindSpore 5 framework, PanGu-Σ underwent training for over 100 days on a cluster system equipped with 512 Ascend 910 AI accelerator chips, processing 329 billion tokens in more than 40natural andprogramming languages.[3]
PanGu-Σ incorporates Random Routed Experts (RRE) and the Transformer decoder architecture, allowing easy extraction of sub-models for various applications like conversation, translation, code production, and natural language interpretation. The model achieves 6.3 times faster training throughput compared toMoE models with the same hyper-parameters. In the Chinese domain, it outperforms previous state-of-the-art models across 16 tasks in a zero-shot setting. Trained on datasets from 40 domains, including Chinese, English, Bilingual, and code, PanGu-Σ excels infew-shotnatural-language understanding, open-domain discussion, question answering, machine translation, and code creation.[4][5]
During the Huawei Developer Conference on July 7, 2023, Huawei introduced PanGu 3.0, a large language model (LLM), tailored for sectors like government, finance, manufacturing, mining, and meteorology utilizingHuawei Cloud [zh] solutions. In the subsequent month, Huawei launched theCelia Virtual Assistant with advanced AI features, capable of generating long text replies based on user voice commands and set to release withHarmonyOS 4.0 for eligible devices.[6][7]
The LLM was designed for enterprises seeking advantages in the AI industry, focusing on task execution over creative work, unlike traditional models used for general purposes like chatbots, poetry, and visual content creation.[8]
Using the same technology asChatGPT, Huawei's LLM features a hierarchical architecture, allowing customers to adapt the model to various tasks and train it on their own datasets, making it versatile across various industries.[9]
On August 5, 2023,Huawei partnered withEuropean Centre for Medium-Range Weather Forecasts (ECMWF) to launch a global weather forecasting AI model. This model used Huawei Cloud solutions and the PanGu-Weather Model withMindSpore. It is accessible on the ECMWF website and aims to provide accurate weather data.[10][11]
On December 19, 2023, Huawei announced its financial services on the PanGu-powered AI Finance platform for the global market. The tech giant introduced this product at the 2023 Huawei Cloud Fintech Summit, aiming to reshape the digital finance industry with efficient features to boost Fintech firms worldwide. The platform incorporated a variety of advanced technologies, including AI, big data analytics, and blockchain.[12]
On June 21, 2024, at HDC 2024, Huawei announced upgraded PanGu 5.0 alongsideHarmonyOS NEXT. This version integrated withHarmony Intelligence, which features a smarterCelia (Xiaoyi) and focuses on generative AI updates to itsLLM platform for creating new content, such as text, code, or images. Aiming to make PanGu accessible to a wide range of developers and businesses, it offered scalable options: smaller models requiring less computational power for those with limited resources, and larger models with increased capacities for complex tasks requiring more processing power.[13]
On June 20, 2025 at Huawei Developer Conference, the company released Pangu Models 5.5 version, a 718-billion parameter industrial focused AI platform.[14]
On June 30, 2025 Huawei has open-sourced its Pangu models as openPangu AI models, including a 7-billion-parameter openPangu model and a 72-billion-parameter openPangu Pro MoE (Mixture-of-Experts) model. The release also featured model inference technology optimized for Huawei’s Ascend AI accelerator chips.[15]
At Huawei Connect 2025 event, September 29, 2025, it announced a roadmap to fully open source its open-source AI software stack withMindSpore toolchains, openPangu models and CANN interfaces by December 31, 2025.[16]
PanGu Large Model 3.0, designed for industry use, was structured with a 5+N+X three-tier architecture.[17]
The updated Huawei PanGu Model 5.0 by Huawei Cloud business division offered three key features: adaptability for different business scenarios, multi-style modeling, and advanced intelligence. Huawei divided the AI model platform into four series, each with different parameter scales:[18]
On July 4, 2025, some researchers alleged on GitHub that there is an extremely high similarity in the attention parameter distribution between the Pangu Pro MoE model andAlibaba'sQwen model, using "model fingerprinting" technology. The next day, Huawei Noah's Ark Lab, the development team, responded that Pangu is a foundational large model self-developed onAscend hardware and not incrementally trained on other models. They added that they had made compliant attributions in strict accordance with open-source licenses, a common practice in the community. The original repository with the accusation has since been deleted.[19][20][21]
| Smart devices |
|  | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Communication infrastructure | ||||||||||||||||||||||||||||||||
| Services | ||||||||||||||||||||||||||||||||
| People |
| |||||||||||||||||||||||||||||||
| Other | ||||||||||||||||||||||||||||||||
