Li Jiang · 蒋力
PyTorch Conference China 2026 · Shanghai · September 9, 2026

HyperParallel
面向昇腾超节点的分布式加速Distributed Acceleration for Ascend SuperPoD

PyTorch官方回顾、国内权威报道与大会现场照片,共同记录HyperParallel在PyTorch Conference China 2026的公开展示;现场架构图中的Offload模块对应HyperParallel核心技术HyperOffload。

Official PyTorch recap, authoritative Chinese coverage, and conference photos document HyperParallel's presentation at PyTorch Conference China 2026. The Offload module shown in the architecture corresponds to HyperOffload, a core HyperParallel technology.

PyTorch Conference China 2026HyperParallelHyperOffloadShanghai
HyperParallel architecture presented at PyTorch Conference China 2026, showing Shard, MPMD, and Offload modules
大会现场:HyperParallel架构展示Shard、MPMD与Offload三类能力。图片来源:极客公园大会报道。
Conference stage: HyperParallel architecture showing Shard, MPMD, and Offload capabilities. Image source: GeekPark's conference report.

大会发布与演示Conference presentation and demo

PyTorch Conference China 2026于9月8日至9日在上海举行。PyTorch基金会官方回顾将华为报告“HyperParallel: A SuperPoD-Aware Distributed Acceleration Library”列入9月9日议程。国内报道进一步记录了在昇腾Atlas 800 A3超节点上使用Qwen3-30B-A3B进行的Live Demo。

PyTorch Conference China 2026 took place in Shanghai on September 8–9. The PyTorch Foundation's official recap lists Huawei's “HyperParallel: A SuperPoD-Aware Distributed Acceleration Library” session on September 9. Chinese reports further document a live Qwen3-30B-A3B training demo on the Ascend Atlas 800 A3 SuperPoD.

9.8–9
大会在上海举行;HyperParallel报告与演示位于第二日议程
Conference in Shanghai; HyperParallel appeared on the Day 2 program
200%+
国内报道所述训练吞吐提升幅度,且loss收敛保持一致
Reported training-throughput gain with consistent loss convergence
3
官方架构中的核心方向:HyperShard、HyperOffload、HyperMPMD
Core directions: HyperShard, HyperOffload, and HyperMPMD
性能数字来自大会演示及相关报道,属于特定模型、设备与配置下的展示结果;本页将其作为活动记录,不泛化为所有训练任务的普遍结论。
The performance figure comes from the conference demo and related reports under a specific model, system, and configuration. It is recorded here as an event result rather than generalized to all training workloads.

HyperOffload:团队与华为的联合成果HyperOffload: joint work with Huawei

昇思MindSpore官方将HyperOffload定义为HyperParallel三项核心技术之一:通过全图编排实现多级智能卸载与层次化存储管理。大会现场架构照片中的“Offload”模块与这一官方技术体系相对应。

MindSpore officially identifies HyperOffload as one of HyperParallel's three core technologies, providing graph-orchestrated multi-level offloading and hierarchical memory management. The “Offload” module visible in the conference architecture photo aligns with this official technical structure.

HyperShard

声明式分布式并行与超节点感知调度

Declarative distributed parallelism and SuperPoD-aware scheduling

HyperOffload

全图驱动的层次化存储管理与数据卸载

Graph-driven hierarchical memory management and data offloading

HyperMPMD

面向非规则模型结构的异构并行

Heterogeneous parallelism for irregular model structures

官方回顾与权威报道Official recap and authoritative coverage

PyTorch Foundation · 2026-09-09

PyTorch Conference China 2026: Advancing the Open Source AI Stack

PyTorch官方大会回顾,确认上海会期及HyperParallel报告的讲者、题目和华为机构信息。

Official conference recap confirming the Shanghai event and the title, speakers, and organization of the HyperParallel session.

访问PyTorch官方回顾 →Official PyTorch recap →
新华网 · 2026-09-14

国产算力深度融入全球AI开源生态

Ascend and PyTorch in the global open-source AI ecosystem

权威媒体报道HyperParallel对PyTorch FSDP与Muon优化器的深度优化,以及向PyTorch生态贡献创新技术的计划。

Authoritative coverage of HyperParallel's optimization of PyTorch FSDP and Muon and plans to contribute innovations to the PyTorch ecosystem.

查看新华网报道 →Xinhua report →
极客公园 · 2026-09-10

HyperParallel亮相PTC 2026

HyperParallel at PTC 2026

较完整记录Live Demo、昇腾Atlas 800 A3超节点、Qwen3-30B-A3B工作负载和现场技术介绍,并刊载本页所用大会照片。

Detailed report on the live demo, Atlas 800 A3 SuperPoD, Qwen3-30B-A3B workload, technical presentation, and the photos used on this page.

查看极客公园报道 →GeekPark report →
MindSpore · 2026-01-28

HyperParallel架构与HyperOffload官方说明

Official HyperParallel and HyperOffload description

明确列出HyperShard、HyperOffload和HyperMPMD三项核心技术,并说明HyperOffload的全图层次化存储管理机制。

Officially lists HyperShard, HyperOffload, and HyperMPMD and explains HyperOffload's graph-level hierarchical memory management.

查看MindSpore官方说明 →MindSpore official description →

大会现场照片Conference photos

照片来源:极客公园《HyperParallel亮相PTC 2026:专为超节点打造的分布式并行组件》大会报道。

Photo source: GeekPark, “HyperParallel at PTC 2026: A Distributed Parallel Component Built for SuperPoD.”

证据边界Evidence boundary

PyTorch官方回顾及大会报道展示的是HyperParallel整体成果,不宜表述为“PyTorch单独发布HyperOffload”。更准确的说法是:PyTorch Conference China 2026公开展示了HyperParallel;大会架构图包含Offload模块;MindSpore官方资料和技术报告进一步确认HyperOffload是HyperParallel核心技术之一,并记录了上海交通大学蒋力、刘方鑫团队与华为的联合研发成果。

The PyTorch recap and conference reports present HyperParallel as a whole; they should not be described as a standalone PyTorch release of HyperOffload. A precise statement is that HyperParallel was publicly presented at PyTorch Conference China 2026, its stage architecture included an Offload module, and official MindSpore materials and the technical report identify HyperOffload as a core HyperParallel technology jointly developed by the Shanghai Jiao Tong University team and Huawei.