Huawei Ascend 9100 + Atlas 950 SuperNode Deep Dive: 300PFlops Training Chip, UnifiedBus 2.0 Optical Interconnect for 8192 NPUs
Abstract: In July 2026, Huawei officially unveiled the Ascend 9100 training chip (300 PFlops FP16 per card) alongside the Atlas 950 SuperNode—64 cards per cabinet, up to 8,192 NPU interconnects, and 16.3 PB/s interconnect bandwidth. This article dissects the chip architecture, supernode interconnect protocol, unified memory addressing, liquid cooling, and national substitution strategy, with complete Go/Python implementations.
1. Ascend 9100: The Performance Ceiling of Domestic Training Chips
1.1 Core Specifications
| Parameter | Ascend 910B | Ascend 950 (Inference) | Ascend 9100 (Training) |
|---|---|---|---|
| Process | 7nm | 7nm Chiplet | 7nm Chiplet |
| FP16 | 256 TFLOPS | - | 300 PFlops |
| FP8 | - | 1 PFlops | 600 PFlops |
| FP4 | - | 2 PFlops | 1.2 EFlops |
| Memory | 64GB HBM2e | 128-144GB HBM3 | 256GB HBM4 |
| Bandwidth | 1.6TB/s | 4TB/s | 8TB/s |
| Power | ~400W | ~600W+ | ~800W |
1.2 Mixed Precision Implementation
class MixedPrecisionEngine:
"""Ascend 9100 mixed precision engine supporting FP16/FP8/FP4"""
def auto_select_precision(self, layer_type: str) -> str:
if layer_type in ["attention_qkv", "attention_out"]:
return "FP16" # Precision-sensitive
elif layer_type in ["ffn_gate", "ffn_up", "ffn_down"]:
return "FP8" # Compute-intensive
elif layer_type == "moe_router":
return "FP16"
return "FP8"
2. Atlas 950 SuperNode: The World’s Most Powerful Computing System
2.1 Benchmark Comparison
| Metric | Atlas 950 | NVIDIA NVL144 | Advantage |
|---|---|---|---|
| NPU Count | 8,192 | 144 | 56.8x |
| Total FP8 | 8 EFLOPS | 1.2 EFLOPS | 6.7x |
| Memory | 1,152TB | 76.8TB | 15x |
| Bandwidth | 16.3 PB/s | 0.26 PB/s | 62x |
2.2 UnifiedBus 2.0 Optical Interconnect
Atlas 950 SuperNode Topology:
┌──────────────┐ UB-Mesh ┌──────────────┐
│ Cabinet 0 │◄──────────────►│ Cabinet 1 │
│ ┌─64 NPU─┐ │ │ ┌─64 NPU─┐ │
│ │ 950DT │ │ │ │ 950DT │ │
│ └────────┘ │ │ └────────┘ │
└──────┬───────┘ └──────┬───────┘
│ │
│ ┌─────────────────────┐ │
└────│ Optical Mesh Switch │────┘
│ 16.3 PB/s │
└─────────────────────┘
1 cabinet: 64x 950DT / 144GB each / 4TB/s BW
Full cluster: 128 cabinets = 8,192 NPUs
2.3 Unified Memory Addressing
type UnifiedAddressSpace struct {
nodeMemoryMap map[uint64]*NodeMemory
globalAddressMap map[uint64]uint64
totalCapacity uint64 // 1,152TB
}
func (uas *UnifiedAddressSpace) RemoteLoad(globalAddr uint64, size uint64) ([]byte, error) {
// Direct load/store semantics for remote NPU memory
// No serialization-network-deserialization pipeline
// Single-hop latency: 200ns (vs 2μs for traditional networking)
nodeID := uint32(globalAddr >> 48)
localAddr := globalAddr & 0xFFFFFFFFFFFF
return uas.nodeMemoryMap[uint64(nodeID)].RemoteRead(localAddr, size)
}
3. CANN Ops-Transformer: Hardware-Aware Operator Library
| Optimization | Before | After | Improvement |
|---|---|---|---|
| FlashAttention | 842ms | 317ms | 2.66x faster |
| PagedAttention | 12 users | 47 users | 3.9x throughput |
| MoE Fusion | 63ms | 21ms | 3x faster |
| Memory Utilization | 63% | 91% | +28pp |
4. DeepSeek V4 Validation on Ascend
DeepSeek V4’s fine-grained expert parallelism verified on Ascend NPUs:
- General inference: 1.50-1.73x speedup vs non-fusion baseline
- RL rollout/Agent scenarios: up to 1.96x speedup
DeepSeek expects V4-Pro pricing to drop significantly once Ascend 950 SuperNodes enter mass production in H2 2026.
Sources: