Kunlunxin P800 README#
LoongForge supports training on the Kunlunxin P800 XPU, covering a variety of model types such as LLMs, VLMs, VLAs, and more.
Quick Start#
Installation#
Refer to Installation on Kunlunxin P800
Quick Start: VLM Model Training#
Refer to Quick Start: VLM Model SFT Training on Kunlunxin P800
Quick Start: LLM Model Training#
Pretrain: Refer to Quick Start: LLM Model Pretrain Training on Kunlunxin P800
SFT: Refer to Quick Start: LLM Model SFT Training on Kunlunxin P800
Quick Start: VLA Model Training#
Supported Models#
Model Type |
Model Category |
Model |
Pretrain |
SFT |
|---|---|---|---|---|
LLM |
DeepSeek-V3.1 |
deepseek_v3_group_bf16 |
✅ (example) |
|
MiniMax |
minimax_m2.5_230b |
✅ (example) |
||
minimax_m2.7_230b |
✅ (example) |
|||
Qwen2.5 |
qwen2.5_0.5b |
|||
qwen2.5_1.5b |
||||
qwen2.5_3b |
||||
qwen2.5_7b |
||||
qwen2.5_14b |
||||
qwen2.5_32b |
✅ (example) |
|||
qwen2.5_72b |
||||
Qwen3 |
qwen3_8b |
✅ (example) |
||
qwen3_14b |
✅ (example) |
|||
qwen3_32b |
✅ (example) |
|||
qwen3_30b_a3b |
✅ (example) |
✅ (example) |
||
qwen3_235b_a22b |
||||
qwen3_480b_a35b |
||||
VLM |
Qwen3-VL |
qwen3_vl_30b_a3b |
✅ (example) |
✅ (example) |
qwen3_vl_235b_a22b |
✅ (example) |
✅ (example) |
||
InternVL-3.5 |
internvl3.5_8b |
✅ (example) |
||
internvl3.5_14b |
✅ (example) |
|||
internvl3.5_38b |
✅ (example) |
|||
internvl3.5_30b_a3b |
✅ (example) |
|||
internvl3.5_241b_a28b |
✅ (example) |
|||
Qwen-3.5 |
qwen3.5_35b_a3b |
✅ (example) |
✅ (example) |
|
VLA |
PI 0.5 |
✅ (example) |
||
GR00T-N1.6 |
✅ (example) |