Skip to main content
Ctrl+K

LoongForge

Get Started

  • Installation
  • Support Model
  • Parallelism Strategies & Optimization Guide

LLM Training

  • Quick Start: LLM Pre-training
  • Quick Start: LLM SFT
  • Checkpoint Conversion for LLM
  • Advanced Features
    • FP8 Training
    • Adaptive FP8 Training (Selective FP8)
    • MoE All-to-All Overlap
    • Optimizer Support
    • Fused Linear Cross Entropy
    • Mcore-Bridge: Online HF Checkpoint Loading & Saving
    • LoRA Feature Usage Guide

VLM Training

  • Quick Start: VLM Pre-training
  • Quick Start: VLM SFT
  • VLM Dataset Conversion
  • Model Checkpoint Conversion for VLM
  • Advanced Features
    • Offline Packing
    • DP Load-Balancing
    • Model Combination
    • FP8 Training for VLM
    • Heterogeneous Parallel
    • ViT Encoder DP Load-Balancing

Embodied Training

  • Overview
  • Quick Start: Pi0.5 Training
  • Quick Start: GR00T N1.6 Training
  • Quick Start: GR00T N1.7 Training
  • Quick Start: LingBot-VA Training
  • Quick Start: X-VLA Training
  • Quick Start: DreamZero Training
  • Quick Start: FastWAM Training
  • Quick Start: Cosmos3-Nano Training
  • Evaluation Module
    • LoongForge-VLA Offline Evaluation — User Guide
    • Guide to Integrating a New Model into the Eval System
    • Evaluation Framework & Protocol
    • Benchmark Environments
    • Benchmark Pages
      • LIBERO Evaluation
      • CALVIN Evaluation
      • SimplerEnv WidowX Evaluation
        • X-VLA SimplerEnv Guide
        • GR00T-N1.6 SimplerEnv Guide
      • RoboTwin Evaluation
      • ManiSkill Evaluation

Diffusion Training

  • Quick Start: Wan Model Training
  • Wan2.2 Packing Training
  • Quick Start: Qwen-Image-Edit-2511 Training

KunLun Training

  • Kunlunxin P800 README
  • Installation on Kunlunxin P800
  • Quick Start: LLM Model Pretrain Training on Kunlunxin P800
  • Quick Start: LLM Model SFT Training on Kunlunxin P800
  • Quick Start: VLM Model SFT Training on Kunlunxin P800

Developer Guide

  • Support New Model

More

  • Contribute
  • License and File Header Guidelines
  • FAQs
  • .md

LLM Advanced Features

LLM Advanced Features#

LoongForge provides a rich set of optimizations for large language model training.

  • FP8 Training
  • Adaptive FP8 Training (Selective FP8)
  • MoE All-to-All Overlap
  • Optimizer Support
  • Fused Linear Cross Entropy
  • Mcore-Bridge: Online HF Checkpoint Loading & Saving
  • LoRA Feature Usage Guide

previous

Checkpoint Conversion for LLM

next

FP8 Training

By LoongForge

© Copyright 2026, LoongForge.