VLM Advanced Features

LoongForge provides a rich set of optimizations for vision-language model training.

• Offline Packing
• DP Load-Balancing
• Model Combination
• FP8 Training for VLM
• Heterogeneous Parallel
• ViT Encoder DP Load-Balancing