·
The issue has been fully resolved.
Resolved
Identified
You may see infra failures when trying to train MoE models with LoRA rank <8.