An expert-parallelism communication library for MoE training that keeps token loads perfectly balanced via dynamic redundant experts, with zero-copy and static shapes.
1212An expert-parallelism communication library for MoE training that keeps token loads perfectly balanced via dynamic redundant experts, with zero-copy and static shapes.