Skill

nemo-mbridge-multi-node-slurm

Created by nvidia

Version 392ab8ab2587345a9d86240967f666bd59ac82ca

Overview

Convert single-node scripts to multi-node Slurm sbatch jobs and debug common multi-node failures. Covers srun-native vs uv run torch.distributed approaches, container setup, NCCL timeouts, OOM sizing for MoE models, and interactive allocation.

Source/credit

All skills