Skill
nemo-mbridge-perf-memory-tuning
Created by nvidia
Version 392ab8ab2587345a9d86240967f666bd59ac82ca
Overview
Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.