Skill

nemo-mbridge-perf-activation-recompute

Created by nvidia

Version 392ab8ab2587345a9d86240967f666bd59ac82ca

Overview

Validate and use selective and full activation recompute in Megatron Bridge to reduce GPU memory usage at the cost of extra compute. Use for activation memory OOMs or regressions involving recompute_granularity, recompute_num_layers, recompute_modules, recompute_method, selective recompute, full recompute, or activation checkpointing.

Source/credit

All skills