Skill

jetson-inference-mem-tune

Created by nvidia

Version 392ab8ab2587345a9d86240967f666bd59ac82ca

Overview

Pick the serving stack and per-runtime memory flags (vLLM, SGLang, llama.cpp, TensorRT Edge-LLM) for an LLM/VLM workload on any NVIDIA Jetson.

Source/credit

All skills