Skill
jetson-llm-serve
Created by nvidia
Version 392ab8ab2587345a9d86240967f666bd59ac82ca
Overview
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
Skill
Created by nvidia
Version 392ab8ab2587345a9d86240967f666bd59ac82ca
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.