Home›Use cases›SGLangSGLang1 listingToolsRigtuneOpen-source tool that benchmarks llama.cpp, vLLM and SGLang settings on your GPU and traffic, then serves the winner behind an OpenAI-compatible API.Related use casesBenchmark evaluation3LLM inference3Local LLM3vLLM3GPU inference2Show all 6Show fewerllama.cpp1
RigtuneOpen-source tool that benchmarks llama.cpp, vLLM and SGLang settings on your GPU and traffic, then serves the winner behind an OpenAI-compatible API.