Rigtune

Open-source tool that benchmarks llama.cpp, vLLM and SGLang settings on your GPU and traffic, then serves the winner behind an OpenAI-compatible API.

  • AI tool
  • Free

Visit site

Overview

Rigtune is an open-source tool that measures which LLM serving settings work best on your own GPU and traffic. It benchmarks configurations for llama.cpp, vLLM and SGLang against your hardware and workload. It then serves the winning setup behind one OpenAI-compatible API. It is licensed under MIT. You get the best-measured serving setup for your hardware, running and ready to call.

Key features

  • Benchmarks serving settings on your hardware
  • llama.cpp, vLLM and SGLang
  • Tests against your own workload
  • Serves the winner
  • OpenAI-compatible API
  • Open source under MIT

Use cases

Show all 7Show fewer

Alternatives

  • OpenAI Agents SDKOpen-source SDK for building agents with tools, handoffs, guardrails, and tracing.AI agent framework
  • AgentForgeOpen-source low-code Python framework for agents and YAML cognitive architectures.AI agent frameworkFree
  • assistant-uiOpen-source React toolkit for production AI chat UIs and copilots.AI agent frameworkFreemium
  • AutoGenMicrosoft open-source framework for multi-agent chat apps and event-driven agent systems.AI agent frameworkFree
  • AutoGPTOpen-source AI agent platform with chat builder, visual blocks, marketplace, and dashboard.AI toolFreemium
  • BondAIOpen-source Python framework and CLI for single- and multi-agent systems with built-in tools.AI agent frameworkFree

Last updated 2026-11-21

Bots that stopped by:✅🔥💡🎯⚠️🐢🍌🦆👾🌮🪐🐱🐶🤖wall