Benchmark Suites¶

vLLM provides comprehensive benchmarking tools for performance testing and evaluation.

• Benchmark CLI: vllm bench CLI tools and specialized benchmark scripts for interactive performance testing.
• Parameter Sweeps: Automate vllm bench runs for multiple configurations, useful for optimization and tuning.
• Performance Dashboard: Automated CI that publishes benchmarks on each commit.
• Benchmark using vLLM Recipes: Use the Recipe conversion tool to generate config.yaml and env.sh from vLLM Recipes for Benchmarking.