ServerBench: Agentic Design of Specialized LLM Serving Systems
The paper introduces ServerBench, a benchmark for evaluating coding agents on designing complete and specialized LLM serving systems.
The paper introduces ServerBench, a benchmark for evaluating coding agents on designing complete and specialized LLM serving systems.