6 min readLocal LLMs · Inference · Performance
How Local LLM Throughput Scales with Multiple Agents
Adding agents does not simply divide a local LLM’s solo token rate between them. Total output can rise even while each agent slows down.
Writing
Local LLMs, performance, and systems under load.