6 min readLocal LLMs · Inference · Performance
How Local LLM Throughput Scales with Multiple Agents
Adding agents does not simply divide a local LLM’s solo token rate between them. Total output can rise even while each agent slows down.
Writing
Longer ideas, worked through.
No fixed subject. Research, explanations, and whatever else is worth developing beyond a short post.