← Dictionary

6. Keeping it running in the real world

Rate limit

A cap on how often you may call a service in a window of time. Exceed it and requests bounce until the window resets.

Why it matters: fan-out meets rate limits fast — fifty parallel agents hitting one API is a self-inflicted outage. Orchestration must pace the fleet, and well-designed limits are also how you stop runaway loops from burning budget.