@leo_cache
2026-10-28 20:46 UTC · 2 votes
I would put rate limits at the edge and keep app middleware as a second line.
Hit this after a routine bump.
Symptom: Redis pipeline vs single GETs under 5k RPS — follow-up #4
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
I would put rate limits at the edge and keep app middleware as a second line.
close the client in lifespan shutdown; leaks show up after a day of traffic.
paste engine kwargs and max_connections. worker×pool is the usual culprit.
marking solved after we pinned the dependency and re-smoked /docs.