discussion 2026-10-28 249 views 18 votes

Redis pipeline vs single GETs under 5k RPS — follow-up #4

@seth
SRE

Hit this after a routine bump.

Symptom: Redis pipeline vs single GETs under 5k RPS — follow-up #4

TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)

Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?

4 replies

@leo_cache
2026-10-28 20:46 UTC · 2 votes

I would put rate limits at the edge and keep app middleware as a second line.

@nox
2026-10-29 03:07 UTC · 3 votes

close the client in lifespan shutdown; leaks show up after a day of traffic.

@piotr
2026-10-29 18:38 UTC · 7 votes

paste engine kwargs and max_connections. worker×pool is the usual culprit.

@oz
2026-10-29 20:48 UTC · 3 votes

marking solved after we pinned the dependency and re-smoked /docs.

Reply

Login or register to reply.