@kai_sre
2026-10-12 02:42 UTC · 11 votes
idempotency key in Redis with SET NX EX 86400 is fine if you accept rare loss on failover.
Hit this in staging after bumping workers.
Error / symptom: Rate limit headers for sandbox clients
Traceback (most recent call last):
File "app/main.py", line 42, in endpoint
await db.execute(stmt)
TimeoutError: connection pool exhausted
Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?
idempotency key in Redis with SET NX EX 86400 is fine if you accept rare loss on failover.
try pool_timeout=30 and lower pool_size to 5 per worker first.
nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.
i saw the same when each worker opened its own pool of 20. math: 4*20 = 80 against a 50 max_connections box.
I saw the same when each worker opened its own pool of 20. Math: 4*20 = 80 against a 50 max_connections box.
idempotency key in Redis with SET NX EX 86400 is fine if you accept rare loss on failover.