@skye
2026-10-13 04:43 UTC · 12 votes
nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.
Hit this in staging after bumping workers.
Error / symptom: gRPC for internal, FastAPI for public — dual schema pain
Traceback (most recent call last):
File "app/main.py", line 42, in endpoint
await db.execute(stmt)
TimeoutError: connection pool exhausted
Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?
nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.
thanks — dropping pool_size fixed p99. marking notes in the thread.
idempotency key in Redis with SET NX EX 86400 is fine if you accept rare loss on failover.
readiness should hit a cheap SELECT 1; liveness can stay process-only.