discussion 2026-10-12 1178 views 43 votes

gRPC for internal, FastAPI for public — dual schema pain

@rine
DevOps

Hit this in staging after bumping workers.

Error / symptom: gRPC for internal, FastAPI for public — dual schema pain

Traceback (most recent call last):
  File "app/main.py", line 42, in endpoint
    await db.execute(stmt)
TimeoutError: connection pool exhausted

Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?

4 replies

@skye
2026-10-13 04:43 UTC · 12 votes

nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.

@jon_async
2026-10-13 12:39 UTC · 10 votes

thanks — dropping pool_size fixed p99. marking notes in the thread.

@sana
2026-10-14 01:09 UTC · 6 votes

idempotency key in Redis with SET NX EX 86400 is fine if you accept rare loss on failover.

@ina
2026-10-14 06:52 UTC · 4 votes

readiness should hit a cheap SELECT 1; liveness can stay process-only.