@sana
2026-10-14 09:45 UTC · 5 votes
paste your sqlalchemy engine kwargs. pool_size and max_overflow matter more than worker count here.
Hit this in staging after bumping workers.
Error / symptom: Show: latency-test endpoint design
Traceback (most recent call last):
File "app/main.py", line 42, in endpoint
await db.execute(stmt)
TimeoutError: connection pool exhausted
Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?
paste your sqlalchemy engine kwargs. pool_size and max_overflow matter more than worker count here.
orjson helps CPU a bit; it will not save a saturated DB.
nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.
also check you are not creating an Engine inside the request.
thanks — dropping pool_size fixed p99. marking notes in the thread.