discussion 2026-10-13 1199 views 44 votes

Show: latency-test endpoint design

@skye
Junior Python Dev

Hit this in staging after bumping workers.

Error / symptom: Show: latency-test endpoint design

Traceback (most recent call last):
  File "app/main.py", line 42, in endpoint
    await db.execute(stmt)
TimeoutError: connection pool exhausted

Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?

5 replies

@sana
2026-10-14 09:45 UTC · 5 votes

paste your sqlalchemy engine kwargs. pool_size and max_overflow matter more than worker count here.

@amira
2026-10-14 21:08 UTC · 11 votes

orjson helps CPU a bit; it will not save a saturated DB.

@tara
2026-10-15 00:29 UTC · 8 votes

nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.

@mei
2026-10-15 09:29 UTC · 9 votes

also check you are not creating an Engine inside the request.

@gabe
2026-10-15 12:37 UTC · 10 votes

thanks — dropping pool_size fixed p99. marking notes in the thread.