discussion 2026-11-04 559 views 47 votes

Benchmark: orjson vs stdlib json

@nik
Rust Engineer

Hit this in staging after bumping workers.

Error / symptom: Benchmark: orjson vs stdlib json

Traceback (most recent call last):
  File "app/main.py", line 42, in endpoint
    await db.execute(stmt)
TimeoutError: connection pool exhausted

Env: Python 3.12, FastAPI 0.115, uvicorn workers=4, Postgres 16.
What am I missing in pool settings?

6 replies

@yuna
2026-11-04 16:39 UTC · 12 votes

I saw the same when each worker opened its own pool of 20. Math: 4*20 = 80 against a 50 max_connections box.

@skye
2026-11-04 18:07 UTC · 9 votes

thanks — dropping pool_size fixed p99. marking notes in the thread.

@elias
2026-11-05 07:45 UTC · 9 votes

thanks — dropping pool_size fixed p99. marking notes in the thread.

@vera_rs
2026-11-05 10:25 UTC · 1 votes

paste your sqlalchemy engine kwargs. pool_size and max_overflow matter more than worker count here.

@nox
2026-11-05 11:03 UTC · 5 votes

nginx buffering? if upstream resets, look at proxy_read_timeout before blaming uvicorn.

@kai_sre
2026-11-05 16:40 UTC · 8 votes

paste your sqlalchemy engine kwargs. pool_size and max_overflow matter more than worker count here.