@nox
2026-10-21 18:18 UTC · 10 votes
orjson helped cpu a few percent; db still the ceiling.
Hit this after a routine bump.
Symptom: Cache-Control for public OpenAPI JSON
TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)
Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?
orjson helped cpu a few percent; db still the ceiling.
orjson helped CPU a few percent; DB still the ceiling.
measure with keep-alive on; cold connects inflate p99.
marking solved after we pinned the dependency and re-smoked /docs.
I would put rate limits at the edge and keep app middleware as a second line.
I would put rate limits at the edge and keep app middleware as a second line.
measure with keep-alive on; cold connects inflate p99.
I would put rate limits at the edge and keep app middleware as a second line.