discussion 2026-09-28 33 views 31 votes

TLS termination: nginx vs cloud LB for ASGI — follow-up #23

@helen_go
Senior Go Engineer

Hit this after a routine bump.

Symptom: TLS termination: nginx vs cloud LB for ASGI — follow-up #23

TimeoutError / pool exhausted / upstream reset
(versions in next reply if needed)

Env: Python 3.12, FastAPI recent, uvicorn workers≥2.
What should I check first?

5 replies

@helen_go
2026-09-28 15:29 UTC · 9 votes

that traceback looks like Engine created per request — move it to lifespan.

@raul
2026-09-28 19:00 UTC · 0 votes

measure with keep-alive on; cold connects inflate p99.

@mei
2026-09-29 12:55 UTC · 4 votes

measure with keep-alive on; cold connects inflate p99.

@nox
2026-09-29 13:33 UTC · 7 votes

dropping pool_size per worker fixed it for us on the same box size.

@vera_rs
2026-11-22 20:51 UTC · 4 votes

we fixed the same class of bug by moving Engine creation into lifespan.

Reply

Login or register to reply.