[None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api#8415

Merged

hchings merged 8 commits intoNVIDIA:mainfrom

Superjomn:perf-tuning

Nov 4, 2025

Commits on Nov 3, 2025

init

Superjomn
authored and
hchings
committed
fix orchestrator_type and llm async example

Superjomn
authored and
hchings
committed
refactor rpc_client

Superjomn
authored and
hchings
committed
add gc trace in LLM

Superjomn
authored and
hchings
committed
.fix cancel future in zmq

Superjomn
authored and
hchings
committed
simplify rpc_client await_response

Superjomn
authored and
hchings
committed
restore orchestrator_type env

Superjomn
authored and
hchings
committed
make gc tracer singleton

Superjomn
authored and
hchings
committed