API World * AI TechWorld 2026: Vertical APIs for Agentic AI: Routing the Right Context to the Right Expert
All resources (slides, code, etc) for API World 2026: Vertical APIs for Agentic AI: Routing the Right Context to the Right Expert
Participants should ensure they have the minimum requirements:
- A Linux or Mac Developer's Laptop with enough memory (16GB minimum) to run 2 databases containers plus a Quantized 7B Small Language Model.
- No GPU is required. Will strictly be using CPU only.
- Windows Users should use a VM or Cloud Instance
- If you opt for this, you must provide your own instances
- Tested On Python 3.12 Only (Should work on 3.10+)
- (HIGHLY Recommended) Huggingface developer token saved to
HF_TOKENenvironment variable. - Using OpenSearch on Instaclustr. Try for 30 days for free! SIGN UP HERE!
Software Downloads:
- Qwen2.5-7B-Instruct-1M
- Running on CPU? Use Q5_K_M version
- (Apple Silicon?) Download this instead
- Drop the file into your ~/models folder. (You might need to create this.)
- Nemotron-Orchestrator-8B
- Running on CPU? Use Q4_K_M version
- (Apple Silicon?) Download this instead
- Drop the file into your ~/models folder. (You might need to create this.)
Install Python dependencies from any folder:
pip install -r requirements.txtIngest the data:
cd news_agent
make ingest
cd financials_agent
make ingestStart the services:
# new console
cd slm_service
python slm_service.py
# new console
cd orch_service
python orch_service.py
# new console
cd news_agent
make mcp
# new console
cd news_agent
make agent
# new console
cd financials_agent
make mcp
# new console
cd financials_agent
make agent
# new console
cd orchestrator_agent
make agent
# new console
cd orchestrator_agent
make clientAsk the following question in the client:
Can you tell me what NVIDIA is doing in the Artificial Intelligence space in news articles? How that work has affected their current stock price (ticker symbol: NVDA)?