Create an Agent Sandbox

[ccrawford4]

Rough Tech Stack:

• CLI Based Trigger
• Kubernetes Job Orchestrator
• gVisor runtime
• Git clone, file-system support, etc.

[ccrawford4]

Currently the API now supports:
-> Creating an arbitrary job which says hello world.

Next steps:

1. Dedicated image with harness + openrouter API key provided
2. Leverage gVisor for isolation
3. Enable the agent with filesystem
4. Tracking runs, metrics, traces
5. Launch on K8S production cluster

[ccrawford4]

Next steps once agent sandbox is created: self-host the LLM on a dedicated VM or spot instance

[ccrawford4]

Latest update:

Figma: https://www.figma.com/board/ySNMVaBMNxxmeR0XBEL7B4/Untitled?node-id=0-1&t=SM4a7tuj9hiKwotH-1

Gcloud documentation: https://docs.cloud.google.com/compute/docs/instances/nested-virtualization/creating-nested-vms

Final Decision: Leverage nested virtualization within gcloud using kvm + firecracker. Setup networking using qemu for internal networking support.

1. Download iso:

curl -L https://alpinelinux.org -o alpine.iso

2. Create virtual disk

qemu-img create -f qcow2 alpine-disk.qcow2 10G

Latest:

sudo qemu-system-x86_64 \
    -enable-kvm \
    -m 512 \
    -drive file=alpine-disk.qcow2,format=qcow2 \
    -drive file=alpine.iso,media=cdrom \
    -boot d \
    -nographic \
    -net nic \
    -net user,hostfwd=tcp::2222-:22

-> Spins up the VM with alpine-disk being the virtual disk and .iso with the metadata for booting while alpine-disk is read/write storage for the VM. We can allocate 10G using this command:

Currently encountering errors with booting so that needs to be dug into.

[ccrawford4]

Update: trying to do this with firecracker instead using their offical docs: https://github.com/firecracker-microvm/firecracker/blob/main/docs/getting-started.md#getting-a-rootfs-and-guest-kernel-image

[ccrawford4]

First create the instance with nested-virtualization enabled and MUST use Ubuntu 24.04

gcloud compute instances create test-vm-1 \                                                                                        
  --enable-nested-virtualization \
  --zone=us-west2-a \
  --image-family=ubuntu-2404-lts-amd64 \
  --image-project=ubuntu-os-cloud

Then do the following:

1. SSH

gcloud compute ssh test-vm-1

2. Install firecracker using their recommended commands: https://github.com/firecracker-microvm/firecracker/blob/main/docs/getting-started.md#running-firecracker