[inventory] Add unhealthy zpools from each sled #9615
buildomat / helios / deploy
succeeded
Jan 14, 2026 in 1h 14m 22s
Success!
The buildomat job ID is 01KEX7H20DN8KFXJ5VYWYJB3Y7. Click here for more detailed status.
The job produced the following artefacts:
/var/svc/log/oxide-mg-ddm:default.log(342.60KiB) [rendered]/var/svc/log/oxide-sled-agent:default.log(2.70MiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log(40.26MiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log(891B) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log(43.06KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log(92.60KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log(432.58KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log(696.66KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log(0B) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log(55.30KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log(1.71KiB) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log(0B) [rendered]/zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log(0B) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_crucible_06ad00b1-6ebe-43f9-a1cf-c5862070bff7/root/var/svc/log/oxide-crucible-agent:default.log(6.76KiB) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_crucible_06ad00b1-6ebe-43f9-a1cf-c5862070bff7/root/var/svc/log/oxide-crucible-downstairs:default.log(0B) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_crucible_06ad00b1-6ebe-43f9-a1cf-c5862070bff7/root/var/svc/log/oxide-crucible-downstairs:downstairs-8e2e0a1a-4289-4866-aca2-1a869a6a3e7f.log(2.95KiB) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_crucible_06ad00b1-6ebe-43f9-a1cf-c5862070bff7/root/var/svc/log/oxide-zone-network-setup:default.log(0B) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_nexus_b4b43de8-1fa5-4d79-8de7-29658c264183/root/var/svc/log/oxide-nexus:default.log(1.56MiB) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_nexus_b4b43de8-1fa5-4d79-8de7-29658c264183/root/var/svc/log/oxide-opte-interface-setup:default.log(0B) [rendered]/pool/ext/1156ef2d-35a9-4f0f-b25c-f830d153ba24/crypt/zone/oxz_nexus_b4b43de8-1fa5-4d79-8de7-29658c264183/root/var/svc/log/oxide-zone-network-setup:default.log(0B) [rendered]/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_clickhouse_07a7794e-06a1-463f-9f86-4a79aeeb9371/root/var/svc/log/oxide-clickhouse-admin-single:default.log(7.20KiB) [rendered]/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_clickhouse_07a7794e-06a1-463f-9f86-4a79aeeb9371/root/var/svc/log/oxide-clickhouse:default.log(870.01KiB) [rendered]/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_clickhouse_07a7794e-06a1-463f-9f86-4a79aeeb9371/root/var/svc/log/oxide-zone-network-setup:default.log(0B) [rendered]/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_cockroachdb_324dfe6b-5b9e-47d1-8213-293a867230de/root/var/svc/log/oxide-cockroach-admin:default.log(8.64KiB) [rendered]/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_cockroachdb_324dfe6b-5b9e-47d1-8213-293a867230de/root/var/svc/log/oxide-cockroachdb:default.log(0B) [rendered]- ... and 85 more not shown here.
The requested job was completed.
Details
control: job dependencies complete; ready to run (waiting for 44 m 29 s)
control: job assigned to worker 01KEXA2PTKHY39XQR8Y6194MDG [factory lab, buskin/18695] (queued for 1 m 10 s)
...
task: starting task 0: "setup"
task: process exited: duration 4056 ms, exit code 0
...
task: starting task 1: "authentication"
task: process exited: duration 45 ms, exit code 0
...
task: starting task 2: "build"
task: process exited: duration 966603 ms, exit code 0
...
|W| uploading: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_578c9d7b-96e0-4213-9501-db33b52b317b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2081 bytes)
|W| upload warning: file "/pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_578c9d7b-96e0-4213-9501-db33b52b317b/root/var/svc/log/oxide-zone-network-setup:default.log.0" disappeared between scan and upload
|W| uploading: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-crucible-pantry:default.log (6677 bytes)
|W| upload warning: file "/pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 6677 -> 73432
|W| uploaded: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-crucible-pantry:default.log
|W| uploading: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-crucible-pantry:default.log.0 (161745 bytes)
|W| upload warning: file "/pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-crucible-pantry:default.log.0" disappeared between scan and upload
|W| uploading: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
|W| uploaded: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-zone-network-setup:default.log
|W| uploading: /pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2139 bytes)
|W| upload warning: file "/pool/ext/fb41cbe8-3592-4f7f-85ed-261c1090790e/crypt/zone/oxz_crucible_pantry_ebcd7a54-3403-4bba-b930-85197796b3b9/root/var/svc/log/oxide-zone-network-setup:default.log.0" disappeared between scan and upload
|W| uploading: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/measurements.log (533035 bytes)
|W| upload warning: file "/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/measurements.log" changed size mid upload: 533035 -> 731973
|W| uploaded: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/measurements.log
|W| uploading: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/statistics.log (390780 bytes)
|W| upload warning: file "/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/statistics.log" changed size mid upload: 390780 -> 545805
|W| uploaded: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/statistics.log
|W| uploading: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/tracking.log (90560 bytes)
|W| upload warning: file "/pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/tracking.log" changed size mid upload: 90560 -> 123824
|W| uploaded: /pool/ext/1eb7d70f-96a1-499a-8651-af14b39ffb2b/crypt/zone/oxz_ntp_f0510cac-556d-4991-99b9-660d3688ac83/root/var/log/chrony/tracking.log
Loading