Skip to content
apple-perf

apple-perf #642

Sign in to view logs

apple-perf

apple-perf #642

Triggered via schedule June 30, 2026 05:01
@metascroymetascroy
⁠ 71dff79
main
Status Cancelled
Total duration 3d 0h 3m 20s
Artifacts –

apple-perf.yml

on: schedule
set-parameters
7s
set-parameters
Matrix: export-models
Matrix: prepare-test-specs
build-benchmark-app  /  macos-job
3s
build-benchmark-app / macos-job
upload-benchmark-app
0s
upload-benchmark-app
Matrix: benchmark-on-device
upload-benchmark-results
1d 0h
upload-benchmark-results
Fit to window
Zoom out
Zoom in

Annotations

87 errors, 1 warning, and 1 notice
build-benchmark-app / macos-job
The job was not started because recent account payments have failed or your spending limit needs to be increased. Please check the 'Billing & plans' section in your settings
prepare-test-specs (ic3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, apple_iphone_15, ar... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, arn:aws:devicefarm:us-...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv2, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (w2l, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (resnet50, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic4, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mobilebert, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (resnet50, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:dev...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:dev... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (w2l, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic4, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, apple_iphone_1...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv2, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mv2, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (w2l, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:02... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (edsr, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15+ios_18, arn:aws:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, apple_iphon... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv2, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (ic4, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic4, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (resnet50, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic4, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:02... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:02... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mobilebert, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv2, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (w2l, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (w2l, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:02... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mobilebert, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, arn:aws:devicefarm:us-west-... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, apple_...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (resnet50, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (edsr, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (edsr, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15+ios_18, arn:aws:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv2, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepool:02... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (mv3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devic... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (resnet50, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicepo... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (w2l, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:d...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (edsr, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devi... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (resnet50, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
prepare-test-specs (mobilebert, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:3085353...
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (ic4, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:device... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
export-models (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devi... / macos-job
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (resnet50, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15+ios_18, arn:aws:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv2, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicep... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (resnet50, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:3085353... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (edsr, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (llama, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853538511... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (w2l, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mobilebert, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (llama, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:3085353851... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic4, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv2, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (w2l, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv3, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicep... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (resnet50, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:de... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv3, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic3, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicep... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mobilebert, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:30853... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, arn:aws:devicefarm:us... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic4, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, llama3_qlora, apple_iphone_... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (w2l, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicep... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, llama3_spinquant, apple... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (ic4, mps, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114:devicep... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (edsr, xnnpack_q8, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
benchmark-on-device (mv2, coreml_fp16, apple_iphone_15, arn:aws:devicefarm:us-west-2:308535385114... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
apple-perf
Canceling since a higher priority waiting request for apple-perf-main-71dff798f056c4c33a1c3dee1665edcae316c80d-false-true exists
upload-benchmark-results
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
set-parameters
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
build-benchmark-app / macos-job
The macos-latest-xlarge label will migrate to macOS 26 beginning June 15, 2026. For more information see https://github.com/actions/runner-images/issues/14167