d-flex flex-column width-full">

Add benchmarking script (#20188)

ea24622

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Meta CLA

Meta CLA Check

Meta CodeSync

Meta Import Checks

Meta Internal-Only Changes Check

Check Labels on: pull_request_target 1

Check labels

Labeler on: pull_request_target 1

label

Docathon Labels Sync on: pull_request_target 1

check-labels

Build documentation on: pull_request 1

build (buck2) / Build doc

upload-gh-pages

Lint on: pull_request 5

Get changed files / get-changed-files

link-check / lint-urls

link-check / lint-xrefs

link-check / lint-file-size

lintrunner-mypy

lintrunner

Build Presets on: pull_request 15

apple (macos) / build

apple (ios) / build

apple (ios-simulator) / build

apple (pybind) / build

apple (profiling) / build

apple (llm) / build

zephyr (zephyr) / build

linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

windows (pybind) / build

windows (windows) / build

Test QNN Backend on: pull_request 3

test-qnn / test-backend-linux (qnn, models) / linux-job

test-qnn / test-backend-linux (qnn, operators) / linux-job

test-qnn / test-backend-macos

test-qnn / package-golden-artifacts

periodic on: pull_request 7

gather-models

test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job

test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

Test XNNPACK Backend on: pull_request 3

test-xnnpack / test-backend-linux (xnnpack, models) / linux-job

test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job

test-xnnpack / test-backend-macos

test-xnnpack / package-golden-artifacts

pull on: pull_request 109

Get changed files / get-changed-files

CI run decision / decide

test-qnn-wheel-packages-linux (3.10) / linux-job

test-qnn-wheel-packages-linux (3.11) / linux-job

test-qnn-wheel-packages-linux (3.12) / linux-job

test-qnn-wheel-packages-linux (3.13) / linux-job

test-setup-linux-gcc / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux (linear, portable, linux.2xlarge) / linux-job

test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add, portable, linux.2xlarge) / linux-job

test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add_mul, portable, linux.2xlarge) / linux-job

test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic3, portable, linux.2xlarge) / linux-job

test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mv2, portable, linux.2xlarge) / linux-job

test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet18, portable, linux.2xlarge) / linux-job

test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet50, portable, linux.2xlarge) / linux-job

test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job

test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job

test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job

test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job

test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job

test-parakeet-xnnpack-linux / linux-job

test-voxtral-realtime-xnnpack-linux / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job

test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux-android / linux-job

test-custom-ops-linux / linux-job

test-selective-build-linux / linux-job

test-multimodal-linux

test-moshi-linux / linux-job

test-quantized-aot-lib-linux / linux-job

test-binary-size-linux-gcc / linux-job

test-binary-size-linux / linux-job

test-arm-cortex-m-size-test (bare_metal) / linux-job

test-arm-cortex-m-size-test (zephyr-preset) / linux-job

test-mcu-cortex-m-backend / linux-job

android / build-android

android / run-emulator

unittest / linux / linux-job

unittest / macos / macos-job

unittest / windows / windows-job

unittest-editable / linux / linux-job

unittest-editable / macos / macos-job

unittest-editable / windows / windows-job

unittest-buck / linux / linux-job

unittest-buck / macos / macos-job

unittest-buck / windows

test-qnn-buck-build-linux / linux-job

test-arm-backend-no-driver (test_pytest_ops_no_target) / linux-job

test-arm-backend-no-driver (test_pytest_ops_tosa) / linux-job

test-arm-backend-no-driver (test_pytest_models_tosa) / linux-job

test-arm-backend-no-driver (test_run_tosa) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job

test-static-llama-qnn-linux (stories_110m) / linux-job

test-static-llama-qnn-linux (stories_260k_bc) / linux-job

test-sqnr-static-llm-qnn-linux (smollm2_135m) / linux-job

test-qnn-models-linux (mv2) / linux-job

test-qnn-models-linux (mv3) / linux-job

test-qnn-models-linux (dl3) / linux-job

test-qnn-direct-build-linux / linux-job

test-qnn-testsuite-linux / test-backend-linux (qnn, models) / linux-job

test-qnn-testsuite-linux / test-backend-linux (qnn, operators) / linux-job

test-qnn-testsuite-linux / test-backend-macos

test-qnn-testsuite-linux / package-golden-artifacts

test-qnn-passes-linux / linux-job

test-qnn-delegate-linux / linux-job

test-phi-3-mini-runner-linux / linux-job

test-qnn-python-imports-linux / linux-job

test-eval_llama-wikitext-linux / linux-job

test-llama_runner_eager-linux / linux-job

test-lora-linux / linux-job

test-lora-multimethod-linux / linux-job

test-mediatek-models-linux / linux-job

test-openvino-linux / linux-job

test-build-wasm-linux / linux-job

unittest-wasm-bindings / linux-job

unittest-wasm-bindings (--enable-etdump) / linux-job

unittest-nxp-neutron / linux-job

test-samsung-quantmodels-linux

test-samsung-models-linux

test-vulkan-models-linux / linux-job

test-vulkan-operators-linux / linux-job

nxp-build-test / linux-job

test-minimal-wheel-linux

test-coreml-bc-macos (${{ matrix.runner }})

Test ARM Backend on: pull_request 5

test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job

test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job

test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job

test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job

test-arm / test-backend-macos

test-arm / package-golden-artifacts

Test WebGPU Backend on: pull_request 3

test-webgpu / test-backend-linux (webgpu, models) / linux-job

test-webgpu / test-backend-linux (webgpu, operators) / linux-job

test-webgpu / test-backend-macos

test-webgpu / package-golden-artifacts

Test CoreML Backend on: pull_request

Get changed files / get-changed-files

test-coreml

Test Vulkan Backend on: pull_request 3

test-vulkan / test-backend-linux (vulkan, models) / linux-job

test-vulkan / test-backend-linux (vulkan, operators) / linux-job

test-vulkan / test-backend-macos

test-vulkan / package-golden-artifacts

Cadence Build & Test on: pull_request 3

cpu-build / build

cpu-test / test-aot / test-aot

cpu-test / test-ops / test-ops

Facebook GitHub Tools

Facebook Internal - Linter

Facebook Internal - Builds & Tests

PyTorch Bot

Dr.CI

Meta CLA / Meta CLA Check succeeded Jun 10, 2026 in 0s

Contributor License Agreement is valid!

View more details on Meta CLA

Loading

Re-running checks...