Skip to content

ggml-openvino: Add npuw dump envs for profiling - #350

Merged
ravi9 merged 8 commits into
ravi9:dev_backend_openvinofrom
yzhou51:npuw_envs
Oct 23, 2026
Merged

ravi9 merged 8 commits into
ravi9:dev_backend_openvinofrom
yzhou51:npuw_envs

Conversation

@ravi9

@ravi9 ravi9 commented Oct 16, 2026

Copy link
Copy Markdown
Owner

Moved from ravi9/llama.cpp-old#9 by @yzhou51 after the repository restore.

Overview

To add these NPUW dumps envs for profiling goal.

Additional information

  • NPUW_DUMP_SUBS / NPUW_DUMP_SUBS_DIR: export selected subgraph IR to inspect partition boundaries, shapes, and operations after timing identifies a slow stage. IR does not itself measure runtime.
  • NPUW_DUMP_IO: capture selected subgraph inputs and outputs when validating data flow around that stage.
  • NPUW_DUMP_SUBS_ON_FAIL: capture IR for a subgraph that fails compilation; this supports failure diagnosis, not performance measurement.

All these env flags are opt-in, require an OpenVINO NPU developer build, and do not change llama.cpp’s KV-cache management.

Requirements

  • I have read and agree with the contributing guidelines
    No touch the code logic, only add some opt-in dump flags.

  • AI usage disclosure:
    No.

@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Oct 21, 2026
@yzhou51

yzhou51 commented Oct 21, 2026

Copy link
Copy Markdown

Hi @cavusmustafa @wine99 Can you help take a review for this? Thanks.

@wine99 wine99 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK for me to add these debug env vars

@ravi9
ravi9 merged commit e938d77 into ravi9:dev_backend_openvino Oct 23, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation ggml OpenVINO

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants