Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CVS-164415] WS Implement Model Exportation #29526

Draft
wants to merge 66 commits into
base: master
Choose a base branch
from
Draft

[CVS-164415] WS Implement Model Exportation #29526

wants to merge 66 commits into from

Conversation

razvanapetroaie
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

razvanapetroaie and others added 30 commits October 28, 2024 12:56
@razvanapetroaie
Adding weights I/O prefixes
788dfcb
@razvanapetroaie
Parsing I/O weights in the plugin-driver adapter
b3c3574
@razvanapetroaie
Some more adjustments to acommodate the new I/O prefixes
111aedd
@razvanapetroaie
Adding the compileWS method
73c7f1c
@razvanapetroaie
Implemented the compileWS method for the plugin-driver adapter
283bb45
@razvanapetroaie
Using the compileWS method instead of compile one
35729af
@razvanapetroaie
Enabling the WS path via a new config option
f5900d5
@razvanapetroaie
Skipping the weights inputs inside the L0 infer request
59074ef
@razvanapetroaie
Adding the signatures for the "runInit" calls
f345d87
@razvanapetroaie
Switching to reusing the Executor ctor
eec036d
@razvanapetroaie
Rewritten the "runInit" signatures
f5bad76
@razvanapetroaie
Extracting weights pointers
671de43
@razvanapetroaie
Starting the pipeline construction
d3452cc
@razvanapetroaie
Creating remote tensors for init input
e061e3f
@razvanapetroaie
Setting init outputs as main inputs upon inference request creation
0634e56
@razvanapetroaie
First version which is runnable by bapp
9e5dc3d
@razvanapetroaie
Small adjustments required for acommodating the most recent compiled …
f329c21 
…models
@razvanapetroaie
Some adjustments
382893b
@razvanapetroaie
Using topological sorting for weights identification
a5b8ed2
@razvanapetroaie
SIT accurate solution on resnet 50, but it's not a nice one
0bd457b
@razvanapetroaie
Adding time checks
54df505
@nikita-kud @razvanapetroaie
Use modified model for Init
9fc8f8b
@razvanapetroaie
Using the "initModel" as a local variable
04ad63f
@razvanapetroaie
Moving the compiler object within the CompiledModel class
4fd3039
@razvanapetroaie
Solving build issues related to batching
8a4a7b4
@razvanapetroaie
Fixing stateful models
f0ab437
@razvanapetroaie
Removing one redundant(?) runNgraphPasses call
a47c4b2
@razvanapetroaie
Moving "run_init" in the "create_infer_request" method
32648fc
@razvanapetroaie
Enabling model import
02aac22
@razvanapetroaie
Merge commit 'caa1e6af13139692a34cf37787c9c79f949bcaaa' into EISW-138…
8f7b2a9 
…991-weights-separation-poc
@github-actions github-actions bot added category: GPU OpenVINO GPU plugin category: CPU OpenVINO CPU plugin category: samples OpenVINO Runtime Samples category: dependency_changes Pull requests that update a dependency file category: NPU OpenVINO NPU plugin labels Mar 17, 2025
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from e6ff7bf to 61fa4bb Compare March 17, 2025 20:20
@github-actions github-actions bot removed category: GPU OpenVINO GPU plugin category: CPU OpenVINO CPU plugin labels Mar 17, 2025
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from 61fa4bb to ff56518 Compare March 17, 2025 20:23
@github-actions github-actions bot removed the category: dependency_changes Pull requests that update a dependency file label Mar 17, 2025
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from ff56518 to 928c03e Compare March 17, 2025 20:58
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from 928c03e to 8ffdffe Compare March 17, 2025 21:05
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from 0b46573 to 83b1772 Compare March 18, 2025 16:13
@razvanapetroaie razvanapetroaie force-pushed the CVS-164415-implement-model-exportation branch from 83b1772 to 2d1202f Compare March 18, 2025 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: NPU OpenVINO NPU plugin category: samples OpenVINO Runtime Samples
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@razvanapetroaie @nikita-kud