(WIP) Multi backend refactor -> main (full diff of all already merged PRs) #1220
+10,533
−996
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* fix dequant 8bit Signed-off-by: jiqing-feng <[email protected]> * support double quant on intel cpu and xpu Signed-off-by: jiqing-feng <[email protected]> * fix format Signed-off-by: jiqing-feng <[email protected]> * fix shape Signed-off-by: jiqing-feng <[email protected]> * fix 4bit format Signed-off-by: jiqing-feng <[email protected]> * fix device error for xpu Signed-off-by: jiqing-feng <[email protected]> * fix 4bit tensor shape Signed-off-by: jiqing-feng <[email protected]> * fix nf4 xpu finetune Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* new matmul8bit Signed-off-by: jiqing-feng <[email protected]> * fix cxb Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
* fix xpu dtypoe Signed-off-by: jiqing-feng <[email protected]> * fix nf4 dtype Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* fix version Signed-off-by: jiqing-feng <[email protected]> * fix setup version Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* enable benchmark script Signed-off-by: jiqing-feng <[email protected]> * Small fixes to non_cuda_backends.mdx --------- Signed-off-by: jiqing-feng <[email protected]> Co-authored-by: Titus <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* enable quant storage Signed-off-by: jiqing-feng <[email protected]> * fix to numpy Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* fix 4bit XPU dequant 4bit Signed-off-by: jiqing-feng <[email protected]> * fix default value Signed-off-by: jiqing-feng <[email protected]> * fix ipex linear set Signed-off-by: jiqing-feng <[email protected]> * fix ipex linear set to false when calling state dict Signed-off-by: jiqing-feng <[email protected]> * fix Int8Param device patch Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
* fix xpu to cpu Signed-off-by: jiqing-feng <[email protected]> * fix xpu cpu data device Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
Signed-off-by: jiqing-feng <[email protected]>
* fix intel cpu/xpu warning Signed-off-by: jiqing-feng <[email protected]> * fix error log Signed-off-by: jiqing-feng <[email protected]> * fix lib Signed-off-by: jiqing-feng <[email protected]> * rm return Nonr Signed-off-by: jiqing-feng <[email protected]> * error log only without ipex Signed-off-by: jiqing-feng <[email protected]> * fix import eerror Signed-off-by: jiqing-feng <[email protected]> * fix format Signed-off-by: jiqing-feng <[email protected]> --------- Signed-off-by: jiqing-feng <[email protected]>
|
Could someone post about the status/progress of this PR? Like a list of checked and unchecked known items to do. |
* enable xpu 8bit optim * add deqaunt_blockwise * dequantize_blockwise * add bakcend synchronize * refine code * ipex dep * ipex dep too * ipex version check --------- Co-authored-by: jiqing-feng <[email protected]>
Authored by: Chetan Kumar Verma <[email protected]> Co-authored-by: Ruheena Suhani Shaik <[email protected]> Co-authored-by: Bhargav Eede <[email protected]> Co-authored-by: Vivek Goel <[email protected]> Co-authored-by: Ruheena Suhani Shaik <[email protected]>
|
Please see this short update about the multi-backend refactor #1596. cc @anadon |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR to
mainserves the purpose to keep an overview of all the extensive changes that have been introduced tomulti-backend-refactorto the iterative PRs around this topic.We will eventually merge this into master and before that do a thorough final review and, as well, get Tim's final sign-off on this extensive refactor.
For now, it mainly serves the purpose of providing a public diff of the entirety of the changes. However, already feel free to leave constructive feedback and review comments.