Skip to content

Commit

Permalink
[XPU] [DeepNVMe] use same cpu_op_desc_t with cuda (#6645)
Browse files Browse the repository at this point in the history
We have found that #6592 uses `_pinned_tensor_mgr` to create cpu bounce
buffer, which is same with what our xpu accelerator currently doing.
So no need to use xpu device specific cpu_op_desc_t.
In this PR:
1. remove custom csrc/xpu/aio/deepspeed_cpu_op.cpp
2. modify xpu async_io opbuilder.

This issue cannot be easily done with revert #6532 , for we added some
source file as last time GDS feature going in DS. So file this new PR :)
  • Loading branch information
Liangliang-Ma authored Oct 22, 2024
1 parent 11bbf45 commit a24cdd6
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 52 deletions.
51 changes: 0 additions & 51 deletions csrc/xpu/aio/deepspeed_cpu_op.cpp

This file was deleted.

2 changes: 1 addition & 1 deletion op_builder/xpu/async_io.py
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ def sources(self):
'csrc/aio/common/deepspeed_aio_types.cpp',
'csrc/aio/py_lib/deepspeed_pin_tensor.cpp',
'csrc/aio/py_lib/deepspeed_py_io_handle.cpp',
'csrc/xpu/aio/deepspeed_cpu_op.cpp',
'csrc/aio/py_lib/deepspeed_cpu_op.cpp',
'csrc/aio/py_lib/deepspeed_aio_op_desc.cpp',
]

Expand Down

0 comments on commit a24cdd6

Please sign in to comment.