Commit 0eeabc1
feat: Introduce StridedLayout, support wrapping external allocations in Buffer, add StridedMemoryView.from_buffer (#1283)
* Add StridedLayout
Signed-off-by: Kamil Tokarski <[email protected]>
* Support wrapping ptr in Buffer, create SMV from buffer and layout, dlpack export
Signed-off-by: Kamil Tokarski <[email protected]>
* Documentation, linting, minor fixes
Signed-off-by: Kamil Tokarski <[email protected]>
* Add NotImplemented copy_from/copy_to
Signed-off-by: Kamil Tokarski <[email protected]>
* Adjust flattening scalars to numpy/cupy behavior, fix shape validation in reshape, fix to dense with sliced views
Signed-off-by: Kamil Tokarski <[email protected]>
* Add StridedLayout tests
Signed-off-by: Kamil Tokarski <[email protected]>
* Use explicit int32_t instead of int in integer fused type
Signed-off-by: Kamil Tokarski <[email protected]>
* Disable (for now) exporting the SMV via dlpack
Signed-off-by: Kamil Tokarski <[email protected]>
* Revert dlpack changes
Signed-off-by: Kamil Tokarski <[email protected]>
* Support layouts up to 64 dims
Signed-off-by: Kamil Tokarski <[email protected]>
* Use cydriver to query memory attributes, fix managed memory handling, add tests for the attributes
Signed-off-by: Kamil Tokarski <[email protected]>
* Test owner and mr cannot be specified together
Signed-off-by: Kamil Tokarski <[email protected]>
* Test Buffer.close with owner
Signed-off-by: Kamil Tokarski <[email protected]>
* Add envelope checks (rquires_size_in_bytes, offset_bounds)
Signed-off-by: Kamil Tokarski <[email protected]>
* Docs, annotation fixes, remove dlpack export mentions
Signed-off-by: Kamil Tokarski <[email protected]>
* Add SMV.from_buffer/view tests
Signed-off-by: Kamil Tokarski <[email protected]>
* Layout tests for SMV created from CAI
Signed-off-by: Kamil Tokarski <[email protected]>
* Fix missing host unregister call in buffer test
Signed-off-by: Kamil Tokarski <[email protected]>
* Fix num attrib on re-try
Signed-off-by: Kamil Tokarski <[email protected]>
* Call int on the buffer.handle
Signed-off-by: Kamil Tokarski <[email protected]>
* Don't enforce Buffer having an owner when creating SMV
Signed-off-by: Kamil Tokarski <[email protected]>
* Use np._s instead of a custom helper in the tests
Signed-off-by: Kamil Tokarski <[email protected]>
* Take lanes into account when computing the itemsize
Signed-off-by: Kamil Tokarski <[email protected]>
* Move layout validation out of get_data_ptr helper
Signed-off-by: Kamil Tokarski <[email protected]>
* Disambiguate all_axes mask for layout flattening, add range flattening tests
Signed-off-by: Kamil Tokarski <[email protected]>
* Bring back the intptr_t in SMV
Signed-off-by: Kamil Tokarski <[email protected]>
* Reorder methods, adjust SMV tests to from_dlpack/form_cai methods
Signed-off-by: Kamil Tokarski <[email protected]>
* Move the Device import to top-level imports
Signed-off-by: Kamil Tokarski <[email protected]>
---------
Signed-off-by: Kamil Tokarski <[email protected]>
Co-authored-by: Leo Fang <[email protected]>1 parent 476cf1d commit 0eeabc1
File tree
15 files changed
+3896
-78
lines changed- cuda_core
- cuda/core/experimental
- _memory
- _utils
- include
- docs/source
- _templates/autosummary
- tests
- helpers
15 files changed
+3896
-78
lines changedLarge diffs are not rendered by default.
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
10 | 16 | | |
11 | 17 | | |
12 | 18 | | |
13 | 19 | | |
14 | 20 | | |
15 | 21 | | |
| 22 | + | |
16 | 23 | | |
17 | 24 | | |
| 25 | + | |
| 26 | + | |
18 | 27 | | |
19 | 28 | | |
20 | 29 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
18 | 19 | | |
19 | 20 | | |
20 | 21 | | |
| 22 | + | |
21 | 23 | | |
22 | 24 | | |
23 | 25 | | |
| |||
47 | 49 | | |
48 | 50 | | |
49 | 51 | | |
| 52 | + | |
| 53 | + | |
50 | 54 | | |
51 | 55 | | |
52 | 56 | | |
| |||
55 | 59 | | |
56 | 60 | | |
57 | 61 | | |
58 | | - | |
| 62 | + | |
| 63 | + | |
59 | 64 | | |
60 | 65 | | |
61 | 66 | | |
62 | 67 | | |
63 | 68 | | |
| 69 | + | |
| 70 | + | |
64 | 71 | | |
65 | 72 | | |
66 | 73 | | |
| 74 | + | |
67 | 75 | | |
68 | 76 | | |
69 | 77 | | |
| |||
75 | 83 | | |
76 | 84 | | |
77 | 85 | | |
78 | | - | |
| 86 | + | |
| 87 | + | |
79 | 88 | | |
80 | 89 | | |
81 | 90 | | |
| |||
87 | 96 | | |
88 | 97 | | |
89 | 98 | | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
90 | 103 | | |
91 | 104 | | |
92 | | - | |
| 105 | + | |
93 | 106 | | |
94 | 107 | | |
95 | 108 | | |
| |||
297 | 310 | | |
298 | 311 | | |
299 | 312 | | |
300 | | - | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
301 | 316 | | |
302 | 317 | | |
303 | 318 | | |
| |||
321 | 336 | | |
322 | 337 | | |
323 | 338 | | |
324 | | - | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
325 | 342 | | |
326 | 343 | | |
327 | 344 | | |
328 | 345 | | |
329 | 346 | | |
330 | 347 | | |
331 | | - | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
332 | 351 | | |
333 | 352 | | |
334 | 353 | | |
| |||
346 | 365 | | |
347 | 366 | | |
348 | 367 | | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
349 | 373 | | |
350 | 374 | | |
351 | 375 | | |
352 | 376 | | |
353 | 377 | | |
354 | | - | |
355 | | - | |
356 | | - | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
357 | 382 | | |
358 | 383 | | |
| 384 | + | |
359 | 385 | | |
360 | 386 | | |
361 | 387 | | |
362 | 388 | | |
| 389 | + | |
| 390 | + | |
| 391 | + | |
| 392 | + | |
| 393 | + | |
| 394 | + | |
| 395 | + | |
| 396 | + | |
| 397 | + | |
| 398 | + | |
| 399 | + | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
| 403 | + | |
| 404 | + | |
| 405 | + | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
| 410 | + | |
| 411 | + | |
| 412 | + | |
| 413 | + | |
| 414 | + | |
| 415 | + | |
| 416 | + | |
| 417 | + | |
| 418 | + | |
| 419 | + | |
| 420 | + | |
| 421 | + | |
| 422 | + | |
| 423 | + | |
| 424 | + | |
| 425 | + | |
| 426 | + | |
| 427 | + | |
| 428 | + | |
| 429 | + | |
| 430 | + | |
| 431 | + | |
| 432 | + | |
| 433 | + | |
| 434 | + | |
| 435 | + | |
| 436 | + | |
| 437 | + | |
| 438 | + | |
| 439 | + | |
| 440 | + | |
| 441 | + | |
| 442 | + | |
| 443 | + | |
| 444 | + | |
| 445 | + | |
| 446 | + | |
| 447 | + | |
| 448 | + | |
| 449 | + | |
| 450 | + | |
| 451 | + | |
| 452 | + | |
| 453 | + | |
363 | 454 | | |
364 | 455 | | |
365 | 456 | | |
| |||
0 commit comments