Skip to content

Make P-D simulation compatible with the latest version of nixl connector #255

@mayabar

Description

@mayabar

Currently the sidecar for the D simulator in P-D scenario should be configured to use nixl connector, in this case it works with additional fields in the request/response (do_remote_decode, do_remote_prefill, remote_block_ids, remote_engine_id, remote_host, remote_port)

Current version of sidecar uses nixl2 connector which expects for the following fields:

  • kv_transfer_params
    • do_remote_decode
    • do_remote_prefill
    • remote_engine_id
    • remote_block_ids
    • remote_host
    • remote_port

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions