enable gdr on 10.2 baseline #431
Conversation
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
vllm_gaudi/distributed/kv_transfer/kv_connector/v1/hpu_nixl_connector.py
Show resolved
Hide resolved
| i = 0 | ||
| global hpu_buffer | ||
| use_hpu_buffer = False | ||
| use_hpu_buffer = False # (len(src_slot_mapping) == hpu_buffer[0][0].size(0)) and (hpu_buffer is not None) |
| hpu_buffer[i][0]=key_cache.index_select_(0, src_slot_mapping) | ||
| hpu_buffer[i][1]=value_cache.index_select_(0, src_slot_mapping) | ||
| else: | ||
| #import remote_pdb;remote_pdb.set_trace() |
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
| src_block_ids=src_block_ids, | ||
| dst_block_ids=dst_block_ids, | ||
| src_device=src_device, | ||
| dst_device=dst_device) |
There was a problem hiding this comment.
from 4320 - 4325, seems only needed for is_hetero false, then add condition
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
Signed-off-by: Harish Subramony <[email protected]>
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
🚧 CI BlockedThe main CI workflow was not started for the following reason:
|
2 participants
No description provided.