Skip to content

Conversation

@Kacper-Pietkun
Copy link
Contributor

@Kacper-Pietkun Kacper-Pietkun commented Oct 23, 2025

I added tests for custom ops defined in vllm_gaudi/ops:

  • For the tests of ops that are not using cuda kernels - native ops and hpu ops are triggered for the same input and their outputs are compared
  • For others tests that are using cuda kernels (so cannot be called with vllm-gaudi plugin) I created separate directory to store some predefined small tensors - weights, inputs and outputs. These tensors are too big to hardcode them in tests, however their sizes were adjusted, so all of them weight less than 3MB in total. Tensors are stored in a .safetensors format. Such tests run hpu ops with loaded inputs and weights and compare their outputs with the loaded outputs.

Signed-off-by: Kacper Pietkun <[email protected]>
@Kacper-Pietkun
Copy link
Contributor Author

/run-gaudi-tests

Signed-off-by: Kacper Pietkun <[email protected]>
@Kacper-Pietkun
Copy link
Contributor Author

/run-gaudi-tests

@github-actions
Copy link

✅ CI Passed

All checks passed successfully against the following vllm commit:
7e0941055fdf89bae93045683dd80542177f3241

@Kacper-Pietkun
Copy link
Contributor Author

/run-gaudi-tests

@github-actions
Copy link

✅ CI Passed

All checks passed successfully against the following vllm commit:
63b22e0dbb901b75619aa4bca2dfa1d7a71f439e

Signed-off-by: Kacper Pietkun <[email protected]>
@github-actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

Your branch is behind the base branch. Please merge or rebase to get the latest changes.

@Kacper-Pietkun
Copy link
Contributor Author

/run-gaudi-tests

@github-actions
Copy link

✅ CI Passed

All checks passed successfully against the following vllm commit:
b368382964913312d41c670b4166f4c83eed49aa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant