Skip to content

Speedup FP4 packing #766

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 7 commits into from
Sep 3, 2025
Merged

Speedup FP4 packing #766

merged 7 commits into from
Sep 3, 2025

Conversation

yiliu30
Copy link
Contributor

@yiliu30 yiliu30 commented Aug 26, 2025 •
edited
Loading

  • enable torch.compile for packing on cuda
  • disable torch.compile for packing on cpu

@yiliu30 yiliu30 changed the title [WIP]Speedup FP4 packing Speedup FP4 packing Sep 3, 2025
@wenhuach21 wenhuach21 merged commit 253b48f into main Sep 3, 2025
8 checks passed
@wenhuach21 wenhuach21 deleted the speedup-packing branch September 3, 2025 07:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@WeiweiZhang1 WeiweiZhang1 WeiweiZhang1 approved these changes

@wenhuach21 wenhuach21 Awaiting requested review from wenhuach21

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@yiliu30 @WeiweiZhang1 @wenhuach21