Skip to content

Extend component benchmarks #315

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Extend component benchmarks #315

wants to merge 2 commits into from

Conversation

mkannwischer
Copy link
Contributor

@mkannwischer mkannwischer commented Jun 9, 2025

This commit adds component benchmarks for various poly and polyvec functions that have been identified as potential optimizaton targets.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 46824 cycles 46826 cycles 1.00
ML-DSA-44 sign 176956 cycles 177037 cycles 1.00
ML-DSA-44 verify 66114 cycles 66121 cycles 1.00
ML-DSA-65 keypair 81429 cycles 81439 cycles 1.00
ML-DSA-65 sign 281185 cycles 281199 cycles 1.00
ML-DSA-65 verify 103023 cycles 103021 cycles 1.00
ML-DSA-87 keypair 130376 cycles 130764 cycles 1.00
ML-DSA-87 sign 342914 cycles 344116 cycles 1.00
ML-DSA-87 verify 158736 cycles 159148 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mac Mini (M1, 2020) benchmarks (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 112328 cycles 112317 cycles 1.00
ML-DSA-44 sign 409172 cycles 409141 cycles 1.00
ML-DSA-44 verify 130130 cycles 130153 cycles 1.00
ML-DSA-65 keypair 192210 cycles 192224 cycles 1.00
ML-DSA-65 sign 658662 cycles 658665 cycles 1.00
ML-DSA-65 verify 207238 cycles 207237 cycles 1.00
ML-DSA-87 keypair 315964 cycles 315969 cycles 1.00
ML-DSA-87 sign 832829 cycles 832811 cycles 1.00
ML-DSA-87 verify 338988 cycles 339006 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 224323 cycles 227787 cycles 0.98
ML-DSA-44 sign 695274 cycles 714292 cycles 0.97
ML-DSA-44 verify 240674 cycles 243230 cycles 0.99
ML-DSA-65 keypair 387306 cycles 380639 cycles 1.02
ML-DSA-65 sign 1136469 cycles 1120572 cycles 1.01
ML-DSA-65 verify 397434 cycles 389764 cycles 1.02
ML-DSA-87 keypair 656529 cycles 655479 cycles 1.00
ML-DSA-87 sign 1526561 cycles 1525900 cycles 1.00
ML-DSA-87 verify 681393 cycles 668923 cycles 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 35651 cycles 35472 cycles 1.01
ML-DSA-44 sign 136471 cycles 135995 cycles 1.00
ML-DSA-44 verify 45584 cycles 45539 cycles 1.00
ML-DSA-65 keypair 62343 cycles 61655 cycles 1.01
ML-DSA-65 sign 225353 cycles 224162 cycles 1.01
ML-DSA-65 verify 70387 cycles 70153 cycles 1.00
ML-DSA-87 keypair 94453 cycles 92936 cycles 1.02
ML-DSA-87 sign 266819 cycles 263402 cycles 1.01
ML-DSA-87 verify 105034 cycles 104888 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-65 verify 411428 cycles 389764 cycles 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i) (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 95914 cycles 96133 cycles 1.00
ML-DSA-44 sign 323018 cycles 323398 cycles 1.00
ML-DSA-44 verify 102686 cycles 102521 cycles 1.00
ML-DSA-65 keypair 164350 cycles 164220 cycles 1.00
ML-DSA-65 sign 528780 cycles 528496 cycles 1.00
ML-DSA-65 verify 163611 cycles 163672 cycles 1.00
ML-DSA-87 keypair 266617 cycles 267417 cycles 1.00
ML-DSA-87 sign 667668 cycles 668661 cycles 1.00
ML-DSA-87 verify 271047 cycles 270775 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 71047 cycles 71452 cycles 0.99
ML-DSA-44 sign 219842 cycles 219809 cycles 1.00
ML-DSA-44 verify 82991 cycles 82905 cycles 1.00
ML-DSA-65 keypair 126038 cycles 122829 cycles 1.03
ML-DSA-65 sign 367094 cycles 355657 cycles 1.03
ML-DSA-65 verify 134524 cycles 131537 cycles 1.02
ML-DSA-87 keypair 207783 cycles 207402 cycles 1.00
ML-DSA-87 sign 458143 cycles 458199 cycles 1.00
ML-DSA-87 verify 216551 cycles 217016 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 58093 cycles 58075 cycles 1.00
ML-DSA-44 sign 208229 cycles 208086 cycles 1.00
ML-DSA-44 verify 73450 cycles 73487 cycles 1.00
ML-DSA-65 keypair 101577 cycles 102370 cycles 0.99
ML-DSA-65 sign 340764 cycles 343811 cycles 0.99
ML-DSA-65 verify 113937 cycles 114664 cycles 0.99
ML-DSA-87 keypair 155451 cycles 154161 cycles 1.01
ML-DSA-87 sign 408592 cycles 403666 cycles 1.01
ML-DSA-87 verify 170627 cycles 168988 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 70080 cycles 70041 cycles 1.00
ML-DSA-44 sign 234363 cycles 234176 cycles 1.00
ML-DSA-44 verify 80608 cycles 80552 cycles 1.00
ML-DSA-65 keypair 123648 cycles 123653 cycles 1.00
ML-DSA-65 sign 378450 cycles 378786 cycles 1.00
ML-DSA-65 verify 130341 cycles 130313 cycles 1.00
ML-DSA-87 keypair 201220 cycles 200817 cycles 1.00
ML-DSA-87 sign 479131 cycles 478823 cycles 1.00
ML-DSA-87 verify 209959 cycles 209893 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 41438 cycles 42857 cycles 0.97
ML-DSA-44 sign 149132 cycles 152741 cycles 0.98
ML-DSA-44 verify 53505 cycles 54592 cycles 0.98
ML-DSA-65 keypair 71867 cycles 72055 cycles 1.00
ML-DSA-65 sign 238846 cycles 241346 cycles 0.99
ML-DSA-65 verify 81515 cycles 81481 cycles 1.00
ML-DSA-87 keypair 109097 cycles 116110 cycles 0.94
ML-DSA-87 sign 280861 cycles 293320 cycles 0.96
ML-DSA-87 verify 121931 cycles 129363 cycles 0.94

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a) (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 134105 cycles 133930 cycles 1.00
ML-DSA-44 sign 508365 cycles 508520 cycles 1.00
ML-DSA-44 verify 148989 cycles 148836 cycles 1.00
ML-DSA-65 keypair 223400 cycles 224038 cycles 1.00
ML-DSA-65 sign 814236 cycles 812510 cycles 1.00
ML-DSA-65 verify 233321 cycles 233515 cycles 1.00
ML-DSA-87 keypair 368833 cycles 368528 cycles 1.00
ML-DSA-87 sign 1025166 cycles 1028366 cycles 1.00
ML-DSA-87 verify 381102 cycles 381571 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4 (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 131426 cycles 131458 cycles 1.00
ML-DSA-44 sign 456055 cycles 455752 cycles 1.00
ML-DSA-44 verify 155875 cycles 142820 cycles 1.09
ML-DSA-65 keypair 223979 cycles 224110 cycles 1.00
ML-DSA-65 sign 733313 cycles 733546 cycles 1.00
ML-DSA-65 verify 227147 cycles 226877 cycles 1.00
ML-DSA-87 keypair 370423 cycles 370702 cycles 1.00
ML-DSA-87 sign 937651 cycles 938185 cycles 1.00
ML-DSA-87 verify 376983 cycles 377210 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i) (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 154003 cycles 153777 cycles 1.00
ML-DSA-44 sign 519167 cycles 519021 cycles 1.00
ML-DSA-44 verify 165411 cycles 165744 cycles 1.00
ML-DSA-65 keypair 261173 cycles 260906 cycles 1.00
ML-DSA-65 sign 834546 cycles 835713 cycles 1.00
ML-DSA-65 verify 264734 cycles 264996 cycles 1.00
ML-DSA-87 keypair 433320 cycles 434080 cycles 1.00
ML-DSA-87 sign 1072072 cycles 1072326 cycles 1.00
ML-DSA-87 verify 438782 cycles 438369 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 74149 cycles 74140 cycles 1.00
ML-DSA-44 sign 249771 cycles 249753 cycles 1.00
ML-DSA-44 verify 88350 cycles 88344 cycles 1.00
ML-DSA-65 keypair 129637 cycles 129627 cycles 1.00
ML-DSA-65 sign 409222 cycles 408711 cycles 1.00
ML-DSA-65 verify 140598 cycles 140611 cycles 1.00
ML-DSA-87 keypair 210158 cycles 210254 cycles 1.00
ML-DSA-87 sign 511567 cycles 511786 cycles 1.00
ML-DSA-87 verify 224667 cycles 224850 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a) (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 118256 cycles 118724 cycles 1.00
ML-DSA-44 sign 417535 cycles 418369 cycles 1.00
ML-DSA-44 verify 130965 cycles 131290 cycles 1.00
ML-DSA-65 keypair 200328 cycles 200076 cycles 1.00
ML-DSA-65 sign 670640 cycles 670991 cycles 1.00
ML-DSA-65 verify 204848 cycles 205403 cycles 1.00
ML-DSA-87 keypair 331613 cycles 333300 cycles 0.99
ML-DSA-87 sign 864443 cycles 867281 cycles 1.00
ML-DSA-87 verify 340656 cycles 341842 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 115320 cycles 115308 cycles 1.00
ML-DSA-44 sign 412703 cycles 412469 cycles 1.00
ML-DSA-44 verify 135628 cycles 135292 cycles 1.00
ML-DSA-65 keypair 199264 cycles 199065 cycles 1.00
ML-DSA-65 sign 680863 cycles 680832 cycles 1.00
ML-DSA-65 verify 217508 cycles 217260 cycles 1.00
ML-DSA-87 keypair 325392 cycles 325724 cycles 1.00
ML-DSA-87 sign 852401 cycles 852130 cycles 1.00
ML-DSA-87 verify 349643 cycles 349000 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 939454 cycles 940147 cycles 1.00
ML-DSA-44 sign 4326288 cycles 4320171 cycles 1.00
ML-DSA-44 verify 1071064 cycles 1071283 cycles 1.00
ML-DSA-65 keypair 1564336 cycles 1565069 cycles 1.00
ML-DSA-65 sign 7125051 cycles 7134328 cycles 1.00
ML-DSA-65 verify 1688122 cycles 1690275 cycles 1.00
ML-DSA-87 keypair 2525731 cycles 2524208 cycles 1.00
ML-DSA-87 sign 8729972 cycles 8722966 cycles 1.00
ML-DSA-87 verify 2708251 cycles 2707524 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3 (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 136202 cycles 136271 cycles 1.00
ML-DSA-44 sign 451151 cycles 451027 cycles 1.00
ML-DSA-44 verify 155294 cycles 147182 cycles 1.06
ML-DSA-65 keypair 239242 cycles 239177 cycles 1.00
ML-DSA-65 sign 732996 cycles 732754 cycles 1.00
ML-DSA-65 verify 237687 cycles 237861 cycles 1.00
ML-DSA-87 keypair 390276 cycles 390707 cycles 1.00
ML-DSA-87 sign 947628 cycles 947422 cycles 1.00
ML-DSA-87 verify 397160 cycles 396895 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2 (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 210752 cycles 211210 cycles 1.00
ML-DSA-44 sign 722601 cycles 725201 cycles 1.00
ML-DSA-44 verify 235906 cycles 240026 cycles 0.98
ML-DSA-65 keypair 376642 cycles 376881 cycles 1.00
ML-DSA-65 sign 1187284 cycles 1187944 cycles 1.00
ML-DSA-65 verify 370435 cycles 370687 cycles 1.00
ML-DSA-87 keypair 596607 cycles 596640 cycles 1.00
ML-DSA-87 sign 1517577 cycles 1517557 cycles 1.00
ML-DSA-87 verify 614341 cycles 614359 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 310407 cycles 298929 cycles 1.04
ML-DSA-44 sign 1149260 cycles 1099833 cycles 1.04
ML-DSA-44 verify 337244 cycles 325451 cycles 1.04
ML-DSA-65 keypair 559941 cycles 554401 cycles 1.01
ML-DSA-65 sign 1882753 cycles 1810077 cycles 1.04
ML-DSA-65 verify 535876 cycles 534686 cycles 1.00
ML-DSA-87 keypair 870126 cycles 832492 cycles 1.05
ML-DSA-87 sign 2381418 cycles 2294933 cycles 1.04
ML-DSA-87 verify 880612 cycles 875274 cycles 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 114892 cycles 114865 cycles 1.00
ML-DSA-44 sign 412222 cycles 412011 cycles 1.00
ML-DSA-44 verify 135270 cycles 134863 cycles 1.00
ML-DSA-65 keypair 198919 cycles 198812 cycles 1.00
ML-DSA-65 sign 680625 cycles 680280 cycles 1.00
ML-DSA-65 verify 217420 cycles 216872 cycles 1.00
ML-DSA-87 keypair 324521 cycles 324705 cycles 1.00
ML-DSA-87 sign 850534 cycles 850463 cycles 1.00
ML-DSA-87 verify 348993 cycles 348367 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 210285 cycles 210196 cycles 1.00
ML-DSA-44 sign 721661 cycles 721639 cycles 1.00
ML-DSA-44 verify 229108 cycles 229000 cycles 1.00
ML-DSA-65 keypair 376113 cycles 376228 cycles 1.00
ML-DSA-65 sign 1185944 cycles 1186159 cycles 1.00
ML-DSA-65 verify 370137 cycles 370145 cycles 1.00
ML-DSA-87 keypair 595434 cycles 595991 cycles 1.00
ML-DSA-87 sign 1512991 cycles 1514501 cycles 1.00
ML-DSA-87 verify 613526 cycles 613928 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 279757 cycles 279878 cycles 1.00
ML-DSA-44 sign 996029 cycles 1000781 cycles 1.00
ML-DSA-44 verify 321964 cycles 322375 cycles 1.00
ML-DSA-65 keypair 478203 cycles 477824 cycles 1.00
ML-DSA-65 sign 1638676 cycles 1632841 cycles 1.00
ML-DSA-65 verify 506668 cycles 506598 cycles 1.00
ML-DSA-87 keypair 812272 cycles 818125 cycles 0.99
ML-DSA-87 sign 2147987 cycles 2169078 cycles 0.99
ML-DSA-87 verify 845170 cycles 849879 cycles 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 29e6c7e Previous: 2bd00dc Ratio
ML-DSA-44 keypair 377688 cycles 339869 cycles 1.11
ML-DSA-44 sign 1228446 cycles 945492 cycles 1.30
ML-DSA-44 verify 439319 cycles 365170 cycles 1.20
ML-DSA-65 keypair 651936 cycles 586612 cycles 1.11
ML-DSA-65 sign 1980250 cycles 1528277 cycles 1.30
ML-DSA-65 verify 699846 cycles 579474 cycles 1.21
ML-DSA-87 keypair 1068156 cycles 999170 cycles 1.07
ML-DSA-87 sign 2544922 cycles 2126878 cycles 1.20
ML-DSA-87 verify 1143760 cycles 1000038 cycles 1.14

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 452757 cycles 451807 cycles 1.00
ML-DSA-44 sign 2013140 cycles 2010372 cycles 1.00
ML-DSA-44 verify 527584 cycles 527463 cycles 1.00
ML-DSA-65 keypair 761295 cycles 761380 cycles 1.00
ML-DSA-65 sign 3320278 cycles 3334854 cycles 1.00
ML-DSA-65 verify 819070 cycles 818285 cycles 1.00
ML-DSA-87 keypair 1224749 cycles 1226480 cycles 1.00
ML-DSA-87 sign 4113555 cycles 4120162 cycles 1.00
ML-DSA-87 verify 1314942 cycles 1318108 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@hanno-becker hanno-becker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mkannwischer What is this PR waiting for?

@mkannwischer
Copy link
Contributor Author

@mkannwischer What is this PR waiting for?

I'm not happy with the results. For example, poly_pointwise_montgomery cycles=4 is most certainly wrong.
Let me re-try this without LTO.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4389ce1 Previous: f2d8abd Ratio
ML-DSA-44 verify 155912 cycles 142820 cycles 1.09

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4389ce1 Previous: f2d8abd Ratio
ML-DSA-44 verify 155317 cycles 147182 cycles 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: 4389ce1 Previous: f2d8abd Ratio
ML-DSA-44 keypair 312985 cycles 298929 cycles 1.05
ML-DSA-44 sign 1159342 cycles 1099833 cycles 1.05
ML-DSA-44 verify 344397 cycles 325451 cycles 1.06
ML-DSA-65 keypair 574059 cycles 554401 cycles 1.04
ML-DSA-65 sign 1904373 cycles 1810077 cycles 1.05
ML-DSA-65 verify 576166 cycles 534686 cycles 1.08
ML-DSA-87 keypair 870416 cycles 832492 cycles 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Signed-off-by: Matthias J. Kannwischer <[email protected]>
Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 59949 cycles 58075 cycles 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-65 verify 84270 cycles 81481 cycles 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155897 cycles 142820 cycles 1.09

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155309 cycles 147182 cycles 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 46237 cycles 42857 cycles 1.08
ML-DSA-44 sign 157708 cycles 152741 cycles 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155916 cycles 142820 cycles 1.09

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 123029 cycles 118724 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155333 cycles 147182 cycles 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-87 keypair 881529 cycles 832492 cycles 1.06
ML-DSA-87 verify 907240 cycles 875274 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155875 cycles 142820 cycles 1.09

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@oqs-bot oqs-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 verify 155294 cycles 147182 cycles 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite Current: ec20117 Previous: f2d8abd Ratio
ML-DSA-44 keypair 310407 cycles 298929 cycles 1.04
ML-DSA-44 sign 1149260 cycles 1099833 cycles 1.04
ML-DSA-44 verify 337244 cycles 325451 cycles 1.04
ML-DSA-65 sign 1882753 cycles 1810077 cycles 1.04
ML-DSA-87 keypair 870126 cycles 832492 cycles 1.05
ML-DSA-87 sign 2381418 cycles 2294933 cycles 1.04

This comment was automatically generated by workflow using github-action-benchmark.

@mkannwischer mkannwischer marked this pull request as draft July 15, 2025 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Extend Component benchmarks
4 participants