-
Notifications
You must be signed in to change notification settings - Fork 19
Extend component benchmarks #315
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
c828bb4
to
4f7e12e
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mac Mini (M1, 2020) benchmarks (opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
46824 cycles |
46826 cycles |
1.00 |
ML-DSA-44 sign |
176956 cycles |
177037 cycles |
1.00 |
ML-DSA-44 verify |
66114 cycles |
66121 cycles |
1.00 |
ML-DSA-65 keypair |
81429 cycles |
81439 cycles |
1.00 |
ML-DSA-65 sign |
281185 cycles |
281199 cycles |
1.00 |
ML-DSA-65 verify |
103023 cycles |
103021 cycles |
1.00 |
ML-DSA-87 keypair |
130376 cycles |
130764 cycles |
1.00 |
ML-DSA-87 sign |
342914 cycles |
344116 cycles |
1.00 |
ML-DSA-87 verify |
158736 cycles |
159148 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mac Mini (M1, 2020) benchmarks (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
112328 cycles |
112317 cycles |
1.00 |
ML-DSA-44 sign |
409172 cycles |
409141 cycles |
1.00 |
ML-DSA-44 verify |
130130 cycles |
130153 cycles |
1.00 |
ML-DSA-65 keypair |
192210 cycles |
192224 cycles |
1.00 |
ML-DSA-65 sign |
658662 cycles |
658665 cycles |
1.00 |
ML-DSA-65 verify |
207238 cycles |
207237 cycles |
1.00 |
ML-DSA-87 keypair |
315964 cycles |
315969 cycles |
1.00 |
ML-DSA-87 sign |
832829 cycles |
832811 cycles |
1.00 |
ML-DSA-87 verify |
338988 cycles |
339006 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
224323 cycles |
227787 cycles |
0.98 |
ML-DSA-44 sign |
695274 cycles |
714292 cycles |
0.97 |
ML-DSA-44 verify |
240674 cycles |
243230 cycles |
0.99 |
ML-DSA-65 keypair |
387306 cycles |
380639 cycles |
1.02 |
ML-DSA-65 sign |
1136469 cycles |
1120572 cycles |
1.01 |
ML-DSA-65 verify |
397434 cycles |
389764 cycles |
1.02 |
ML-DSA-87 keypair |
656529 cycles |
655479 cycles |
1.00 |
ML-DSA-87 sign |
1526561 cycles |
1525900 cycles |
1.00 |
ML-DSA-87 verify |
681393 cycles |
668923 cycles |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
35651 cycles |
35472 cycles |
1.01 |
ML-DSA-44 sign |
136471 cycles |
135995 cycles |
1.00 |
ML-DSA-44 verify |
45584 cycles |
45539 cycles |
1.00 |
ML-DSA-65 keypair |
62343 cycles |
61655 cycles |
1.01 |
ML-DSA-65 sign |
225353 cycles |
224162 cycles |
1.01 |
ML-DSA-65 verify |
70387 cycles |
70153 cycles |
1.00 |
ML-DSA-87 keypair |
94453 cycles |
92936 cycles |
1.02 |
ML-DSA-87 sign |
266819 cycles |
263402 cycles |
1.01 |
ML-DSA-87 verify |
105034 cycles |
104888 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-65 verify |
411428 cycles |
389764 cycles |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i) (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
95914 cycles |
96133 cycles |
1.00 |
ML-DSA-44 sign |
323018 cycles |
323398 cycles |
1.00 |
ML-DSA-44 verify |
102686 cycles |
102521 cycles |
1.00 |
ML-DSA-65 keypair |
164350 cycles |
164220 cycles |
1.00 |
ML-DSA-65 sign |
528780 cycles |
528496 cycles |
1.00 |
ML-DSA-65 verify |
163611 cycles |
163672 cycles |
1.00 |
ML-DSA-87 keypair |
266617 cycles |
267417 cycles |
1.00 |
ML-DSA-87 sign |
667668 cycles |
668661 cycles |
1.00 |
ML-DSA-87 verify |
271047 cycles |
270775 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
71047 cycles |
71452 cycles |
0.99 |
ML-DSA-44 sign |
219842 cycles |
219809 cycles |
1.00 |
ML-DSA-44 verify |
82991 cycles |
82905 cycles |
1.00 |
ML-DSA-65 keypair |
126038 cycles |
122829 cycles |
1.03 |
ML-DSA-65 sign |
367094 cycles |
355657 cycles |
1.03 |
ML-DSA-65 verify |
134524 cycles |
131537 cycles |
1.02 |
ML-DSA-87 keypair |
207783 cycles |
207402 cycles |
1.00 |
ML-DSA-87 sign |
458143 cycles |
458199 cycles |
1.00 |
ML-DSA-87 verify |
216551 cycles |
217016 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
58093 cycles |
58075 cycles |
1.00 |
ML-DSA-44 sign |
208229 cycles |
208086 cycles |
1.00 |
ML-DSA-44 verify |
73450 cycles |
73487 cycles |
1.00 |
ML-DSA-65 keypair |
101577 cycles |
102370 cycles |
0.99 |
ML-DSA-65 sign |
340764 cycles |
343811 cycles |
0.99 |
ML-DSA-65 verify |
113937 cycles |
114664 cycles |
0.99 |
ML-DSA-87 keypair |
155451 cycles |
154161 cycles |
1.01 |
ML-DSA-87 sign |
408592 cycles |
403666 cycles |
1.01 |
ML-DSA-87 verify |
170627 cycles |
168988 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
70080 cycles |
70041 cycles |
1.00 |
ML-DSA-44 sign |
234363 cycles |
234176 cycles |
1.00 |
ML-DSA-44 verify |
80608 cycles |
80552 cycles |
1.00 |
ML-DSA-65 keypair |
123648 cycles |
123653 cycles |
1.00 |
ML-DSA-65 sign |
378450 cycles |
378786 cycles |
1.00 |
ML-DSA-65 verify |
130341 cycles |
130313 cycles |
1.00 |
ML-DSA-87 keypair |
201220 cycles |
200817 cycles |
1.00 |
ML-DSA-87 sign |
479131 cycles |
478823 cycles |
1.00 |
ML-DSA-87 verify |
209959 cycles |
209893 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
41438 cycles |
42857 cycles |
0.97 |
ML-DSA-44 sign |
149132 cycles |
152741 cycles |
0.98 |
ML-DSA-44 verify |
53505 cycles |
54592 cycles |
0.98 |
ML-DSA-65 keypair |
71867 cycles |
72055 cycles |
1.00 |
ML-DSA-65 sign |
238846 cycles |
241346 cycles |
0.99 |
ML-DSA-65 verify |
81515 cycles |
81481 cycles |
1.00 |
ML-DSA-87 keypair |
109097 cycles |
116110 cycles |
0.94 |
ML-DSA-87 sign |
280861 cycles |
293320 cycles |
0.96 |
ML-DSA-87 verify |
121931 cycles |
129363 cycles |
0.94 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a) (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
134105 cycles |
133930 cycles |
1.00 |
ML-DSA-44 sign |
508365 cycles |
508520 cycles |
1.00 |
ML-DSA-44 verify |
148989 cycles |
148836 cycles |
1.00 |
ML-DSA-65 keypair |
223400 cycles |
224038 cycles |
1.00 |
ML-DSA-65 sign |
814236 cycles |
812510 cycles |
1.00 |
ML-DSA-65 verify |
233321 cycles |
233515 cycles |
1.00 |
ML-DSA-87 keypair |
368833 cycles |
368528 cycles |
1.00 |
ML-DSA-87 sign |
1025166 cycles |
1028366 cycles |
1.00 |
ML-DSA-87 verify |
381102 cycles |
381571 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4 (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
131426 cycles |
131458 cycles |
1.00 |
ML-DSA-44 sign |
456055 cycles |
455752 cycles |
1.00 |
ML-DSA-44 verify |
155875 cycles |
142820 cycles |
1.09 |
ML-DSA-65 keypair |
223979 cycles |
224110 cycles |
1.00 |
ML-DSA-65 sign |
733313 cycles |
733546 cycles |
1.00 |
ML-DSA-65 verify |
227147 cycles |
226877 cycles |
1.00 |
ML-DSA-87 keypair |
370423 cycles |
370702 cycles |
1.00 |
ML-DSA-87 sign |
937651 cycles |
938185 cycles |
1.00 |
ML-DSA-87 verify |
376983 cycles |
377210 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i) (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
154003 cycles |
153777 cycles |
1.00 |
ML-DSA-44 sign |
519167 cycles |
519021 cycles |
1.00 |
ML-DSA-44 verify |
165411 cycles |
165744 cycles |
1.00 |
ML-DSA-65 keypair |
261173 cycles |
260906 cycles |
1.00 |
ML-DSA-65 sign |
834546 cycles |
835713 cycles |
1.00 |
ML-DSA-65 verify |
264734 cycles |
264996 cycles |
1.00 |
ML-DSA-87 keypair |
433320 cycles |
434080 cycles |
1.00 |
ML-DSA-87 sign |
1072072 cycles |
1072326 cycles |
1.00 |
ML-DSA-87 verify |
438782 cycles |
438369 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
74149 cycles |
74140 cycles |
1.00 |
ML-DSA-44 sign |
249771 cycles |
249753 cycles |
1.00 |
ML-DSA-44 verify |
88350 cycles |
88344 cycles |
1.00 |
ML-DSA-65 keypair |
129637 cycles |
129627 cycles |
1.00 |
ML-DSA-65 sign |
409222 cycles |
408711 cycles |
1.00 |
ML-DSA-65 verify |
140598 cycles |
140611 cycles |
1.00 |
ML-DSA-87 keypair |
210158 cycles |
210254 cycles |
1.00 |
ML-DSA-87 sign |
511567 cycles |
511786 cycles |
1.00 |
ML-DSA-87 verify |
224667 cycles |
224850 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a) (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
118256 cycles |
118724 cycles |
1.00 |
ML-DSA-44 sign |
417535 cycles |
418369 cycles |
1.00 |
ML-DSA-44 verify |
130965 cycles |
131290 cycles |
1.00 |
ML-DSA-65 keypair |
200328 cycles |
200076 cycles |
1.00 |
ML-DSA-65 sign |
670640 cycles |
670991 cycles |
1.00 |
ML-DSA-65 verify |
204848 cycles |
205403 cycles |
1.00 |
ML-DSA-87 keypair |
331613 cycles |
333300 cycles |
0.99 |
ML-DSA-87 sign |
864443 cycles |
867281 cycles |
1.00 |
ML-DSA-87 verify |
340656 cycles |
341842 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
115320 cycles |
115308 cycles |
1.00 |
ML-DSA-44 sign |
412703 cycles |
412469 cycles |
1.00 |
ML-DSA-44 verify |
135628 cycles |
135292 cycles |
1.00 |
ML-DSA-65 keypair |
199264 cycles |
199065 cycles |
1.00 |
ML-DSA-65 sign |
680863 cycles |
680832 cycles |
1.00 |
ML-DSA-65 verify |
217508 cycles |
217260 cycles |
1.00 |
ML-DSA-87 keypair |
325392 cycles |
325724 cycles |
1.00 |
ML-DSA-87 sign |
852401 cycles |
852130 cycles |
1.00 |
ML-DSA-87 verify |
349643 cycles |
349000 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
939454 cycles |
940147 cycles |
1.00 |
ML-DSA-44 sign |
4326288 cycles |
4320171 cycles |
1.00 |
ML-DSA-44 verify |
1071064 cycles |
1071283 cycles |
1.00 |
ML-DSA-65 keypair |
1564336 cycles |
1565069 cycles |
1.00 |
ML-DSA-65 sign |
7125051 cycles |
7134328 cycles |
1.00 |
ML-DSA-65 verify |
1688122 cycles |
1690275 cycles |
1.00 |
ML-DSA-87 keypair |
2525731 cycles |
2524208 cycles |
1.00 |
ML-DSA-87 sign |
8729972 cycles |
8722966 cycles |
1.00 |
ML-DSA-87 verify |
2708251 cycles |
2707524 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3 (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
136202 cycles |
136271 cycles |
1.00 |
ML-DSA-44 sign |
451151 cycles |
451027 cycles |
1.00 |
ML-DSA-44 verify |
155294 cycles |
147182 cycles |
1.06 |
ML-DSA-65 keypair |
239242 cycles |
239177 cycles |
1.00 |
ML-DSA-65 sign |
732996 cycles |
732754 cycles |
1.00 |
ML-DSA-65 verify |
237687 cycles |
237861 cycles |
1.00 |
ML-DSA-87 keypair |
390276 cycles |
390707 cycles |
1.00 |
ML-DSA-87 sign |
947628 cycles |
947422 cycles |
1.00 |
ML-DSA-87 verify |
397160 cycles |
396895 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2 (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
210752 cycles |
211210 cycles |
1.00 |
ML-DSA-44 sign |
722601 cycles |
725201 cycles |
1.00 |
ML-DSA-44 verify |
235906 cycles |
240026 cycles |
0.98 |
ML-DSA-65 keypair |
376642 cycles |
376881 cycles |
1.00 |
ML-DSA-65 sign |
1187284 cycles |
1187944 cycles |
1.00 |
ML-DSA-65 verify |
370435 cycles |
370687 cycles |
1.00 |
ML-DSA-87 keypair |
596607 cycles |
596640 cycles |
1.00 |
ML-DSA-87 sign |
1517577 cycles |
1517557 cycles |
1.00 |
ML-DSA-87 verify |
614341 cycles |
614359 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
310407 cycles |
298929 cycles |
1.04 |
ML-DSA-44 sign |
1149260 cycles |
1099833 cycles |
1.04 |
ML-DSA-44 verify |
337244 cycles |
325451 cycles |
1.04 |
ML-DSA-65 keypair |
559941 cycles |
554401 cycles |
1.01 |
ML-DSA-65 sign |
1882753 cycles |
1810077 cycles |
1.04 |
ML-DSA-65 verify |
535876 cycles |
534686 cycles |
1.00 |
ML-DSA-87 keypair |
870126 cycles |
832492 cycles |
1.05 |
ML-DSA-87 sign |
2381418 cycles |
2294933 cycles |
1.04 |
ML-DSA-87 verify |
880612 cycles |
875274 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
114892 cycles |
114865 cycles |
1.00 |
ML-DSA-44 sign |
412222 cycles |
412011 cycles |
1.00 |
ML-DSA-44 verify |
135270 cycles |
134863 cycles |
1.00 |
ML-DSA-65 keypair |
198919 cycles |
198812 cycles |
1.00 |
ML-DSA-65 sign |
680625 cycles |
680280 cycles |
1.00 |
ML-DSA-65 verify |
217420 cycles |
216872 cycles |
1.00 |
ML-DSA-87 keypair |
324521 cycles |
324705 cycles |
1.00 |
ML-DSA-87 sign |
850534 cycles |
850463 cycles |
1.00 |
ML-DSA-87 verify |
348993 cycles |
348367 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
210285 cycles |
210196 cycles |
1.00 |
ML-DSA-44 sign |
721661 cycles |
721639 cycles |
1.00 |
ML-DSA-44 verify |
229108 cycles |
229000 cycles |
1.00 |
ML-DSA-65 keypair |
376113 cycles |
376228 cycles |
1.00 |
ML-DSA-65 sign |
1185944 cycles |
1186159 cycles |
1.00 |
ML-DSA-65 verify |
370137 cycles |
370145 cycles |
1.00 |
ML-DSA-87 keypair |
595434 cycles |
595991 cycles |
1.00 |
ML-DSA-87 sign |
1512991 cycles |
1514501 cycles |
1.00 |
ML-DSA-87 verify |
613526 cycles |
613928 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
279757 cycles |
279878 cycles |
1.00 |
ML-DSA-44 sign |
996029 cycles |
1000781 cycles |
1.00 |
ML-DSA-44 verify |
321964 cycles |
322375 cycles |
1.00 |
ML-DSA-65 keypair |
478203 cycles |
477824 cycles |
1.00 |
ML-DSA-65 sign |
1638676 cycles |
1632841 cycles |
1.00 |
ML-DSA-65 verify |
506668 cycles |
506598 cycles |
1.00 |
ML-DSA-87 keypair |
812272 cycles |
818125 cycles |
0.99 |
ML-DSA-87 sign |
2147987 cycles |
2169078 cycles |
0.99 |
ML-DSA-87 verify |
845170 cycles |
849879 cycles |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: 29e6c7e | Previous: 2bd00dc | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
377688 cycles |
339869 cycles |
1.11 |
ML-DSA-44 sign |
1228446 cycles |
945492 cycles |
1.30 |
ML-DSA-44 verify |
439319 cycles |
365170 cycles |
1.20 |
ML-DSA-65 keypair |
651936 cycles |
586612 cycles |
1.11 |
ML-DSA-65 sign |
1980250 cycles |
1528277 cycles |
1.30 |
ML-DSA-65 verify |
699846 cycles |
579474 cycles |
1.21 |
ML-DSA-87 keypair |
1068156 cycles |
999170 cycles |
1.07 |
ML-DSA-87 sign |
2544922 cycles |
2126878 cycles |
1.20 |
ML-DSA-87 verify |
1143760 cycles |
1000038 cycles |
1.14 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
452757 cycles |
451807 cycles |
1.00 |
ML-DSA-44 sign |
2013140 cycles |
2010372 cycles |
1.00 |
ML-DSA-44 verify |
527584 cycles |
527463 cycles |
1.00 |
ML-DSA-65 keypair |
761295 cycles |
761380 cycles |
1.00 |
ML-DSA-65 sign |
3320278 cycles |
3334854 cycles |
1.00 |
ML-DSA-65 verify |
819070 cycles |
818285 cycles |
1.00 |
ML-DSA-87 keypair |
1224749 cycles |
1226480 cycles |
1.00 |
ML-DSA-87 sign |
4113555 cycles |
4120162 cycles |
1.00 |
ML-DSA-87 verify |
1314942 cycles |
1318108 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mkannwischer What is this PR waiting for?
I'm not happy with the results. For example, |
4f7e12e
to
29e6c7e
Compare
4389ce1
to
9dec841
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: 4389ce1 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155912 cycles |
142820 cycles |
1.09 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: 4389ce1 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155317 cycles |
147182 cycles |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: 4389ce1 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
312985 cycles |
298929 cycles |
1.05 |
ML-DSA-44 sign |
1159342 cycles |
1099833 cycles |
1.05 |
ML-DSA-44 verify |
344397 cycles |
325451 cycles |
1.06 |
ML-DSA-65 keypair |
574059 cycles |
554401 cycles |
1.04 |
ML-DSA-65 sign |
1904373 cycles |
1810077 cycles |
1.05 |
ML-DSA-65 verify |
576166 cycles |
534686 cycles |
1.08 |
ML-DSA-87 keypair |
870416 cycles |
832492 cycles |
1.05 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Matthias J. Kannwischer <[email protected]>
9dec841
to
ec20117
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
59949 cycles |
58075 cycles |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-65 verify |
84270 cycles |
81481 cycles |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155897 cycles |
142820 cycles |
1.09 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155309 cycles |
147182 cycles |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
46237 cycles |
42857 cycles |
1.08 |
ML-DSA-44 sign |
157708 cycles |
152741 cycles |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155916 cycles |
142820 cycles |
1.09 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
123029 cycles |
118724 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155333 cycles |
147182 cycles |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-87 keypair |
881529 cycles |
832492 cycles |
1.06 |
ML-DSA-87 verify |
907240 cycles |
875274 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155875 cycles |
142820 cycles |
1.09 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 verify |
155294 cycles |
147182 cycles |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03
.
Benchmark suite | Current: ec20117 | Previous: f2d8abd | Ratio |
---|---|---|---|
ML-DSA-44 keypair |
310407 cycles |
298929 cycles |
1.04 |
ML-DSA-44 sign |
1149260 cycles |
1099833 cycles |
1.04 |
ML-DSA-44 verify |
337244 cycles |
325451 cycles |
1.04 |
ML-DSA-65 sign |
1882753 cycles |
1810077 cycles |
1.04 |
ML-DSA-87 keypair |
870126 cycles |
832492 cycles |
1.05 |
ML-DSA-87 sign |
2381418 cycles |
2294933 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
This commit adds component benchmarks for various poly and polyvec functions that have been identified as potential optimizaton targets.