Test performance penalty for not using lazy reduction in matrix-vector mul

[mkannwischer]

Testing how much we have to pay if we do not use the lazy reduction. This would make it much easier to reduce the memory footprint.

[github-actions]

Mac Mini (M1, 2020) benchmarks (opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	54741 cycles	55121 cycles	0.99
ML-DSA-44 sign	168522 cycles	181218 cycles	0.93
ML-DSA-44 verify	68490 cycles	70271 cycles	0.97
ML-DSA-65 keypair	97962 cycles	98197 cycles	1.00
ML-DSA-65 sign	270500 cycles	288821 cycles	0.94
ML-DSA-65 verify	108628 cycles	110755 cycles	0.98
ML-DSA-87 keypair	153992 cycles	152936 cycles	1.01
ML-DSA-87 sign	340968 cycles	357384 cycles	0.95
ML-DSA-87 verify	171884 cycles	173385 cycles	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Mac Mini (M1, 2020) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	117679 cycles	112351 cycles	1.05
ML-DSA-44 sign	431618 cycles	409292 cycles	1.05
ML-DSA-44 verify	135374 cycles	130051 cycles	1.04
ML-DSA-65 keypair	203407 cycles	192709 cycles	1.06
ML-DSA-65 sign	713969 cycles	658766 cycles	1.08
ML-DSA-65 verify	217875 cycles	207158 cycles	1.05
ML-DSA-87 keypair	337637 cycles	316016 cycles	1.07
ML-DSA-87 sign	920085 cycles	833048 cycles	1.10
ML-DSA-87 verify	360558 cycles	339065 cycles	1.06

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	132329 cycles	128481 cycles	1.03
ML-DSA-44 sign	436926 cycles	419292 cycles	1.04
ML-DSA-44 verify	146452 cycles	142322 cycles	1.03
ML-DSA-65 keypair	247820 cycles	240293 cycles	1.03
ML-DSA-65 sign	735114 cycles	695033 cycles	1.06
ML-DSA-65 verify	239060 cycles	231034 cycles	1.03
ML-DSA-87 keypair	378426 cycles	361990 cycles	1.05
ML-DSA-87 sign	942940 cycles	879346 cycles	1.07
ML-DSA-87 verify	391564 cycles	375231 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 sign	436926 cycles	419292 cycles	1.04
ML-DSA-65 keypair	247820 cycles	240293 cycles	1.03
ML-DSA-65 sign	735114 cycles	695033 cycles	1.06
ML-DSA-65 verify	239060 cycles	231034 cycles	1.03
ML-DSA-87 keypair	378426 cycles	361990 cycles	1.05
ML-DSA-87 sign	942940 cycles	879346 cycles	1.07
ML-DSA-87 verify	391564 cycles	375231 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	216680 cycles	209755 cycles	1.03
ML-DSA-44 sign	759204 cycles	721488 cycles	1.05
ML-DSA-44 verify	237830 cycles	228427 cycles	1.04
ML-DSA-65 keypair	386122 cycles	375731 cycles	1.03
ML-DSA-65 sign	1244019 cycles	1185975 cycles	1.05
ML-DSA-65 verify	381499 cycles	370463 cycles	1.03
ML-DSA-87 keypair	613942 cycles	594968 cycles	1.03
ML-DSA-87 sign	1585035 cycles	1513496 cycles	1.05
ML-DSA-87 verify	631149 cycles	613012 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	216680 cycles	209755 cycles	1.03
ML-DSA-44 sign	759204 cycles	721488 cycles	1.05
ML-DSA-44 verify	237830 cycles	228427 cycles	1.04
ML-DSA-65 sign	1244019 cycles	1185975 cycles	1.05
ML-DSA-87 keypair	613942 cycles	594968 cycles	1.03
ML-DSA-87 sign	1585035 cycles	1513496 cycles	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Intel Xeon 4th gen (c7i)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	46547 cycles	46318 cycles	1.00
ML-DSA-44 sign	142698 cycles	143210 cycles	1.00
ML-DSA-44 verify	52732 cycles	52723 cycles	1.00
ML-DSA-65 keypair	82813 cycles	83731 cycles	0.99
ML-DSA-65 sign	232275 cycles	239349 cycles	0.97
ML-DSA-65 verify	82548 cycles	83638 cycles	0.99
ML-DSA-87 keypair	125951 cycles	126356 cycles	1.00
ML-DSA-87 sign	281982 cycles	290700 cycles	0.97
ML-DSA-87 verify	127489 cycles	128157 cycles	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 4th gen (c7i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 808fce1	Previous: d526633	Ratio
ML-DSA-44 keypair	49485 cycles	47586 cycles	1.04
ML-DSA-44 sign	160196 cycles	153461 cycles	1.04
ML-DSA-44 verify	55990 cycles	53879 cycles	1.04
ML-DSA-65 sign	268130 cycles	254913 cycles	1.05
ML-DSA-65 verify	87930 cycles	84977 cycles	1.03
ML-DSA-87 keypair	133236 cycles	127486 cycles	1.05
ML-DSA-87 sign	330944 cycles	307406 cycles	1.08
ML-DSA-87 verify	135781 cycles	129950 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Intel Xeon 4th gen (c7i) (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	96210 cycles	95743 cycles	1.00
ML-DSA-44 sign	330002 cycles	322676 cycles	1.02
ML-DSA-44 verify	103613 cycles	102339 cycles	1.01
ML-DSA-65 keypair	165871 cycles	163949 cycles	1.01
ML-DSA-65 sign	534187 cycles	528783 cycles	1.01
ML-DSA-65 verify	165840 cycles	163058 cycles	1.02
ML-DSA-87 keypair	271536 cycles	265848 cycles	1.02
ML-DSA-87 sign	688725 cycles	668435 cycles	1.03
ML-DSA-87 verify	272976 cycles	270993 cycles	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 4th gen (c7i) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-87 sign	688725 cycles	668435 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Intel Xeon 3rd gen (c6i)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	76089 cycles	77080 cycles	0.99
ML-DSA-44 sign	213640 cycles	220563 cycles	0.97
ML-DSA-44 verify	84886 cycles	85845 cycles	0.99
ML-DSA-65 keypair	135404 cycles	136269 cycles	0.99
ML-DSA-65 sign	353367 cycles	364356 cycles	0.97
ML-DSA-65 verify	134190 cycles	135934 cycles	0.99
ML-DSA-87 keypair	204796 cycles	205351 cycles	1.00
ML-DSA-87 sign	429304 cycles	441708 cycles	0.97
ML-DSA-87 verify	204807 cycles	207153 cycles	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 808fce1	Previous: d526633	Ratio
ML-DSA-44 keypair	79927 cycles	77505 cycles	1.03
ML-DSA-44 sign	238980 cycles	229859 cycles	1.04
ML-DSA-65 keypair	141362 cycles	136044 cycles	1.04
ML-DSA-65 sign	403040 cycles	381158 cycles	1.06
ML-DSA-65 verify	141892 cycles	137040 cycles	1.04
ML-DSA-87 keypair	217246 cycles	207823 cycles	1.05
ML-DSA-87 sign	496104 cycles	463675 cycles	1.07
ML-DSA-87 verify	219110 cycles	209884 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

AMD EPYC 3rd gen (c6a)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	79322 cycles	81356 cycles	0.97
ML-DSA-44 sign	207520 cycles	226092 cycles	0.92
ML-DSA-44 verify	84512 cycles	88260 cycles	0.96
ML-DSA-65 keypair	139357 cycles	142052 cycles	0.98
ML-DSA-65 sign	330784 cycles	362087 cycles	0.91
ML-DSA-65 verify	134031 cycles	139632 cycles	0.96
ML-DSA-87 keypair	231921 cycles	230331 cycles	1.01
ML-DSA-87 sign	442648 cycles	469575 cycles	0.94
ML-DSA-87 verify	225705 cycles	228097 cycles	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 808fce1	Previous: d526633	Ratio
ML-DSA-44 keypair	88734 cycles	84016 cycles	1.06
ML-DSA-44 sign	255891 cycles	237582 cycles	1.08
ML-DSA-44 verify	95136 cycles	90769 cycles	1.05
ML-DSA-65 keypair	153654 cycles	144299 cycles	1.06
ML-DSA-65 sign	423882 cycles	382979 cycles	1.11
ML-DSA-65 verify	150857 cycles	141929 cycles	1.06
ML-DSA-87 keypair	251114 cycles	237753 cycles	1.06
ML-DSA-87 sign	560939 cycles	493575 cycles	1.14
ML-DSA-87 verify	248288 cycles	232906 cycles	1.07

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	332045 cycles	317717 cycles	1.05
ML-DSA-44 sign	1078818 cycles	1018829 cycles	1.06
ML-DSA-44 verify	358593 cycles	343435 cycles	1.04
ML-DSA-65 keypair	581402 cycles	554825 cycles	1.05
ML-DSA-65 sign	1810613 cycles	1681441 cycles	1.08
ML-DSA-65 verify	575864 cycles	548288 cycles	1.05
ML-DSA-87 keypair	967100 cycles	921974 cycles	1.05
ML-DSA-87 sign	2415454 cycles	2279440 cycles	1.06
ML-DSA-87 verify	973861 cycles	924004 cycles	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	332045 cycles	317717 cycles	1.05
ML-DSA-44 sign	1078818 cycles	1018829 cycles	1.06
ML-DSA-44 verify	358593 cycles	343435 cycles	1.04
ML-DSA-65 keypair	581402 cycles	554825 cycles	1.05
ML-DSA-65 sign	1810613 cycles	1681441 cycles	1.08
ML-DSA-65 verify	575864 cycles	548288 cycles	1.05
ML-DSA-87 keypair	967100 cycles	921974 cycles	1.05
ML-DSA-87 sign	2415454 cycles	2279440 cycles	1.06
ML-DSA-87 verify	973861 cycles	924004 cycles	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Intel Xeon 3rd gen (c6i) (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	155547 cycles	153622 cycles	1.01
ML-DSA-44 sign	527113 cycles	517320 cycles	1.02
ML-DSA-44 verify	167883 cycles	165362 cycles	1.02
ML-DSA-65 keypair	267490 cycles	260088 cycles	1.03
ML-DSA-65 sign	862139 cycles	834566 cycles	1.03
ML-DSA-65 verify	270750 cycles	264365 cycles	1.02
ML-DSA-87 keypair	442222 cycles	435856 cycles	1.01
ML-DSA-87 sign	1107347 cycles	1077002 cycles	1.03
ML-DSA-87 verify	447606 cycles	441239 cycles	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

AMD EPYC 3rd gen (c6a) (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	139020 cycles	133755 cycles	1.04
ML-DSA-44 sign	527554 cycles	508741 cycles	1.04
ML-DSA-44 verify	154146 cycles	149009 cycles	1.03
ML-DSA-65 keypair	232126 cycles	224929 cycles	1.03
ML-DSA-65 sign	857652 cycles	817984 cycles	1.05
ML-DSA-65 verify	242099 cycles	234445 cycles	1.03
ML-DSA-87 keypair	384066 cycles	367661 cycles	1.04
ML-DSA-87 sign	1092211 cycles	1024750 cycles	1.07
ML-DSA-87 verify	397432 cycles	380667 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

AMD EPYC 4th gen (c7a)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	55397 cycles	57250 cycles	0.97
ML-DSA-44 sign	154782 cycles	162767 cycles	0.95
ML-DSA-44 verify	62068 cycles	64684 cycles	0.96
ML-DSA-65 keypair	97865 cycles	99154 cycles	0.99
ML-DSA-65 sign	250056 cycles	268404 cycles	0.93
ML-DSA-65 verify	97631 cycles	100472 cycles	0.97
ML-DSA-87 keypair	150252 cycles	149108 cycles	1.01
ML-DSA-87 sign	308110 cycles	312790 cycles	0.99
ML-DSA-87 verify	149444 cycles	150848 cycles	0.99

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	139020 cycles	133755 cycles	1.04
ML-DSA-44 sign	527554 cycles	508741 cycles	1.04
ML-DSA-44 verify	154146 cycles	149009 cycles	1.03
ML-DSA-65 keypair	232126 cycles	224929 cycles	1.03
ML-DSA-65 sign	857652 cycles	817984 cycles	1.05
ML-DSA-65 verify	242099 cycles	234445 cycles	1.03
ML-DSA-87 keypair	384066 cycles	367661 cycles	1.04
ML-DSA-87 sign	1092211 cycles	1024750 cycles	1.07
ML-DSA-87 verify	397432 cycles	380667 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 808fce1	Previous: d526633	Ratio
ML-DSA-65 sign	283814 cycles	275458 cycles	1.03
ML-DSA-87 sign	351402 cycles	336799 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton2

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	132720 cycles	128977 cycles	1.03
ML-DSA-44 sign	437573 cycles	419986 cycles	1.04
ML-DSA-44 verify	146844 cycles	142726 cycles	1.03
ML-DSA-65 keypair	248316 cycles	240336 cycles	1.03
ML-DSA-65 sign	735832 cycles	695356 cycles	1.06
ML-DSA-65 verify	239507 cycles	231268 cycles	1.04
ML-DSA-87 keypair	378966 cycles	362538 cycles	1.05
ML-DSA-87 sign	944259 cycles	880625 cycles	1.07
ML-DSA-87 verify	391795 cycles	375653 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton2'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 sign	437573 cycles	419986 cycles	1.04
ML-DSA-65 keypair	248316 cycles	240336 cycles	1.03
ML-DSA-65 sign	735832 cycles	695356 cycles	1.06
ML-DSA-65 verify	239507 cycles	231268 cycles	1.04
ML-DSA-87 keypair	378966 cycles	362538 cycles	1.05
ML-DSA-87 sign	944259 cycles	880625 cycles	1.07
ML-DSA-87 verify	391795 cycles	375653 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton4

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	79144 cycles	77450 cycles	1.02
ML-DSA-44 sign	246141 cycles	238723 cycles	1.03
ML-DSA-44 verify	86460 cycles	84869 cycles	1.02
ML-DSA-65 keypair	141289 cycles	137236 cycles	1.03
ML-DSA-65 sign	405445 cycles	386431 cycles	1.05
ML-DSA-65 verify	141538 cycles	137840 cycles	1.03
ML-DSA-87 keypair	229167 cycles	221317 cycles	1.04
ML-DSA-87 sign	523722 cycles	493651 cycles	1.06
ML-DSA-87 verify	231845 cycles	224144 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

AMD EPYC 4th gen (c7a) (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	119628 cycles	118655 cycles	1.01
ML-DSA-44 sign	421880 cycles	417795 cycles	1.01
ML-DSA-44 verify	131982 cycles	131349 cycles	1.00
ML-DSA-65 keypair	202773 cycles	200149 cycles	1.01
ML-DSA-65 sign	682655 cycles	669316 cycles	1.02
ML-DSA-65 verify	207148 cycles	205009 cycles	1.01
ML-DSA-87 keypair	337713 cycles	332412 cycles	1.02
ML-DSA-87 sign	885204 cycles	870135 cycles	1.02
ML-DSA-87 verify	345940 cycles	341727 cycles	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 verify	151700 cycles	142948 cycles	1.06
ML-DSA-87 sign	967130 cycles	938604 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton3 (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	138757 cycles	136141 cycles	1.02
ML-DSA-44 sign	461746 cycles	450824 cycles	1.02
ML-DSA-44 verify	149877 cycles	147151 cycles	1.02
ML-DSA-65 keypair	244537 cycles	239369 cycles	1.02
ML-DSA-65 sign	758568 cycles	732552 cycles	1.04
ML-DSA-65 verify	242577 cycles	237430 cycles	1.02
ML-DSA-87 keypair	399948 cycles	390139 cycles	1.03
ML-DSA-87 sign	987157 cycles	947297 cycles	1.04
ML-DSA-87 verify	406976 cycles	396872 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-65 sign	758568 cycles	732552 cycles	1.04
ML-DSA-87 sign	987157 cycles	947297 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton2 (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	216687 cycles	210315 cycles	1.03
ML-DSA-44 sign	759388 cycles	722344 cycles	1.05
ML-DSA-44 verify	243080 cycles	238729 cycles	1.02
ML-DSA-65 keypair	386994 cycles	377901 cycles	1.02
ML-DSA-65 sign	1244334 cycles	1187457 cycles	1.05
ML-DSA-65 verify	381725 cycles	371394 cycles	1.03
ML-DSA-87 keypair	614264 cycles	595631 cycles	1.03
ML-DSA-87 sign	1586118 cycles	1516225 cycles	1.05
ML-DSA-87 verify	631291 cycles	613436 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton2 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	216687 cycles	210315 cycles	1.03
ML-DSA-44 sign	759388 cycles	722344 cycles	1.05
ML-DSA-65 sign	1244334 cycles	1187457 cycles	1.05
ML-DSA-87 keypair	614264 cycles	595631 cycles	1.03
ML-DSA-87 sign	1586118 cycles	1516225 cycles	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	468084 cycles	452280 cycles	1.03
ML-DSA-44 sign	2072688 cycles	2008168 cycles	1.03
ML-DSA-44 verify	542417 cycles	526074 cycles	1.03
ML-DSA-65 keypair	789935 cycles	761954 cycles	1.04
ML-DSA-65 sign	3465825 cycles	3326025 cycles	1.04
ML-DSA-65 verify	848348 cycles	819643 cycles	1.04
ML-DSA-87 keypair	1282172 cycles	1238511 cycles	1.04
ML-DSA-87 sign	4331841 cycles	4151009 cycles	1.04
ML-DSA-87 verify	1371042 cycles	1323960 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	468084 cycles	452280 cycles	1.03
ML-DSA-44 sign	2072688 cycles	2008168 cycles	1.03
ML-DSA-44 verify	542417 cycles	526074 cycles	1.03
ML-DSA-65 keypair	789935 cycles	761954 cycles	1.04
ML-DSA-65 sign	3465825 cycles	3326025 cycles	1.04
ML-DSA-65 verify	848348 cycles	819643 cycles	1.04
ML-DSA-87 keypair	1282172 cycles	1238511 cycles	1.04
ML-DSA-87 sign	4331841 cycles	4151009 cycles	1.04
ML-DSA-87 verify	1371042 cycles	1323960 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	998387 cycles	936300 cycles	1.07
ML-DSA-44 sign	4547888 cycles	4331978 cycles	1.05
ML-DSA-44 verify	1127280 cycles	1071908 cycles	1.05
ML-DSA-65 keypair	1652159 cycles	1555382 cycles	1.06
ML-DSA-65 sign	7672445 cycles	7135767 cycles	1.08
ML-DSA-65 verify	1798495 cycles	1689729 cycles	1.06
ML-DSA-87 keypair	2737049 cycles	2523855 cycles	1.08
ML-DSA-87 sign	9561263 cycles	8729995 cycles	1.10
ML-DSA-87 verify	2916448 cycles	2708041 cycles	1.08

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	998387 cycles	936300 cycles	1.07
ML-DSA-44 sign	4547888 cycles	4331978 cycles	1.05
ML-DSA-44 verify	1127280 cycles	1071908 cycles	1.05
ML-DSA-65 keypair	1652159 cycles	1555382 cycles	1.06
ML-DSA-65 sign	7672445 cycles	7135767 cycles	1.08
ML-DSA-65 verify	1798495 cycles	1689729 cycles	1.06
ML-DSA-87 keypair	2737049 cycles	2523855 cycles	1.08
ML-DSA-87 sign	9561263 cycles	8729995 cycles	1.10
ML-DSA-87 verify	2916448 cycles	2708041 cycles	1.08

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	240033 cycles	243560 cycles	0.99
ML-DSA-44 sign	726234 cycles	734275 cycles	0.99
ML-DSA-44 verify	251379 cycles	258943 cycles	0.97
ML-DSA-65 keypair	473808 cycles	461844 cycles	1.03
ML-DSA-65 sign	1228659 cycles	1182635 cycles	1.04
ML-DSA-65 verify	426070 cycles	424234 cycles	1.00
ML-DSA-87 keypair	705088 cycles	704135 cycles	1.00
ML-DSA-87 sign	1610635 cycles	1570533 cycles	1.03
ML-DSA-87 verify	708703 cycles	690037 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-65 sign	1228659 cycles	1182635 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	305723 cycles	303886 cycles	1.01
ML-DSA-44 sign	1140336 cycles	1114589 cycles	1.02
ML-DSA-44 verify	338610 cycles	328189 cycles	1.03
ML-DSA-65 keypair	562258 cycles	563300 cycles	1.00
ML-DSA-65 sign	1904021 cycles	1878380 cycles	1.01
ML-DSA-65 verify	549440 cycles	551688 cycles	1.00
ML-DSA-87 keypair	868879 cycles	841184 cycles	1.03
ML-DSA-87 sign	2448930 cycles	2336165 cycles	1.05
ML-DSA-87 verify	906389 cycles	887974 cycles	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 verify	338610 cycles	328189 cycles	1.03
ML-DSA-87 keypair	868879 cycles	841184 cycles	1.03
ML-DSA-87 sign	2448930 cycles	2336165 cycles	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	250517 cycles	243560 cycles	1.03
ML-DSA-44 sign	748169 cycles	734275 cycles	1.02
ML-DSA-44 verify	261689 cycles	258943 cycles	1.01
ML-DSA-65 keypair	465340 cycles	461844 cycles	1.01
ML-DSA-65 sign	1219653 cycles	1182635 cycles	1.03
ML-DSA-65 verify	419472 cycles	424234 cycles	0.99
ML-DSA-87 keypair	709521 cycles	704135 cycles	1.01
ML-DSA-87 sign	1624055 cycles	1570533 cycles	1.03
ML-DSA-87 verify	706359 cycles	690037 cycles	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-65 sign	1219653 cycles	1182635 cycles	1.03
ML-DSA-87 sign	1624055 cycles	1570533 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-65 sign	862139 cycles	834566 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton4 (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	132940 cycles	131458 cycles	1.01
ML-DSA-44 sign	463498 cycles	455872 cycles	1.02
ML-DSA-44 verify	151716 cycles	142948 cycles	1.06
ML-DSA-65 keypair	228872 cycles	224949 cycles	1.02
ML-DSA-65 sign	751968 cycles	733705 cycles	1.02
ML-DSA-65 verify	232097 cycles	226837 cycles	1.02
ML-DSA-87 keypair	376801 cycles	370255 cycles	1.02
ML-DSA-87 sign	967130 cycles	938604 cycles	1.03
ML-DSA-87 verify	385225 cycles	377332 cycles	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton4 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 verify	151716 cycles	142948 cycles	1.06
ML-DSA-87 sign	967130 cycles	938604 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	992285 cycles	936300 cycles	1.06
ML-DSA-44 sign	4557903 cycles	4331978 cycles	1.05
ML-DSA-44 verify	1126461 cycles	1071908 cycles	1.05
ML-DSA-65 keypair	1652177 cycles	1555382 cycles	1.06
ML-DSA-65 sign	7674828 cycles	7135767 cycles	1.08
ML-DSA-65 verify	1798275 cycles	1689729 cycles	1.06
ML-DSA-87 keypair	2736802 cycles	2523855 cycles	1.08
ML-DSA-87 sign	9563655 cycles	8729995 cycles	1.10
ML-DSA-87 verify	2916764 cycles	2708041 cycles	1.08

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	992285 cycles	936300 cycles	1.06
ML-DSA-44 sign	4557903 cycles	4331978 cycles	1.05
ML-DSA-44 verify	1126461 cycles	1071908 cycles	1.05
ML-DSA-65 keypair	1652177 cycles	1555382 cycles	1.06
ML-DSA-65 sign	7674828 cycles	7135767 cycles	1.08
ML-DSA-65 verify	1798275 cycles	1689729 cycles	1.06
ML-DSA-87 keypair	2736802 cycles	2523855 cycles	1.08
ML-DSA-87 sign	9563655 cycles	8729995 cycles	1.10
ML-DSA-87 verify	2916764 cycles	2708041 cycles	1.08

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton3 (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	138795 cycles	136141 cycles	1.02
ML-DSA-44 sign	461815 cycles	450824 cycles	1.02
ML-DSA-44 verify	149914 cycles	147151 cycles	1.02
ML-DSA-65 keypair	244729 cycles	239369 cycles	1.02
ML-DSA-65 sign	758710 cycles	732552 cycles	1.04
ML-DSA-65 verify	242637 cycles	237430 cycles	1.02
ML-DSA-87 keypair	399973 cycles	390139 cycles	1.03
ML-DSA-87 sign	987420 cycles	947297 cycles	1.04
ML-DSA-87 verify	407000 cycles	396872 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton3 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-65 sign	758710 cycles	732552 cycles	1.04
ML-DSA-87 sign	987420 cycles	947297 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

Graviton2 (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	217127 cycles	210315 cycles	1.03
ML-DSA-44 sign	759901 cycles	722344 cycles	1.05
ML-DSA-44 verify	243503 cycles	238729 cycles	1.02
ML-DSA-65 keypair	387216 cycles	377901 cycles	1.02
ML-DSA-65 sign	1244585 cycles	1187457 cycles	1.05
ML-DSA-65 verify	381997 cycles	371394 cycles	1.03
ML-DSA-87 keypair	614729 cycles	595631 cycles	1.03
ML-DSA-87 sign	1586925 cycles	1516225 cycles	1.05
ML-DSA-87 verify	631985 cycles	613436 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[oqs-bot]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Graviton2 (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	217127 cycles	210315 cycles	1.03
ML-DSA-44 sign	759901 cycles	722344 cycles	1.05
ML-DSA-65 sign	1244585 cycles	1187457 cycles	1.05
ML-DSA-87 keypair	614729 cycles	595631 cycles	1.03
ML-DSA-87 sign	1586925 cycles	1516225 cycles	1.05
ML-DSA-87 verify	631985 cycles	613436 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	304592 cycles	303886 cycles	1.00
ML-DSA-44 sign	1131822 cycles	1114589 cycles	1.02
ML-DSA-44 verify	348188 cycles	328189 cycles	1.06
ML-DSA-65 keypair	583888 cycles	563300 cycles	1.04
ML-DSA-65 sign	1917707 cycles	1878380 cycles	1.02
ML-DSA-65 verify	558496 cycles	551688 cycles	1.01
ML-DSA-87 keypair	870928 cycles	841184 cycles	1.04
ML-DSA-87 sign	2411860 cycles	2336165 cycles	1.03
ML-DSA-87 verify	899783 cycles	887974 cycles	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 verify	348188 cycles	328189 cycles	1.06
ML-DSA-65 keypair	583888 cycles	563300 cycles	1.04
ML-DSA-87 keypair	870928 cycles	841184 cycles	1.04
ML-DSA-87 sign	2411860 cycles	2336165 cycles	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	467629 cycles	452280 cycles	1.03
ML-DSA-44 sign	2071481 cycles	2008168 cycles	1.03
ML-DSA-44 verify	541842 cycles	526074 cycles	1.03
ML-DSA-65 keypair	789584 cycles	761954 cycles	1.04
ML-DSA-65 sign	3478536 cycles	3326025 cycles	1.05
ML-DSA-65 verify	847383 cycles	819643 cycles	1.03
ML-DSA-87 keypair	1283267 cycles	1238511 cycles	1.04
ML-DSA-87 sign	4340740 cycles	4151009 cycles	1.05
ML-DSA-87 verify	1375498 cycles	1323960 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.

Benchmark suite	Current: 9c8e592	Previous: 5c94783	Ratio
ML-DSA-44 keypair	467629 cycles	452280 cycles	1.03
ML-DSA-44 sign	2071481 cycles	2008168 cycles	1.03
ML-DSA-65 keypair	789584 cycles	761954 cycles	1.04
ML-DSA-65 sign	3478536 cycles	3326025 cycles	1.05
ML-DSA-65 verify	847383 cycles	819643 cycles	1.03
ML-DSA-87 keypair	1283267 cycles	1238511 cycles	1.04
ML-DSA-87 sign	4340740 cycles	4151009 cycles	1.05
ML-DSA-87 verify	1375498 cycles	1323960 cycles	1.04

This comment was automatically generated by workflow using github-action-benchmark.