Skip to content

Conversation

AlexeyKuznetsov-DD
Copy link
Contributor

What Does This Do

DO NOT MERGE

# Conflicts:
#	dd-java-agent/instrumentation/java-concurrent/java-concurrent-21/src/previewTest/groovy/StructuredConcurrencyTest.groovy
#	dd-java-agent/instrumentation/lettuce-4/src/test/groovy/Lettuce4ClientTestBase.groovy
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Aug 22, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: testing Testing labels Aug 22, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Aug 22, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 57.59% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: d920e92 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Aug 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze-gradle
git_commit_date 1756307636 1756327576
git_commit_sha 02a3250 d920e92
release_version 1.53.0-SNAPSHOT~02a3250561 1.53.0-SNAPSHOT~d920e9225f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756329315 1756329315
ci_job_id 1102399251 1102399251
ci_pipeline_id 74911785 74911785
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-43vdgdyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-43vdgdyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 14 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051025
Total [baseline] (10.827 s) : 0, 10827173
Agent [candidate] (1.044 s) : 0, 1044029
Total [candidate] (10.657 s) : 0, 10657360
section appsec
Agent [baseline] (1.225 s) : 0, 1224743
Total [baseline] (10.757 s) : 0, 10756625
Agent [candidate] (1.222 s) : 0, 1221824
Total [candidate] (10.833 s) : 0, 10833447
section iast
Agent [baseline] (1.183 s) : 0, 1182638
Total [baseline] (10.926 s) : 0, 10925684
Agent [candidate] (1.188 s) : 0, 1188161
Total [candidate] (11.05 s) : 0, 11049702
section profiling
Agent [baseline] (1.195 s) : 0, 1194529
Total [baseline] (10.872 s) : 0, 10872277
Agent [candidate] (1.198 s) : 0, 1198133
Total [candidate] (10.958 s) : 0, 10958308
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.225 s 173.718 ms (16.5%)
Agent iast 1.183 s 131.613 ms (12.5%)
Agent profiling 1.195 s 143.504 ms (13.7%)
Total tracing 10.827 s -
Total appsec 10.757 s -70.548 ms (-0.7%)
Total iast 10.926 s 98.511 ms (0.9%)
Total profiling 10.872 s 45.104 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.222 s 177.795 ms (17.0%)
Agent iast 1.188 s 144.132 ms (13.8%)
Agent profiling 1.198 s 154.104 ms (14.8%)
Total tracing 10.657 s -
Total appsec 10.833 s 176.087 ms (1.7%)
Total iast 11.05 s 392.342 ms (3.7%)
Total profiling 10.958 s 300.948 ms (2.8%)
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (733.273 ms) : 0, 733273
BytebuddyAgent [candidate] (730.496 ms) : 0, 730496
GlobalTracer [baseline] (243.203 ms) : 0, 243203
GlobalTracer [candidate] (242.221 ms) : 0, 242221
AppSec [baseline] (30.23 ms) : 0, 30230
AppSec [candidate] (30.112 ms) : 0, 30112
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.027 ms) : 0, 6027
Remote Config [baseline] (666.896 µs) : 0, 667
Remote Config [candidate] (665.529 µs) : 0, 666
Telemetry [baseline] (15.05 ms) : 0, 15050
Telemetry [candidate] (12.087 ms) : 0, 12087
section appsec
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (756.158 ms) : 0, 756158
BytebuddyAgent [candidate] (754.314 ms) : 0, 754314
GlobalTracer [baseline] (235.741 ms) : 0, 235741
GlobalTracer [candidate] (234.624 ms) : 0, 234624
IAST [baseline] (23.358 ms) : 0, 23358
IAST [candidate] (23.597 ms) : 0, 23597
AppSec [baseline] (169.651 ms) : 0, 169651
AppSec [candidate] (169.618 ms) : 0, 169618
Debugger [baseline] (5.819 ms) : 0, 5819
Debugger [candidate] (6.547 ms) : 0, 6547
Remote Config [baseline] (633.551 µs) : 0, 634
Remote Config [candidate] (647.7 µs) : 0, 648
Telemetry [baseline] (10.785 ms) : 0, 10785
Telemetry [candidate] (9.966 ms) : 0, 9966
section iast
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (853.424 ms) : 0, 853424
BytebuddyAgent [candidate] (857.667 ms) : 0, 857667
GlobalTracer [baseline] (233.653 ms) : 0, 233653
GlobalTracer [candidate] (234.256 ms) : 0, 234256
IAST [baseline] (29.74 ms) : 0, 29740
IAST [candidate] (29.077 ms) : 0, 29077
AppSec [baseline] (27.657 ms) : 0, 27657
AppSec [candidate] (29.619 ms) : 0, 29619
Debugger [baseline] (6.635 ms) : 0, 6635
Debugger [candidate] (5.808 ms) : 0, 5808
Remote Config [baseline] (619.41 µs) : 0, 619
Remote Config [candidate] (622.155 µs) : 0, 622
Telemetry [baseline] (8.354 ms) : 0, 8354
Telemetry [candidate] (8.44 ms) : 0, 8440
section profiling
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (760.493 ms) : 0, 760493
BytebuddyAgent [candidate] (763.699 ms) : 0, 763699
GlobalTracer [baseline] (221.889 ms) : 0, 221889
GlobalTracer [candidate] (222.345 ms) : 0, 222345
AppSec [baseline] (30.654 ms) : 0, 30654
AppSec [candidate] (30.056 ms) : 0, 30056
Debugger [baseline] (6.316 ms) : 0, 6316
Debugger [candidate] (6.285 ms) : 0, 6285
Remote Config [baseline] (689.473 µs) : 0, 689
Remote Config [candidate] (709.622 µs) : 0, 710
Telemetry [baseline] (15.702 ms) : 0, 15702
Telemetry [candidate] (16.28 ms) : 0, 16280
ProfilingAgent [baseline] (107.763 ms) : 0, 107763
ProfilingAgent [candidate] (107.597 ms) : 0, 107597
Profiling [baseline] (108.406 ms) : 0, 108406
Profiling [candidate] (108.263 ms) : 0, 108263
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048511
Total [baseline] (8.626 s) : 0, 8625875
Agent [candidate] (1.045 s) : 0, 1044841
Total [candidate] (8.606 s) : 0, 8606071
section iast
Agent [baseline] (1.18 s) : 0, 1179796
Total [baseline] (9.347 s) : 0, 9347170
Agent [candidate] (1.18 s) : 0, 1180463
Total [candidate] (9.36 s) : 0, 9360152
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.18 s 131.285 ms (12.5%)
Total tracing 8.626 s -
Total iast 9.347 s 721.295 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.18 s 135.622 ms (13.0%)
Total tracing 8.606 s -
Total iast 9.36 s 754.082 ms (8.8%)
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (734.369 ms) : 0, 734369
BytebuddyAgent [candidate] (730.264 ms) : 0, 730264
GlobalTracer [baseline] (242.652 ms) : 0, 242652
GlobalTracer [candidate] (242.455 ms) : 0, 242455
AppSec [baseline] (30.078 ms) : 0, 30078
AppSec [candidate] (30.025 ms) : 0, 30025
Debugger [baseline] (6.045 ms) : 0, 6045
Debugger [candidate] (6.051 ms) : 0, 6051
Remote Config [baseline] (678.127 µs) : 0, 678
Remote Config [candidate] (662.247 µs) : 0, 662
Telemetry [baseline] (12.241 ms) : 0, 12241
Telemetry [candidate] (13.054 ms) : 0, 13054
section iast
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (851.478 ms) : 0, 851478
BytebuddyAgent [candidate] (851.928 ms) : 0, 851928
GlobalTracer [baseline] (233.133 ms) : 0, 233133
GlobalTracer [candidate] (233.092 ms) : 0, 233092
AppSec [baseline] (27.717 ms) : 0, 27717
AppSec [candidate] (27.609 ms) : 0, 27609
Debugger [baseline] (7.448 ms) : 0, 7448
Debugger [candidate] (6.722 ms) : 0, 6722
Remote Config [baseline] (611.809 µs) : 0, 612
Remote Config [candidate] (594.334 µs) : 0, 594
Telemetry [baseline] (8.32 ms) : 0, 8320
Telemetry [candidate] (8.293 ms) : 0, 8293
IAST [baseline] (28.608 ms) : 0, 28608
IAST [candidate] (29.722 ms) : 0, 29722
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze-gradle
git_commit_date 1756307636 1756327576
git_commit_sha 02a3250 d920e92
release_version 1.53.0-SNAPSHOT~02a3250561 1.53.0-SNAPSHOT~d920e9225f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756328986 1756328986
ci_job_id 1102399252 1102399252
ci_pipeline_id 74911785 74911785
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ph6sb3bx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ph6sb3bx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load worse
[+250.669µs; +360.623µs] or [+5.944%; +8.551%]
unstable
[-189.018op/s; +44.643op/s] or [-17.381%; +4.105%]
4.523ms 1015.312op/s 4.217ms 1087.500op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+561.715µs; +1157.047µs] or [+4.166%; +8.581%]
unstable
[-58.107op/s; +17.045op/s] or [-16.824%; +4.935%]
14.343ms 324.844op/s 13.483ms 345.375op/s
scenario:load:insecure-bank:profiling:high_load worse
[+252.362µs; +563.403µs] or [+2.927%; +6.535%]
unstable
[-93.200op/s; +45.387op/s] or [-17.328%; +8.439%]
9.029ms 513.938op/s 8.621ms 537.844op/s
scenario:load:petclinic:no_agent:high_load worse
[+2.516ms; +3.164ms] or [+6.994%; +8.794%]
unstable
[-18.216op/s; -0.659op/s] or [-14.022%; -0.507%]
38.819ms 120.475op/s 35.978ms 129.912op/s
scenario:load:petclinic:iast:high_load better
[-2.972ms; -2.165ms] or [-6.523%; -4.751%]
unstable
[-1.442op/s; +13.592op/s] or [-1.404%; +13.234%]
42.992ms 108.775op/s 45.560ms 102.700op/s
scenario:load:petclinic:profiling:high_load better
[-2.338ms; -1.349ms] or [-4.798%; -2.768%]
unstable
[-3.522op/s; +11.047op/s] or [-3.668%; +11.504%]
46.888ms 99.787op/s 48.731ms 96.025op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.978 ms) : 35691, 36266
.   : milestone, 35978,
appsec (48.571 ms) : 48157, 48985
.   : milestone, 48571,
code_origins (45.124 ms) : 44743, 45506
.   : milestone, 45124,
iast (45.56 ms) : 45170, 45950
.   : milestone, 45560,
profiling (48.731 ms) : 48275, 49188
.   : milestone, 48731,
tracing (43.628 ms) : 43256, 43999
.   : milestone, 43628,
section candidate
no_agent (38.819 ms) : 38505, 39132
.   : milestone, 38819,
appsec (47.6 ms) : 47174, 48025
.   : milestone, 47600,
code_origins (44.121 ms) : 43746, 44495
.   : milestone, 44121,
iast (42.992 ms) : 42632, 43352
.   : milestone, 42992,
profiling (46.888 ms) : 46425, 47351
.   : milestone, 46888,
tracing (44.141 ms) : 43759, 44523
.   : milestone, 44141,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.978 ms [35.691 ms, 36.266 ms] -
appsec 48.571 ms [48.157 ms, 48.985 ms] 12.593 ms (35.0%)
code_origins 45.124 ms [44.743 ms, 45.506 ms] 9.146 ms (25.4%)
iast 45.56 ms [45.17 ms, 45.95 ms] 9.582 ms (26.6%)
profiling 48.731 ms [48.275 ms, 49.188 ms] 12.753 ms (35.4%)
tracing 43.628 ms [43.256 ms, 43.999 ms] 7.649 ms (21.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.819 ms [38.505 ms, 39.132 ms] -
appsec 47.6 ms [47.174 ms, 48.025 ms] 8.781 ms (22.6%)
code_origins 44.121 ms [43.746 ms, 44.495 ms] 5.302 ms (13.7%)
iast 42.992 ms [42.632 ms, 43.352 ms] 4.173 ms (10.8%)
profiling 46.888 ms [46.425 ms, 47.351 ms] 8.069 ms (20.8%)
tracing 44.141 ms [43.759 ms, 44.523 ms] 5.322 ms (13.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.217 ms) : 4168, 4267
.   : milestone, 4217,
iast (9.235 ms) : 9084, 9386
.   : milestone, 9235,
iast_FULL (13.483 ms) : 13218, 13749
.   : milestone, 13483,
iast_GLOBAL (10.605 ms) : 10417, 10794
.   : milestone, 10605,
profiling (8.621 ms) : 8478, 8765
.   : milestone, 8621,
tracing (7.663 ms) : 7552, 7773
.   : milestone, 7663,
section candidate
no_agent (4.523 ms) : 4470, 4575
.   : milestone, 4523,
iast (9.394 ms) : 9239, 9548
.   : milestone, 9394,
iast_FULL (14.343 ms) : 14055, 14630
.   : milestone, 14343,
iast_GLOBAL (10.434 ms) : 10242, 10627
.   : milestone, 10434,
profiling (9.029 ms) : 8884, 9175
.   : milestone, 9029,
tracing (7.407 ms) : 7303, 7511
.   : milestone, 7407,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.217 ms [4.168 ms, 4.267 ms] -
iast 9.235 ms [9.084 ms, 9.386 ms] 5.018 ms (119.0%)
iast_FULL 13.483 ms [13.218 ms, 13.749 ms] 9.266 ms (219.7%)
iast_GLOBAL 10.605 ms [10.417 ms, 10.794 ms] 6.388 ms (151.5%)
profiling 8.621 ms [8.478 ms, 8.765 ms] 4.404 ms (104.4%)
tracing 7.663 ms [7.552 ms, 7.773 ms] 3.446 ms (81.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.523 ms [4.47 ms, 4.575 ms] -
iast 9.394 ms [9.239 ms, 9.548 ms] 4.871 ms (107.7%)
iast_FULL 14.343 ms [14.055 ms, 14.63 ms] 9.82 ms (217.1%)
iast_GLOBAL 10.434 ms [10.242 ms, 10.627 ms] 5.911 ms (130.7%)
profiling 9.029 ms [8.884 ms, 9.175 ms] 4.507 ms (99.6%)
tracing 7.407 ms [7.303 ms, 7.511 ms] 2.884 ms (63.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-freeze-gradle
git_commit_date 1756307636 1756327576
git_commit_sha 02a3250 d920e92
release_version 1.53.0-SNAPSHOT~02a3250561 1.53.0-SNAPSHOT~d920e9225f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756329638 1756329638
ci_job_id 1102399253 1102399253
ci_pipeline_id 74911785 74911785
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-widpyorj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-widpyorj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.318ms; -0.984ms] or [-36.489%; -27.238%]
2.462ms 3.613ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (3.613 ms) : 3400, 3827
.   : milestone, 3613,
iast (2.198 ms) : 2135, 2261
.   : milestone, 2198,
iast_GLOBAL (2.239 ms) : 2176, 2302
.   : milestone, 2239,
profiling (2.063 ms) : 2011, 2115
.   : milestone, 2063,
tracing (2.014 ms) : 1965, 2063
.   : milestone, 2014,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.462 ms) : 2409, 2514
.   : milestone, 2462,
iast (2.217 ms) : 2153, 2281
.   : milestone, 2217,
iast_GLOBAL (2.248 ms) : 2185, 2312
.   : milestone, 2248,
profiling (2.044 ms) : 1993, 2094
.   : milestone, 2044,
tracing (2.023 ms) : 1974, 2072
.   : milestone, 2023,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 3.613 ms [3.4 ms, 3.827 ms] 2.128 ms (143.3%)
iast 2.198 ms [2.135 ms, 2.261 ms] 712.855 µs (48.0%)
iast_GLOBAL 2.239 ms [2.176 ms, 2.302 ms] 753.579 µs (50.7%)
profiling 2.063 ms [2.011 ms, 2.115 ms] 578.033 µs (38.9%)
tracing 2.014 ms [1.965 ms, 2.063 ms] 529.117 µs (35.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.462 ms [2.409 ms, 2.514 ms] 983.67 µs (66.5%)
iast 2.217 ms [2.153 ms, 2.281 ms] 739.023 µs (50.0%)
iast_GLOBAL 2.248 ms [2.185 ms, 2.312 ms] 770.148 µs (52.1%)
profiling 2.044 ms [1.993 ms, 2.094 ms] 565.571 µs (38.3%)
tracing 2.023 ms [1.974 ms, 2.072 ms] 544.866 µs (36.9%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d920e9225f, baseline=1.53.0-SNAPSHOT~02a3250561
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.488 s) : 15488000, 15488000
.   : milestone, 15488000,
appsec (14.792 s) : 14792000, 14792000
.   : milestone, 14792000,
iast (18.696 s) : 18696000, 18696000
.   : milestone, 18696000,
iast_GLOBAL (17.674 s) : 17674000, 17674000
.   : milestone, 17674000,
profiling (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
tracing (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
section candidate
no_agent (15.349 s) : 15349000, 15349000
.   : milestone, 15349000,
appsec (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
iast (18.413 s) : 18413000, 18413000
.   : milestone, 18413000,
iast_GLOBAL (18.242 s) : 18242000, 18242000
.   : milestone, 18242000,
profiling (15.296 s) : 15296000, 15296000
.   : milestone, 15296000,
tracing (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.488 s [15.488 s, 15.488 s] -
appsec 14.792 s [14.792 s, 14.792 s] -696.0 ms (-4.5%)
iast 18.696 s [18.696 s, 18.696 s] 3.208 s (20.7%)
iast_GLOBAL 17.674 s [17.674 s, 17.674 s] 2.186 s (14.1%)
profiling 15.05 s [15.05 s, 15.05 s] -438.0 ms (-2.8%)
tracing 14.92 s [14.92 s, 14.92 s] -568.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.349 s [15.349 s, 15.349 s] -
appsec 15.068 s [15.068 s, 15.068 s] -281.0 ms (-1.8%)
iast 18.413 s [18.413 s, 18.413 s] 3.064 s (20.0%)
iast_GLOBAL 18.242 s [18.242 s, 18.242 s] 2.893 s (18.8%)
profiling 15.296 s [15.296 s, 15.296 s] -53.0 ms (-0.3%)
tracing 14.84 s [14.84 s, 14.84 s] -509.0 ms (-3.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: testing Testing tag: do not merge Do not merge changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant