Skip to content

Migrating Additional tests in ConfigTest that Utilize Fake Env Vars #9860

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Oct 27, 2025
Merged

Migrating Additional tests in ConfigTest that Utilize Fake Env Vars #9860

merged 4 commits into from
Oct 27, 2025
+66 −58

Conversation

@mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Oct 24, 2025

What Does This Do

Followup to #9857 for tests that were not properly migrated.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd requested a review from a team as a code owner October 24, 2025 19:55
@mhlidd mhlidd requested review from AlexeyKuznetsov-DD and smola and removed request for a team and smola October 24, 2025 19:55
@github-actions
Copy link
Contributor

github-actions bot commented Oct 24, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 24, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 47.34% (-12.35%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 59a0d7c | Docs | Was this helpful? Give us feedback!

@mhlidd mhlidd added type: bug Bug report and fix comp: testing Testing tag: no release notes Changes to exclude from release notes labels Oct 24, 2025
@pr-commenter
Copy link

pr-commenter bot commented Oct 24, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/migrate_more_config_tests
git_commit_date 1761572904 1761573362
git_commit_sha fb9d0a1 59a0d7c
release_version 1.55.0-SNAPSHOT~fb9d0a1c57 1.55.0-SNAPSHOT~59a0d7cc93
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761575208 1761575208
ci_job_id 1199516593 1199516593
ci_pipeline_id 80372289 80372289
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ihb34fxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ihb34fxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1036526
Total [baseline] (8.68 s) : 0, 8680060
Agent [candidate] (1.032 s) : 0, 1032438
Total [candidate] (8.71 s) : 0, 8710196
section iast
Agent [baseline] (1.171 s) : 0, 1171145
Total [baseline] (9.398 s) : 0, 9397867
Agent [candidate] (1.162 s) : 0, 1162054
Total [candidate] (9.311 s) : 0, 9311093
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.171 s 134.619 ms (13.0%)
Total tracing 8.68 s -
Total iast 9.398 s 717.807 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent iast 1.162 s 129.616 ms (12.6%)
Total tracing 8.71 s -
Total iast 9.311 s 600.897 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (706.794 ms) : 0, 706794
BytebuddyAgent [candidate] (705.049 ms) : 0, 705049
GlobalTracer [baseline] (246.383 ms) : 0, 246383
GlobalTracer [candidate] (244.671 ms) : 0, 244671
AppSec [baseline] (32.893 ms) : 0, 32893
AppSec [candidate] (32.174 ms) : 0, 32174
Debugger [baseline] (6.519 ms) : 0, 6519
Debugger [candidate] (6.312 ms) : 0, 6312
Remote Config [baseline] (696.56 µs) : 0, 697
Remote Config [candidate] (680.292 µs) : 0, 680
Telemetry [baseline] (14.605 ms) : 0, 14605
Telemetry [candidate] (13.652 ms) : 0, 13652
Flare Poller [baseline] (5.801 ms) : 0, 5801
Flare Poller [candidate] (7.18 ms) : 0, 7180
section iast
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (830.991 ms) : 0, 830991
BytebuddyAgent [candidate] (824.831 ms) : 0, 824831
GlobalTracer [baseline] (235.48 ms) : 0, 235480
GlobalTracer [candidate] (234.031 ms) : 0, 234031
AppSec [baseline] (30.794 ms) : 0, 30794
AppSec [candidate] (29.718 ms) : 0, 29718
Debugger [baseline] (6.16 ms) : 0, 6160
Debugger [candidate] (6.111 ms) : 0, 6111
Remote Config [baseline] (608.737 µs) : 0, 609
Remote Config [candidate] (612.373 µs) : 0, 612
Telemetry [baseline] (8.567 ms) : 0, 8567
Telemetry [candidate] (8.43 ms) : 0, 8430
Flare Poller [baseline] (4.226 ms) : 0, 4226
Flare Poller [candidate] (4.151 ms) : 0, 4151
IAST [baseline] (31.352 ms) : 0, 31352
IAST [candidate] (31.456 ms) : 0, 31456
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1028307
Total [baseline] (10.832 s) : 0, 10831912
Agent [candidate] (1.03 s) : 0, 1030006
Total [candidate] (10.828 s) : 0, 10827610
section appsec
Agent [baseline] (1.209 s) : 0, 1209343
Total [baseline] (10.946 s) : 0, 10945873
Agent [candidate] (1.211 s) : 0, 1210989
Total [candidate] (10.953 s) : 0, 10952722
section iast
Agent [baseline] (1.171 s) : 0, 1170945
Total [baseline] (11.202 s) : 0, 11202398
Agent [candidate] (1.164 s) : 0, 1163585
Total [candidate] (11.157 s) : 0, 11156663
section profiling
Agent [baseline] (1.172 s) : 0, 1171536
Total [baseline] (10.816 s) : 0, 10815993
Agent [candidate] (1.174 s) : 0, 1173666
Total [candidate] (10.881 s) : 0, 10880754
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.028 s -
Agent appsec 1.209 s 181.036 ms (17.6%)
Agent iast 1.171 s 142.638 ms (13.9%)
Agent profiling 1.172 s 143.229 ms (13.9%)
Total tracing 10.832 s -
Total appsec 10.946 s 113.96 ms (1.1%)
Total iast 11.202 s 370.485 ms (3.4%)
Total profiling 10.816 s -15.919 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent appsec 1.211 s 180.983 ms (17.6%)
Agent iast 1.164 s 133.579 ms (13.0%)
Agent profiling 1.174 s 143.66 ms (13.9%)
Total tracing 10.828 s -
Total appsec 10.953 s 125.112 ms (1.2%)
Total iast 11.157 s 329.053 ms (3.0%)
Total profiling 10.881 s 53.143 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (701.061 ms) : 0, 701061
BytebuddyAgent [candidate] (702.445 ms) : 0, 702445
GlobalTracer [baseline] (244.613 ms) : 0, 244613
GlobalTracer [candidate] (244.806 ms) : 0, 244806
AppSec [baseline] (32.115 ms) : 0, 32115
AppSec [candidate] (32.117 ms) : 0, 32117
Debugger [baseline] (6.377 ms) : 0, 6377
Debugger [candidate] (6.341 ms) : 0, 6341
Remote Config [baseline] (699.101 µs) : 0, 699
Remote Config [candidate] (687.713 µs) : 0, 688
Telemetry [baseline] (15.886 ms) : 0, 15886
Telemetry [candidate] (14.36 ms) : 0, 14360
Flare Poller [baseline] (4.948 ms) : 0, 4948
Flare Poller [candidate] (6.533 ms) : 0, 6533
section appsec
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (729.701 ms) : 0, 729701
BytebuddyAgent [candidate] (731.722 ms) : 0, 731722
GlobalTracer [baseline] (237.135 ms) : 0, 237135
GlobalTracer [candidate] (237.643 ms) : 0, 237643
AppSec [baseline] (175.465 ms) : 0, 175465
AppSec [candidate] (174.636 ms) : 0, 174636
Debugger [baseline] (6.006 ms) : 0, 6006
Debugger [candidate] (5.928 ms) : 0, 5928
Remote Config [baseline] (631.985 µs) : 0, 632
Remote Config [candidate] (633.172 µs) : 0, 633
Telemetry [baseline] (8.546 ms) : 0, 8546
Telemetry [candidate] (8.528 ms) : 0, 8528
Flare Poller [baseline] (3.916 ms) : 0, 3916
Flare Poller [candidate] (3.922 ms) : 0, 3922
IAST [baseline] (25.235 ms) : 0, 25235
IAST [candidate] (25.201 ms) : 0, 25201
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (831.776 ms) : 0, 831776
BytebuddyAgent [candidate] (825.72 ms) : 0, 825720
GlobalTracer [baseline] (235.441 ms) : 0, 235441
GlobalTracer [candidate] (234.125 ms) : 0, 234125
AppSec [baseline] (30.598 ms) : 0, 30598
AppSec [candidate] (30.614 ms) : 0, 30614
Debugger [baseline] (6.109 ms) : 0, 6109
Debugger [candidate] (6.147 ms) : 0, 6147
Remote Config [baseline] (601.672 µs) : 0, 602
Remote Config [candidate] (664.46 µs) : 0, 664
Telemetry [baseline] (8.439 ms) : 0, 8439
Telemetry [candidate] (8.48 ms) : 0, 8480
Flare Poller [baseline] (4.102 ms) : 0, 4102
Flare Poller [candidate] (4.135 ms) : 0, 4135
IAST [baseline] (30.866 ms) : 0, 30866
IAST [candidate] (30.829 ms) : 0, 30829
section profiling
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (724.891 ms) : 0, 724891
BytebuddyAgent [candidate] (726.431 ms) : 0, 726431
GlobalTracer [baseline] (220.115 ms) : 0, 220115
GlobalTracer [candidate] (220.353 ms) : 0, 220353
AppSec [baseline] (32.378 ms) : 0, 32378
AppSec [candidate] (32.188 ms) : 0, 32188
Debugger [baseline] (12.489 ms) : 0, 12489
Debugger [candidate] (10.72 ms) : 0, 10720
Remote Config [baseline] (1.496 ms) : 0, 1496
Remote Config [candidate] (2.229 ms) : 0, 2229
Telemetry [baseline] (9.826 ms) : 0, 9826
Telemetry [candidate] (10.693 ms) : 0, 10693
Flare Poller [baseline] (4.076 ms) : 0, 4076
Flare Poller [candidate] (4.123 ms) : 0, 4123
ProfilingAgent [baseline] (109.514 ms) : 0, 109514
ProfilingAgent [candidate] (110.047 ms) : 0, 110047
Profiling [baseline] (110.151 ms) : 0, 110151
Profiling [candidate] (110.723 ms) : 0, 110723
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/migrate_more_config_tests
git_commit_date 1761572904 1761573362
git_commit_sha fb9d0a1 59a0d7c
release_version 1.55.0-SNAPSHOT~fb9d0a1c57 1.55.0-SNAPSHOT~59a0d7cc93
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761574780 1761574780
ci_job_id 1199516594 1199516594
ci_pipeline_id 80372289 80372289
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qyu0e3rv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qyu0e3rv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+669.561µs; +1084.205µs] or [+6.554%; +10.612%]		 unstable
[-106.040op/s; +9.205op/s] or [-23.317%; +2.024%]		 11.094ms 406.364op/s 10.217ms 454.781op/s
scenario:load:insecure-bank:profiling:high_load worse
[+700.544µs; +1035.787µs] or [+7.878%; +11.649%]		 unstable
[-112.146op/s; +20.271op/s] or [-21.499%; +3.886%]		 9.760ms 475.688op/s 8.892ms 521.625op/s
scenario:load:insecure-bank:iast:high_load worse
[+222.726µs; +581.657µs] or [+2.281%; +5.956%]		 unstable
[-93.444op/s; +28.625op/s] or [-19.652%; +6.020%]		 10.169ms 443.091op/s 9.766ms 475.500op/s
scenario:load:petclinic:iast:high_load worse
[+1.726ms; +2.563ms] or [+3.961%; +5.885%]		 unstable
[-12.638op/s; +2.488op/s] or [-11.764%; +2.316%]		 45.703ms 102.350op/s 43.558ms 107.425op/s
scenario:load:petclinic:tracing:high_load better
[-2.747ms; -1.913ms] or [-5.946%; -4.142%]		 unstable
[-2.259op/s; +13.009op/s] or [-2.231%; +12.844%]		 43.862ms 106.662op/s 46.192ms 101.287op/s
scenario:load:petclinic:profiling:high_load better
[-2.432ms; -1.444ms] or [-4.903%; -2.912%]		 unstable
[-3.307op/s; +10.932op/s] or [-3.505%; +11.585%]		 47.671ms 98.175op/s 49.609ms 94.362op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.832 ms) : 37522, 38141
.   : milestone, 37832,
appsec (48.028 ms) : 47609, 48447
.   : milestone, 48028,
code_origins (43.565 ms) : 43178, 43952
.   : milestone, 43565,
iast (43.558 ms) : 43175, 43942
.   : milestone, 43558,
profiling (49.609 ms) : 49169, 50049
.   : milestone, 49609,
tracing (46.192 ms) : 45795, 46590
.   : milestone, 46192,
section candidate
no_agent (37.707 ms) : 37406, 38008
.   : milestone, 37707,
appsec (47.626 ms) : 47201, 48052
.   : milestone, 47626,
code_origins (43.62 ms) : 43247, 43992
.   : milestone, 43620,
iast (45.703 ms) : 45308, 46098
.   : milestone, 45703,
profiling (47.671 ms) : 47193, 48148
.   : milestone, 47671,
tracing (43.862 ms) : 43486, 44239
.   : milestone, 43862,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.832 ms [37.522 ms, 38.141 ms] -
appsec 48.028 ms [47.609 ms, 48.447 ms] 10.196 ms (27.0%)
code_origins 43.565 ms [43.178 ms, 43.952 ms] 5.733 ms (15.2%)
iast 43.558 ms [43.175 ms, 43.942 ms] 5.727 ms (15.1%)
profiling 49.609 ms [49.169 ms, 50.049 ms] 11.777 ms (31.1%)
tracing 46.192 ms [45.795 ms, 46.59 ms] 8.361 ms (22.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.707 ms [37.406 ms, 38.008 ms] -
appsec 47.626 ms [47.201 ms, 48.052 ms] 9.919 ms (26.3%)
code_origins 43.62 ms [43.247 ms, 43.992 ms] 5.913 ms (15.7%)
iast 45.703 ms [45.308 ms, 46.098 ms] 7.996 ms (21.2%)
profiling 47.671 ms [47.193 ms, 48.148 ms] 9.964 ms (26.4%)
tracing 43.862 ms [43.486 ms, 44.239 ms] 6.155 ms (16.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.431 ms) : 4380, 4482
.   : milestone, 4431,
iast (9.766 ms) : 9605, 9928
.   : milestone, 9766,
iast_FULL (14.268 ms) : 13981, 14555
.   : milestone, 14268,
iast_GLOBAL (10.217 ms) : 10032, 10401
.   : milestone, 10217,
profiling (8.892 ms) : 8743, 9041
.   : milestone, 8892,
tracing (8.026 ms) : 7892, 8161
.   : milestone, 8026,
section candidate
no_agent (4.391 ms) : 4342, 4440
.   : milestone, 4391,
iast (10.169 ms) : 9997, 10340
.   : milestone, 10169,
iast_FULL (14.222 ms) : 13940, 14503
.   : milestone, 14222,
iast_GLOBAL (11.094 ms) : 10893, 11294
.   : milestone, 11094,
profiling (9.76 ms) : 9598, 9923
.   : milestone, 9760,
tracing (7.881 ms) : 7768, 7993
.   : milestone, 7881,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.431 ms [4.38 ms, 4.482 ms] -
iast 9.766 ms [9.605 ms, 9.928 ms] 5.336 ms (120.4%)
iast_FULL 14.268 ms [13.981 ms, 14.555 ms] 9.837 ms (222.0%)
iast_GLOBAL 10.217 ms [10.032 ms, 10.401 ms] 5.786 ms (130.6%)
profiling 8.892 ms [8.743 ms, 9.041 ms] 4.461 ms (100.7%)
tracing 8.026 ms [7.892 ms, 8.161 ms] 3.595 ms (81.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.391 ms [4.342 ms, 4.44 ms] -
iast 10.169 ms [9.997 ms, 10.34 ms] 5.778 ms (131.6%)
iast_FULL 14.222 ms [13.94 ms, 14.503 ms] 9.831 ms (223.9%)
iast_GLOBAL 11.094 ms [10.893 ms, 11.294 ms] 6.703 ms (152.6%)
profiling 9.76 ms [9.598 ms, 9.923 ms] 5.369 ms (122.3%)
tracing 7.881 ms [7.768 ms, 7.993 ms] 3.49 ms (79.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/migrate_more_config_tests
git_commit_date 1761572904 1761573362
git_commit_sha fb9d0a1 59a0d7c
release_version 1.55.0-SNAPSHOT~fb9d0a1c57 1.55.0-SNAPSHOT~59a0d7cc93
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1761575366 1761575366
ci_job_id 1199516595 1199516595
ci_pipeline_id 80372289 80372289
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-j9me375e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-j9me375e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.681 ms) : 3463, 3898
.   : milestone, 3681,
iast (2.206 ms) : 2143, 2269
.   : milestone, 2206,
iast_GLOBAL (2.239 ms) : 2175, 2303
.   : milestone, 2239,
profiling (2.071 ms) : 2019, 2124
.   : milestone, 2071,
tracing (2.022 ms) : 1973, 2072
.   : milestone, 2022,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.639 ms) : 3427, 3851
.   : milestone, 3639,
iast (2.202 ms) : 2139, 2265
.   : milestone, 2202,
iast_GLOBAL (2.245 ms) : 2181, 2309
.   : milestone, 2245,
profiling (2.461 ms) : 2305, 2617
.   : milestone, 2461,
tracing (2.013 ms) : 1964, 2062
.   : milestone, 2013,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.681 ms [3.463 ms, 3.898 ms] 2.208 ms (149.9%)
iast 2.206 ms [2.143 ms, 2.269 ms] 733.099 µs (49.8%)
iast_GLOBAL 2.239 ms [2.175 ms, 2.303 ms] 766.069 µs (52.0%)
profiling 2.071 ms [2.019 ms, 2.124 ms] 598.363 µs (40.6%)
tracing 2.022 ms [1.973 ms, 2.072 ms] 549.387 µs (37.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.639 ms [3.427 ms, 3.851 ms] 2.167 ms (147.2%)
iast 2.202 ms [2.139 ms, 2.265 ms] 730.36 µs (49.6%)
iast_GLOBAL 2.245 ms [2.181 ms, 2.309 ms] 773.4 µs (52.5%)
profiling 2.461 ms [2.305 ms, 2.617 ms] 989.101 µs (67.2%)
tracing 2.013 ms [1.964 ms, 2.062 ms] 541.1 µs (36.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~59a0d7cc93, baseline=1.55.0-SNAPSHOT~fb9d0a1c57
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,
appsec (14.838 s) : 14838000, 14838000
.   : milestone, 14838000,
iast (18.791 s) : 18791000, 18791000
.   : milestone, 18791000,
iast_GLOBAL (18.248 s) : 18248000, 18248000
.   : milestone, 18248000,
profiling (16.03 s) : 16030000, 16030000
.   : milestone, 16030000,
tracing (15.307 s) : 15307000, 15307000
.   : milestone, 15307000,
section candidate
no_agent (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
appsec (14.635 s) : 14635000, 14635000
.   : milestone, 14635000,
iast (18.632 s) : 18632000, 18632000
.   : milestone, 18632000,
iast_GLOBAL (18.152 s) : 18152000, 18152000
.   : milestone, 18152000,
profiling (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
tracing (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.985 s [14.985 s, 14.985 s] -
appsec 14.838 s [14.838 s, 14.838 s] -147.0 ms (-1.0%)
iast 18.791 s [18.791 s, 18.791 s] 3.806 s (25.4%)
iast_GLOBAL 18.248 s [18.248 s, 18.248 s] 3.263 s (21.8%)
profiling 16.03 s [16.03 s, 16.03 s] 1.045 s (7.0%)
tracing 15.307 s [15.307 s, 15.307 s] 322.0 ms (2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.975 s [14.975 s, 14.975 s] -
appsec 14.635 s [14.635 s, 14.635 s] -340.0 ms (-2.3%)
iast 18.632 s [18.632 s, 18.632 s] 3.657 s (24.4%)
iast_GLOBAL 18.152 s [18.152 s, 18.152 s] 3.177 s (21.2%)
profiling 15.165 s [15.165 s, 15.165 s] 190.0 ms (1.3%)
tracing 15.259 s [15.259 s, 15.259 s] 284.0 ms (1.9%)

@PerfectSlayer
Copy link
Contributor

It feels that we might benefit from a comp: config label now. WDTY?

@mhlidd mhlidd merged commit 45b8e15 into master Oct 27, 2025
538 of 539 checks passed
@mhlidd mhlidd deleted the mhlidd/migrate_more_config_tests branch October 27, 2025 14:33
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

comp: config comp: testing Testing tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

4 participants

@mhlidd @PerfectSlayer @AlexeyKuznetsov-DD