Skip to content

Comments

Add display name as parameter in JUnit5 dynamic tests#10649

Open
daniel-mohedano wants to merge 3 commits intomasterfrom
daniel.mohedano/junit-dynamic-tests
Open

Add display name as parameter in JUnit5 dynamic tests#10649
daniel-mohedano wants to merge 3 commits intomasterfrom
daniel.mohedano/junit-dynamic-tests

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Feb 20, 2026 •
edited
Loading

What Does This Do

  • For JUnit5 Dynamic Tests, the display name will be added as a parameter: {"metadata": {"test_name": displayName}}.
  • A new test.junit5.is_dynamic is introduced to differentiate between actual parameterized tests and dynamic tests.

Motivation

The changes allow dynamically generated tests to have independent fingerprints. Previously, they were reported with the method name (in this case the factory method) as test.name, which made it impossible for our backend to differentiate between all dynamic tests inside the same factory. The factory method is still kept as test name to avoid possible issues where different dynamic tests might have identical display names, which would cause collisions in features such as EFD or FTM.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Feb 20, 2026
@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 56.29
agentEvpProxy 56.22

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 91.95
agentless 85.63
agentlessCodeCoverage 99.44
agentlessLineCoverage 115.55

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 36.89
agentless 37.93
agentlessCodeCoverage 44.15
agentlessLineCoverage 74.39

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 21.70
agentless 18.50
agentlessCodeCoverage 20.21
agentlessLineCoverage 30.22

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 14.62
agentless 12.79
agentlessCodeCoverage 21.02

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 12.76
agentless 11.31
agentlessCodeCoverage 14.51
agentlessLineCoverage 23.75

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 94.67
agentless 89.98
agentlessCodeCoverage 96.81
agentlessLineCoverage 99.99

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 25.30
agentless 18.62
agentlessCodeCoverage 24.99
agentlessLineCoverage 39.40

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 17.34
agentless 9.72
agentlessCodeCoverage 14.15
agentlessLineCoverage 31.84

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 24.17
agentless -4.46
agentlessCodeCoverage 56.65
agentlessLineCoverage 92.48

@pr-commenter
Copy link

pr-commenter bot commented Feb 20, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771530866 1771603033
git_commit_sha af8b844 1e40a01
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~1e40a01be0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771604875 1771604875
ci_job_id 1443528095 1443528095
ci_pipeline_id 97891350 97891350
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qviyk2u7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qviyk2u7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065294
Total [baseline] (11.023 s) : 0, 11023359
Agent [candidate] (1.064 s) : 0, 1063583
Total [candidate] (10.808 s) : 0, 10808464
section appsec
Agent [baseline] (1.246 s) : 0, 1245938
Total [baseline] (11.184 s) : 0, 11184136
Agent [candidate] (1.24 s) : 0, 1240438
Total [candidate] (10.946 s) : 0, 10946186
section iast
Agent [baseline] (1.231 s) : 0, 1231073
Total [baseline] (11.124 s) : 0, 11123502
Agent [candidate] (1.233 s) : 0, 1232787
Total [candidate] (11.242 s) : 0, 11241652
section profiling
Agent [baseline] (1.193 s) : 0, 1193233
Total [baseline] (10.961 s) : 0, 10960738
Agent [candidate] (1.208 s) : 0, 1208334
Total [candidate] (10.997 s) : 0, 10997023
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.246 s 180.644 ms (17.0%)
Agent iast 1.231 s 165.78 ms (15.6%)
Agent profiling 1.193 s 127.939 ms (12.0%)
Total tracing 11.023 s -
Total appsec 11.184 s 160.777 ms (1.5%)
Total iast 11.124 s 100.143 ms (0.9%)
Total profiling 10.961 s -62.621 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.24 s 176.855 ms (16.6%)
Agent iast 1.233 s 169.204 ms (15.9%)
Agent profiling 1.208 s 144.751 ms (13.6%)
Total tracing 10.808 s -
Total appsec 10.946 s 137.722 ms (1.3%)
Total iast 11.242 s 433.188 ms (4.0%)
Total profiling 10.997 s 188.559 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (627.834 ms) : 0, 627834
BytebuddyAgent [candidate] (626.328 ms) : 0, 626328
AgentMeter [baseline] (29.073 ms) : 0, 29073
AgentMeter [candidate] (29.034 ms) : 0, 29034
GlobalTracer [baseline] (257.778 ms) : 0, 257778
GlobalTracer [candidate] (257.017 ms) : 0, 257017
AppSec [baseline] (32.885 ms) : 0, 32885
AppSec [candidate] (33.0 ms) : 0, 33000
Debugger [baseline] (63.781 ms) : 0, 63781
Debugger [candidate] (63.536 ms) : 0, 63536
Remote Config [baseline] (631.121 µs) : 0, 631
Remote Config [candidate] (632.723 µs) : 0, 633
Telemetry [baseline] (10.684 ms) : 0, 10684
Telemetry [candidate] (9.892 ms) : 0, 9892
Flare Poller [baseline] (5.327 ms) : 0, 5327
Flare Poller [candidate] (6.857 ms) : 0, 6857
section appsec
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (661.927 ms) : 0, 661927
BytebuddyAgent [candidate] (658.513 ms) : 0, 658513
AgentMeter [baseline] (12.045 ms) : 0, 12045
AgentMeter [candidate] (12.025 ms) : 0, 12025
GlobalTracer [baseline] (259.684 ms) : 0, 259684
GlobalTracer [candidate] (258.616 ms) : 0, 258616
AppSec [baseline] (169.684 ms) : 0, 169684
AppSec [candidate] (168.212 ms) : 0, 168212
Debugger [baseline] (65.536 ms) : 0, 65536
Debugger [candidate] (66.605 ms) : 0, 66605
Remote Config [baseline] (665.534 µs) : 0, 666
Remote Config [candidate] (646.339 µs) : 0, 646
Telemetry [baseline] (9.31 ms) : 0, 9310
Telemetry [candidate] (9.487 ms) : 0, 9487
Flare Poller [baseline] (3.692 ms) : 0, 3692
Flare Poller [candidate] (3.678 ms) : 0, 3678
IAST [baseline] (25.74 ms) : 0, 25740
IAST [candidate] (25.321 ms) : 0, 25321
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (795.577 ms) : 0, 795577
BytebuddyAgent [candidate] (795.979 ms) : 0, 795979
AgentMeter [baseline] (11.3 ms) : 0, 11300
AgentMeter [candidate] (11.318 ms) : 0, 11318
GlobalTracer [baseline] (246.868 ms) : 0, 246868
GlobalTracer [candidate] (247.872 ms) : 0, 247872
AppSec [baseline] (33.15 ms) : 0, 33150
AppSec [candidate] (34.98 ms) : 0, 34980
Debugger [baseline] (67.338 ms) : 0, 67338
Debugger [candidate] (65.672 ms) : 0, 65672
Remote Config [baseline] (542.422 µs) : 0, 542
Remote Config [candidate] (569.546 µs) : 0, 570
Telemetry [baseline] (8.619 ms) : 0, 8619
Telemetry [candidate] (8.742 ms) : 0, 8742
Flare Poller [baseline] (3.46 ms) : 0, 3460
Flare Poller [candidate] (3.469 ms) : 0, 3469
IAST [baseline] (26.905 ms) : 0, 26905
IAST [candidate] (26.879 ms) : 0, 26879
section profiling
ProfilingAgent [baseline] (99.93 ms) : 0, 99930
ProfilingAgent [candidate] (99.376 ms) : 0, 99376
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (682.793 ms) : 0, 682793
BytebuddyAgent [candidate] (692.242 ms) : 0, 692242
AgentMeter [baseline] (8.585 ms) : 0, 8585
AgentMeter [candidate] (8.758 ms) : 0, 8758
GlobalTracer [baseline] (216.346 ms) : 0, 216346
GlobalTracer [candidate] (219.741 ms) : 0, 219741
AppSec [baseline] (32.74 ms) : 0, 32740
AppSec [candidate] (33.614 ms) : 0, 33614
Debugger [baseline] (67.456 ms) : 0, 67456
Debugger [candidate] (68.456 ms) : 0, 68456
Remote Config [baseline] (631.839 µs) : 0, 632
Remote Config [candidate] (637.973 µs) : 0, 638
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (8.885 ms) : 0, 8885
Flare Poller [baseline] (3.79 ms) : 0, 3790
Flare Poller [candidate] (3.842 ms) : 0, 3842
Profiling [baseline] (100.508 ms) : 0, 100508
Profiling [candidate] (99.967 ms) : 0, 99967
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060648
Total [baseline] (8.744 s) : 0, 8744397
Agent [candidate] (1.071 s) : 0, 1071124
Total [candidate] (8.745 s) : 0, 8744726
section iast
Agent [baseline] (1.236 s) : 0, 1236097
Total [baseline] (9.491 s) : 0, 9491381
Agent [candidate] (1.229 s) : 0, 1228908
Total [candidate] (9.335 s) : 0, 9334966
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.236 s 175.449 ms (16.5%)
Total tracing 8.744 s -
Total iast 9.491 s 746.984 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent iast 1.229 s 157.784 ms (14.7%)
Total tracing 8.745 s -
Total iast 9.335 s 590.24 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (625.338 ms) : 0, 625338
BytebuddyAgent [candidate] (631.875 ms) : 0, 631875
AgentMeter [baseline] (29.059 ms) : 0, 29059
AgentMeter [candidate] (29.24 ms) : 0, 29240
GlobalTracer [baseline] (257.377 ms) : 0, 257377
GlobalTracer [candidate] (259.061 ms) : 0, 259061
AppSec [baseline] (32.968 ms) : 0, 32968
AppSec [candidate] (33.146 ms) : 0, 33146
Debugger [baseline] (61.242 ms) : 0, 61242
Debugger [candidate] (63.049 ms) : 0, 63049
Remote Config [baseline] (624.209 µs) : 0, 624
Remote Config [candidate] (617.649 µs) : 0, 618
Telemetry [baseline] (10.589 ms) : 0, 10589
Telemetry [candidate] (10.639 ms) : 0, 10639
Flare Poller [baseline] (6.061 ms) : 0, 6061
Flare Poller [candidate] (6.008 ms) : 0, 6008
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (798.215 ms) : 0, 798215
BytebuddyAgent [candidate] (794.345 ms) : 0, 794345
AgentMeter [baseline] (11.391 ms) : 0, 11391
AgentMeter [candidate] (11.309 ms) : 0, 11309
GlobalTracer [baseline] (248.833 ms) : 0, 248833
GlobalTracer [candidate] (247.338 ms) : 0, 247338
IAST [baseline] (27.113 ms) : 0, 27113
IAST [candidate] (26.928 ms) : 0, 26928
AppSec [baseline] (30.754 ms) : 0, 30754
AppSec [candidate] (32.236 ms) : 0, 32236
Debugger [baseline] (69.646 ms) : 0, 69646
Debugger [candidate] (66.842 ms) : 0, 66842
Remote Config [baseline] (565.726 µs) : 0, 566
Remote Config [candidate] (540.169 µs) : 0, 540
Telemetry [baseline] (8.774 ms) : 0, 8774
Telemetry [candidate] (8.617 ms) : 0, 8617
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.457 ms) : 0, 3457
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771530866 1771603033
git_commit_sha af8b844 1e40a01
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~1e40a01be0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771605359 1771605359
ci_job_id 1443528097 1443528097
ci_pipeline_id 97891350 97891350
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-fky8ryjg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-fky8ryjg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-192.007µs; -84.016µs] or [-6.740%; -2.949%]		 unsure
[-847.370µs; -159.938µs] or [-10.282%; -1.941%]		 unstable
[-91.586op/s; +232.024op/s] or [-7.267%; +18.409%]		 2.711ms 7.738ms 1330.594op/s 2.849ms 8.241ms 1260.375op/s
scenario:load:petclinic:code_origins:high_load worse
[+537.452µs; +1111.270µs] or [+3.068%; +6.343%]		 unsure
[+0.522ms; +1.872ms] or [+1.821%; +6.529%]		 unstable
[-36.221op/s; +14.096op/s] or [-13.855%; +5.392%]		 18.344ms 29.868ms 250.375op/s 17.520ms 28.671ms 261.438op/s
scenario:load:petclinic:no_agent:high_load better
[-1.910ms; -0.641ms] or [-10.845%; -3.641%]		 better
[-3.416ms; -0.697ms] or [-11.401%; -2.326%]		 unstable
[-11.422op/s; +45.172op/s] or [-4.416%; +17.464%]		 16.340ms 27.904ms 275.531op/s 17.616ms 29.961ms 258.656op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.041 ms) : 17856, 18226
.   : milestone, 18041,
appsec (18.317 ms) : 18131, 18504
.   : milestone, 18317,
code_origins (17.848 ms) : 17670, 18027
.   : milestone, 17848,
iast (17.517 ms) : 17348, 17687
.   : milestone, 17517,
profiling (18.587 ms) : 18399, 18776
.   : milestone, 18587,
tracing (17.389 ms) : 17218, 17560
.   : milestone, 17389,
section candidate
no_agent (16.932 ms) : 16767, 17097
.   : milestone, 16932,
appsec (18.645 ms) : 18457, 18833
.   : milestone, 18645,
code_origins (18.643 ms) : 18454, 18831
.   : milestone, 18643,
iast (17.654 ms) : 17477, 17831
.   : milestone, 17654,
profiling (18.486 ms) : 18300, 18671
.   : milestone, 18486,
tracing (17.412 ms) : 17242, 17582
.   : milestone, 17412,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.041 ms [17.856 ms, 18.226 ms] -
appsec 18.317 ms [18.131 ms, 18.504 ms] 275.919 µs (1.5%)
code_origins 17.848 ms [17.67 ms, 18.027 ms] -192.939 µs (-1.1%)
iast 17.517 ms [17.348 ms, 17.687 ms] -524.177 µs (-2.9%)
profiling 18.587 ms [18.399 ms, 18.776 ms] 545.843 µs (3.0%)
tracing 17.389 ms [17.218 ms, 17.56 ms] -652.154 µs (-3.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 16.932 ms [16.767 ms, 17.097 ms] -
appsec 18.645 ms [18.457 ms, 18.833 ms] 1.713 ms (10.1%)
code_origins 18.643 ms [18.454 ms, 18.831 ms] 1.71 ms (10.1%)
iast 17.654 ms [17.477 ms, 17.831 ms] 722.164 µs (4.3%)
profiling 18.486 ms [18.3 ms, 18.671 ms] 1.554 ms (9.2%)
tracing 17.412 ms [17.242 ms, 17.582 ms] 479.864 µs (2.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.166 ms) : 1155, 1177
.   : milestone, 1166,
iast (3.127 ms) : 3086, 3168
.   : milestone, 3127,
iast_FULL (5.623 ms) : 5567, 5678
.   : milestone, 5623,
iast_GLOBAL (3.639 ms) : 3579, 3700
.   : milestone, 3639,
profiling (1.992 ms) : 1974, 2009
.   : milestone, 1992,
tracing (1.784 ms) : 1769, 1800
.   : milestone, 1784,
section candidate
no_agent (1.185 ms) : 1173, 1197
.   : milestone, 1185,
iast (3.01 ms) : 2974, 3047
.   : milestone, 3010,
iast_FULL (5.699 ms) : 5641, 5757
.   : milestone, 5699,
iast_GLOBAL (3.444 ms) : 3395, 3494
.   : milestone, 3444,
profiling (1.882 ms) : 1867, 1898
.   : milestone, 1882,
tracing (1.754 ms) : 1739, 1769
.   : milestone, 1754,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.166 ms [1.155 ms, 1.177 ms] -
iast 3.127 ms [3.086 ms, 3.168 ms] 1.961 ms (168.2%)
iast_FULL 5.623 ms [5.567 ms, 5.678 ms] 4.457 ms (382.2%)
iast_GLOBAL 3.639 ms [3.579 ms, 3.7 ms] 2.473 ms (212.1%)
profiling 1.992 ms [1.974 ms, 2.009 ms] 825.42 µs (70.8%)
tracing 1.784 ms [1.769 ms, 1.8 ms] 618.34 µs (53.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.197 ms] -
iast 3.01 ms [2.974 ms, 3.047 ms] 1.825 ms (154.0%)
iast_FULL 5.699 ms [5.641 ms, 5.757 ms] 4.514 ms (380.8%)
iast_GLOBAL 3.444 ms [3.395 ms, 3.494 ms] 2.259 ms (190.6%)
profiling 1.882 ms [1.867 ms, 1.898 ms] 697.178 µs (58.8%)
tracing 1.754 ms [1.739 ms, 1.769 ms] 568.69 µs (48.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/junit-dynamic-tests
git_commit_date 1771530866 1771603033
git_commit_sha af8b844 1e40a01
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~1e40a01be0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771605045 1771605045
ci_job_id 1443528098 1443528098
ci_pipeline_id 97891350 97891350
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-iyx2t1ck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-iyx2t1ck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.731 ms) : 3513, 3948
.   : milestone, 3731,
iast (2.266 ms) : 2197, 2336
.   : milestone, 2266,
iast_GLOBAL (2.305 ms) : 2235, 2375
.   : milestone, 2305,
profiling (2.113 ms) : 2057, 2169
.   : milestone, 2113,
tracing (2.072 ms) : 2018, 2126
.   : milestone, 2072,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.787 ms) : 3563, 4010
.   : milestone, 3787,
iast (2.25 ms) : 2180, 2319
.   : milestone, 2250,
iast_GLOBAL (2.302 ms) : 2232, 2372
.   : milestone, 2302,
profiling (2.109 ms) : 2052, 2165
.   : milestone, 2109,
tracing (2.089 ms) : 2035, 2143
.   : milestone, 2089,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.731 ms [3.513 ms, 3.948 ms] 2.258 ms (153.3%)
iast 2.266 ms [2.197 ms, 2.336 ms] 793.092 µs (53.8%)
iast_GLOBAL 2.305 ms [2.235 ms, 2.375 ms] 832.027 µs (56.5%)
profiling 2.113 ms [2.057 ms, 2.169 ms] 639.874 µs (43.4%)
tracing 2.072 ms [2.018 ms, 2.126 ms] 599.108 µs (40.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.787 ms [3.563 ms, 4.01 ms] 2.311 ms (156.7%)
iast 2.25 ms [2.18 ms, 2.319 ms] 774.674 µs (52.5%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.372 ms] 827.311 µs (56.1%)
profiling 2.109 ms [2.052 ms, 2.165 ms] 633.42 µs (42.9%)
tracing 2.089 ms [2.035 ms, 2.143 ms] 614.03 µs (41.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1e40a01be0, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
appsec (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
iast (17.674 s) : 17674000, 17674000
.   : milestone, 17674000,
iast_GLOBAL (17.804 s) : 17804000, 17804000
.   : milestone, 17804000,
profiling (15.407 s) : 15407000, 15407000
.   : milestone, 15407000,
tracing (14.753 s) : 14753000, 14753000
.   : milestone, 14753000,
section candidate
no_agent (15.511 s) : 15511000, 15511000
.   : milestone, 15511000,
appsec (14.955 s) : 14955000, 14955000
.   : milestone, 14955000,
iast (18.381 s) : 18381000, 18381000
.   : milestone, 18381000,
iast_GLOBAL (18.017 s) : 18017000, 18017000
.   : milestone, 18017000,
profiling (14.821 s) : 14821000, 14821000
.   : milestone, 14821000,
tracing (14.591 s) : 14591000, 14591000
.   : milestone, 14591000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.05 s [15.05 s, 15.05 s] -
appsec 15.065 s [15.065 s, 15.065 s] 15.0 ms (0.1%)
iast 17.674 s [17.674 s, 17.674 s] 2.624 s (17.4%)
iast_GLOBAL 17.804 s [17.804 s, 17.804 s] 2.754 s (18.3%)
profiling 15.407 s [15.407 s, 15.407 s] 357.0 ms (2.4%)
tracing 14.753 s [14.753 s, 14.753 s] -297.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.511 s [15.511 s, 15.511 s] -
appsec 14.955 s [14.955 s, 14.955 s] -556.0 ms (-3.6%)
iast 18.381 s [18.381 s, 18.381 s] 2.87 s (18.5%)
iast_GLOBAL 18.017 s [18.017 s, 18.017 s] 2.506 s (16.2%)
profiling 14.821 s [14.821 s, 14.821 s] -690.0 ms (-4.4%)
tracing 14.591 s [14.591 s, 14.591 s] -920.0 ms (-5.9%)

@daniel-mohedano daniel-mohedano marked this pull request as ready for review February 20, 2026 13:20
@daniel-mohedano daniel-mohedano requested review from a team as code owners February 20, 2026 13:20
@daniel-mohedano daniel-mohedano requested review from mhlidd and removed request for a team February 20, 2026 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@mhlidd mhlidd Awaiting requested review from mhlidd mhlidd is a code owner automatically assigned from DataDog/apm-sdk-capabilities-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@daniel-mohedano @nikita-tkachenko-datadog