Marked as flaky. by AlexeyKuznetsov-DD · Pull Request #10608 · DataDog/dd-trace-java

AlexeyKuznetsov-DD · 2026-02-17T16:32:54Z

What Does This Do

Marked test Thread.startVirtualThread() runnable as flaky.

Motivation

Green CI.

Additional Notes

Test is flaky almost every day on master branch.

pr-commenter · 2026-02-17T17:19:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-smoke-test-vt
git_commit_date	1771338181	1771345580
git_commit_sha	`27522ae`	`9fc68d9`
release_version	1.60.0-SNAPSHOT~27522ae525	1.60.0-SNAPSHOT~9fc68d96bf

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771347568	1771347568
ci_job_id	1432343008	1432343008
ci_pipeline_id	96961538	96961538
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-j2x7avgq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-j2x7avgq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1076764
Total [baseline] (8.798 s) : 0, 8798302
Agent [candidate] (1.064 s) : 0, 1063738
Total [candidate] (8.719 s) : 0, 8719208
section iast
Agent [baseline] (1.229 s) : 0, 1228849
Total [baseline] (9.378 s) : 0, 9377527
Agent [candidate] (1.231 s) : 0, 1231243
Total [candidate] (9.307 s) : 0, 9307206

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.077 s	-
Agent	iast	1.229 s	152.085 ms (14.1%)
Total	tracing	8.798 s	-
Total	iast	9.378 s	579.224 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.231 s	167.506 ms (15.7%)
Total	tracing	8.719 s	-
Total	iast	9.307 s	587.998 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (637.265 ms) : 0, 637265
BytebuddyAgent [candidate] (628.897 ms) : 0, 628897
AgentMeter [baseline] (29.509 ms) : 0, 29509
AgentMeter [candidate] (28.948 ms) : 0, 28948
GlobalTracer [baseline] (260.323 ms) : 0, 260323
GlobalTracer [candidate] (257.555 ms) : 0, 257555
AppSec [baseline] (33.388 ms) : 0, 33388
AppSec [candidate] (32.809 ms) : 0, 32809
Debugger [baseline] (61.286 ms) : 0, 61286
Debugger [candidate] (61.942 ms) : 0, 61942
Remote Config [baseline] (626.308 µs) : 0, 626
Remote Config [candidate] (650.354 µs) : 0, 650
Telemetry [baseline] (11.524 ms) : 0, 11524
Telemetry [candidate] (12.033 ms) : 0, 12033
Flare Poller [baseline] (6.058 ms) : 0, 6058
Flare Poller [candidate] (4.452 ms) : 0, 4452
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (794.033 ms) : 0, 794033
BytebuddyAgent [candidate] (796.297 ms) : 0, 796297
AgentMeter [baseline] (11.235 ms) : 0, 11235
AgentMeter [candidate] (11.242 ms) : 0, 11242
GlobalTracer [baseline] (247.605 ms) : 0, 247605
GlobalTracer [candidate] (248.012 ms) : 0, 248012
IAST [baseline] (26.852 ms) : 0, 26852
IAST [candidate] (26.902 ms) : 0, 26902
AppSec [baseline] (34.969 ms) : 0, 34969
AppSec [candidate] (34.777 ms) : 0, 34777
Debugger [baseline] (65.109 ms) : 0, 65109
Debugger [candidate] (64.864 ms) : 0, 64864
Remote Config [baseline] (536.565 µs) : 0, 537
Remote Config [candidate] (540.599 µs) : 0, 541
Telemetry [baseline] (8.603 ms) : 0, 8603
Telemetry [candidate] (8.607 ms) : 0, 8607
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (3.55 ms) : 0, 3550

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062061
Total [baseline] (10.922 s) : 0, 10922144
Agent [candidate] (1.063 s) : 0, 1062902
Total [candidate] (10.948 s) : 0, 10947695
section appsec
Agent [baseline] (1.247 s) : 0, 1247466
Total [baseline] (11.067 s) : 0, 11067413
Agent [candidate] (1.237 s) : 0, 1236629
Total [candidate] (10.985 s) : 0, 10984884
section iast
Agent [baseline] (1.235 s) : 0, 1235471
Total [baseline] (11.159 s) : 0, 11159031
Agent [candidate] (1.233 s) : 0, 1232825
Total [candidate] (11.114 s) : 0, 11113822
section profiling
Agent [baseline] (1.19 s) : 0, 1189848
Total [baseline] (10.883 s) : 0, 10882611
Agent [candidate] (1.198 s) : 0, 1197957
Total [candidate] (11.057 s) : 0, 11057301

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	appsec	1.247 s	185.406 ms (17.5%)
Agent	iast	1.235 s	173.411 ms (16.3%)
Agent	profiling	1.19 s	127.787 ms (12.0%)
Total	tracing	10.922 s	-
Total	appsec	11.067 s	145.269 ms (1.3%)
Total	iast	11.159 s	236.886 ms (2.2%)
Total	profiling	10.883 s	-39.533 ms (-0.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	appsec	1.237 s	173.728 ms (16.3%)
Agent	iast	1.233 s	169.923 ms (16.0%)
Agent	profiling	1.198 s	135.055 ms (12.7%)
Total	tracing	10.948 s	-
Total	appsec	10.985 s	37.189 ms (0.3%)
Total	iast	11.114 s	166.127 ms (1.5%)
Total	profiling	11.057 s	109.606 ms (1.0%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.162 ms) : 0, 1162
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (626.668 ms) : 0, 626668
BytebuddyAgent [candidate] (627.832 ms) : 0, 627832
AgentMeter [baseline] (28.802 ms) : 0, 28802
AgentMeter [candidate] (28.853 ms) : 0, 28853
GlobalTracer [baseline] (256.532 ms) : 0, 256532
GlobalTracer [candidate] (256.815 ms) : 0, 256815
AppSec [baseline] (32.639 ms) : 0, 32639
AppSec [candidate] (32.731 ms) : 0, 32731
Debugger [baseline] (62.147 ms) : 0, 62147
Debugger [candidate] (62.161 ms) : 0, 62161
Remote Config [baseline] (618.35 µs) : 0, 618
Remote Config [candidate] (626.892 µs) : 0, 627
Telemetry [baseline] (12.164 ms) : 0, 12164
Telemetry [candidate] (11.389 ms) : 0, 11389
Flare Poller [baseline] (6.051 ms) : 0, 6051
Flare Poller [candidate] (6.14 ms) : 0, 6140
section appsec
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (663.229 ms) : 0, 663229
BytebuddyAgent [candidate] (656.605 ms) : 0, 656605
AgentMeter [baseline] (12.051 ms) : 0, 12051
AgentMeter [candidate] (11.932 ms) : 0, 11932
GlobalTracer [baseline] (259.577 ms) : 0, 259577
GlobalTracer [candidate] (257.837 ms) : 0, 257837
AppSec [baseline] (168.686 ms) : 0, 168686
AppSec [candidate] (167.764 ms) : 0, 167764
Debugger [baseline] (67.6 ms) : 0, 67600
Debugger [candidate] (67.009 ms) : 0, 67009
Remote Config [baseline] (649.794 µs) : 0, 650
Remote Config [candidate] (661.123 µs) : 0, 661
Telemetry [baseline] (9.771 ms) : 0, 9771
Telemetry [candidate] (9.654 ms) : 0, 9654
Flare Poller [baseline] (3.873 ms) : 0, 3873
Flare Poller [candidate] (3.731 ms) : 0, 3731
IAST [baseline] (25.466 ms) : 0, 25466
IAST [candidate] (25.055 ms) : 0, 25055
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (798.395 ms) : 0, 798395
BytebuddyAgent [candidate] (795.606 ms) : 0, 795606
AgentMeter [baseline] (11.288 ms) : 0, 11288
AgentMeter [candidate] (11.265 ms) : 0, 11265
GlobalTracer [baseline] (249.025 ms) : 0, 249025
GlobalTracer [candidate] (248.561 ms) : 0, 248561
AppSec [baseline] (33.12 ms) : 0, 33120
AppSec [candidate] (32.253 ms) : 0, 32253
Debugger [baseline] (67.384 ms) : 0, 67384
Debugger [candidate] (68.964 ms) : 0, 68964
Remote Config [baseline] (535.052 µs) : 0, 535
Remote Config [candidate] (542.155 µs) : 0, 542
Telemetry [baseline] (8.582 ms) : 0, 8582
Telemetry [candidate] (8.665 ms) : 0, 8665
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.506 ms) : 0, 3506
IAST [baseline] (27.197 ms) : 0, 27197
IAST [candidate] (27.041 ms) : 0, 27041
section profiling
ProfilingAgent [baseline] (98.802 ms) : 0, 98802
ProfilingAgent [candidate] (99.699 ms) : 0, 99699
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (681.847 ms) : 0, 681847
BytebuddyAgent [candidate] (686.722 ms) : 0, 686722
AgentMeter [baseline] (8.62 ms) : 0, 8620
AgentMeter [candidate] (8.652 ms) : 0, 8652
GlobalTracer [baseline] (215.962 ms) : 0, 215962
GlobalTracer [candidate] (217.155 ms) : 0, 217155
AppSec [baseline] (32.584 ms) : 0, 32584
AppSec [candidate] (32.944 ms) : 0, 32944
Debugger [baseline] (67.653 ms) : 0, 67653
Debugger [candidate] (67.884 ms) : 0, 67884
Remote Config [baseline] (618.593 µs) : 0, 619
Remote Config [candidate] (631.164 µs) : 0, 631
Telemetry [baseline] (8.938 ms) : 0, 8938
Telemetry [candidate] (9.018 ms) : 0, 9018
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.799 ms) : 0, 3799
Profiling [baseline] (99.372 ms) : 0, 99372
Profiling [candidate] (100.274 ms) : 0, 100274

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-smoke-test-vt
git_commit_date	1771338181	1771345580
git_commit_sha	`27522ae`	`9fc68d9`
release_version	1.60.0-SNAPSHOT~27522ae525	1.60.0-SNAPSHOT~9fc68d96bf

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771348065	1771348065
ci_job_id	1432343011	1432343011
ci_pipeline_id	96961538	96961538
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-tpvuxslz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-tpvuxslz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+81.215µs; +229.489µs] or [+2.993%; +8.456%]	same [-6.173µs; +499.991µs] or [-0.079%; +6.413%]	unstable [-182.867op/s; +89.492op/s] or [-13.993%; +6.848%]	2.869ms	8.044ms	1260.188op/s	2.714ms	7.797ms	1306.875op/s
scenario:load:insecure-bank:iast_FULL:high_load	worse [+208.917µs; +419.936µs] or [+4.152%; +8.346%]	unsure [+185.554µs; +704.707µs] or [+1.549%; +5.883%]	unstable [-120.476op/s; +39.851op/s] or [-14.768%; +4.885%]	5.346ms	12.423ms	775.500op/s	5.032ms	11.978ms	815.812op/s
scenario:load:petclinic:iast:high_load	better [-1148.368µs; -787.944µs] or [-6.370%; -4.370%]	unsure [-1395.462µs; -386.628µs] or [-4.773%; -1.322%]	unstable [-12.826op/s; +41.764op/s] or [-5.050%; +16.444%]	17.061ms	28.346ms	268.438op/s	18.029ms	29.237ms	253.969op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.156 ms) : 18958, 19354
.   : milestone, 19156,
appsec (18.487 ms) : 18298, 18676
.   : milestone, 18487,
code_origins (17.753 ms) : 17579, 17927
.   : milestone, 17753,
iast (18.374 ms) : 18193, 18556
.   : milestone, 18374,
profiling (19.5 ms) : 19297, 19703
.   : milestone, 19500,
tracing (17.476 ms) : 17303, 17649
.   : milestone, 17476,
section candidate
no_agent (19.705 ms) : 19499, 19910
.   : milestone, 19705,
appsec (18.431 ms) : 18242, 18620
.   : milestone, 18431,
code_origins (17.488 ms) : 17312, 17664
.   : milestone, 17488,
iast (17.38 ms) : 17206, 17555
.   : milestone, 17380,
profiling (18.724 ms) : 18535, 18913
.   : milestone, 18724,
tracing (17.653 ms) : 17477, 17829
.   : milestone, 17653,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.156 ms [18.958 ms, 19.354 ms]	-
appsec	18.487 ms [18.298 ms, 18.676 ms]	-669.008 µs (-3.5%)
code_origins	17.753 ms [17.579 ms, 17.927 ms]	-1.403 ms (-7.3%)
iast	18.374 ms [18.193 ms, 18.556 ms]	-781.784 µs (-4.1%)
profiling	19.5 ms [19.297 ms, 19.703 ms]	343.845 µs (1.8%)
tracing	17.476 ms [17.303 ms, 17.649 ms]	-1.68 ms (-8.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.705 ms [19.499 ms, 19.91 ms]	-
appsec	18.431 ms [18.242 ms, 18.62 ms]	-1.274 ms (-6.5%)
code_origins	17.488 ms [17.312 ms, 17.664 ms]	-2.216 ms (-11.2%)
iast	17.38 ms [17.206 ms, 17.555 ms]	-2.324 ms (-11.8%)
profiling	18.724 ms [18.535 ms, 18.913 ms]	-980.508 µs (-5.0%)
tracing	17.653 ms [17.477 ms, 17.829 ms]	-2.051 ms (-10.4%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.179 ms) : 1168, 1191
.   : milestone, 1179,
iast (3.199 ms) : 3152, 3246
.   : milestone, 3199,
iast_FULL (5.664 ms) : 5609, 5719
.   : milestone, 5664,
iast_GLOBAL (3.508 ms) : 3443, 3574
.   : milestone, 3508,
profiling (2.014 ms) : 1997, 2032
.   : milestone, 2014,
tracing (1.799 ms) : 1784, 1814
.   : milestone, 1799,
section candidate
no_agent (1.197 ms) : 1185, 1209
.   : milestone, 1197,
iast (3.138 ms) : 3094, 3181
.   : milestone, 3138,
iast_FULL (5.963 ms) : 5904, 6022
.   : milestone, 5963,
iast_GLOBAL (3.64 ms) : 3580, 3701
.   : milestone, 3640,
profiling (1.968 ms) : 1951, 1986
.   : milestone, 1968,
tracing (1.752 ms) : 1739, 1766
.   : milestone, 1752,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.179 ms [1.168 ms, 1.191 ms]	-
iast	3.199 ms [3.152 ms, 3.246 ms]	2.02 ms (171.3%)
iast_FULL	5.664 ms [5.609 ms, 5.719 ms]	4.485 ms (380.2%)
iast_GLOBAL	3.508 ms [3.443 ms, 3.574 ms]	2.329 ms (197.5%)
profiling	2.014 ms [1.997 ms, 2.032 ms]	834.968 µs (70.8%)
tracing	1.799 ms [1.784 ms, 1.814 ms]	619.664 µs (52.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.197 ms [1.185 ms, 1.209 ms]	-
iast	3.138 ms [3.094 ms, 3.181 ms]	1.94 ms (162.0%)
iast_FULL	5.963 ms [5.904 ms, 6.022 ms]	4.766 ms (398.0%)
iast_GLOBAL	3.64 ms [3.58 ms, 3.701 ms]	2.443 ms (204.0%)
profiling	1.968 ms [1.951 ms, 1.986 ms]	771.019 µs (64.4%)
tracing	1.752 ms [1.739 ms, 1.766 ms]	555.088 µs (46.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-smoke-test-vt
git_commit_date	1771338181	1771345580
git_commit_sha	`27522ae`	`9fc68d9`
release_version	1.60.0-SNAPSHOT~27522ae525	1.60.0-SNAPSHOT~9fc68d96bf

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1771347766	1771347766
ci_job_id	1432343014	1432343014
ci_pipeline_id	96961538	96961538
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-qgvmskqx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-qgvmskqx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.419ms; -1.072ms] or [-37.867%; -28.603%]	2.503ms	3.748ms

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
appsec (14.773 s) : 14773000, 14773000
.   : milestone, 14773000,
iast (18.276 s) : 18276000, 18276000
.   : milestone, 18276000,
iast_GLOBAL (17.701 s) : 17701000, 17701000
.   : milestone, 17701000,
profiling (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
tracing (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
section candidate
no_agent (15.429 s) : 15429000, 15429000
.   : milestone, 15429000,
appsec (14.897 s) : 14897000, 14897000
.   : milestone, 14897000,
iast (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
iast_GLOBAL (17.799 s) : 17799000, 17799000
.   : milestone, 17799000,
profiling (14.879 s) : 14879000, 14879000
.   : milestone, 14879000,
tracing (14.69 s) : 14690000, 14690000
.   : milestone, 14690000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.015 s [15.015 s, 15.015 s]	-
appsec	14.773 s [14.773 s, 14.773 s]	-242.0 ms (-1.6%)
iast	18.276 s [18.276 s, 18.276 s]	3.261 s (21.7%)
iast_GLOBAL	17.701 s [17.701 s, 17.701 s]	2.686 s (17.9%)
profiling	14.855 s [14.855 s, 14.855 s]	-160.0 ms (-1.1%)
tracing	14.852 s [14.852 s, 14.852 s]	-163.0 ms (-1.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.429 s [15.429 s, 15.429 s]	-
appsec	14.897 s [14.897 s, 14.897 s]	-532.0 ms (-3.4%)
iast	17.984 s [17.984 s, 17.984 s]	2.555 s (16.6%)
iast_GLOBAL	17.799 s [17.799 s, 17.799 s]	2.37 s (15.4%)
profiling	14.879 s [14.879 s, 14.879 s]	-550.0 ms (-3.6%)
tracing	14.69 s [14.69 s, 14.69 s]	-739.0 ms (-4.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1478
.   : milestone, 1467,
appsec (3.748 ms) : 3527, 3970
.   : milestone, 3748,
iast (2.242 ms) : 2172, 2311
.   : milestone, 2242,
iast_GLOBAL (2.287 ms) : 2217, 2356
.   : milestone, 2287,
profiling (2.46 ms) : 2300, 2620
.   : milestone, 2460,
tracing (2.05 ms) : 1997, 2104
.   : milestone, 2050,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.503 ms) : 2448, 2557
.   : milestone, 2503,
iast (2.248 ms) : 2179, 2318
.   : milestone, 2248,
iast_GLOBAL (2.293 ms) : 2223, 2362
.   : milestone, 2293,
profiling (2.069 ms) : 2015, 2123
.   : milestone, 2069,
tracing (2.046 ms) : 1993, 2099
.   : milestone, 2046,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.478 ms]	-
appsec	3.748 ms [3.527 ms, 3.97 ms]	2.281 ms (155.5%)
iast	2.242 ms [2.172 ms, 2.311 ms]	774.436 µs (52.8%)
iast_GLOBAL	2.287 ms [2.217 ms, 2.356 ms]	819.498 µs (55.9%)
profiling	2.46 ms [2.3 ms, 2.62 ms]	992.828 µs (67.7%)
tracing	2.05 ms [1.997 ms, 2.104 ms]	582.952 µs (39.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	2.503 ms [2.448 ms, 2.557 ms]	1.032 ms (70.2%)
iast	2.248 ms [2.179 ms, 2.318 ms]	777.959 µs (52.9%)
iast_GLOBAL	2.293 ms [2.223 ms, 2.362 ms]	822.364 µs (55.9%)
profiling	2.069 ms [2.015 ms, 2.123 ms]	598.719 µs (40.7%)
tracing	2.046 ms [1.993 ms, 2.099 ms]	575.823 µs (39.2%)

Marked as flaky.

9fc68d9

AlexeyKuznetsov-DD requested a review from PerfectSlayer February 17, 2026 16:32

AlexeyKuznetsov-DD self-assigned this Feb 17, 2026

AlexeyKuznetsov-DD added tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests inst: java Core Java language instrumentation labels Feb 17, 2026

AlexeyKuznetsov-DD marked this pull request as ready for review February 17, 2026 16:33

AlexeyKuznetsov-DD requested a review from a team as a code owner February 17, 2026 16:33

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Marked as flaky.#10608

Marked as flaky.#10608
AlexeyKuznetsov-DD wants to merge 1 commit intomasterfrom
alexeyk/flaky-smoke-test-vt

AlexeyKuznetsov-DD commented Feb 17, 2026

Uh oh!

pr-commenter bot commented Feb 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

AlexeyKuznetsov-DD commented Feb 17, 2026

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter bot commented Feb 17, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant