Skip to content

Comments

llmobs: set model tag even when llmobs disabled#10644

Draft
ygree wants to merge 1 commit intomasterfrom
ygree/llmobs-systest-fixes
Draft

llmobs: set model tag even when llmobs disabled#10644
ygree wants to merge 1 commit intomasterfrom
ygree/llmobs-systest-fixes

Conversation

@ygree
Copy link
Contributor

@ygree ygree commented Feb 19, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@ygree ygree self-assigned this Feb 19, 2026
@ygree ygree added comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix labels Feb 19, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 19, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771537472
git_commit_sha 16f3647 5cd257e
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~5cd257e5f4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771539357 1771539357
ci_job_id 1441419150 1441419150
ci_pipeline_id 97730393 97730393
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2e7muxyp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2e7muxyp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 7 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:iast:Debugger better
[-7.905ms; -1.706ms] or [-11.236%; -2.424%]		 65.548ms 70.354ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062470
Total [baseline] (10.955 s) : 0, 10955470
Agent [candidate] (1.075 s) : 0, 1075184
Total [candidate] (10.815 s) : 0, 10814780
section appsec
Agent [baseline] (1.241 s) : 0, 1241355
Total [baseline] (11.143 s) : 0, 11143254
Agent [candidate] (1.236 s) : 0, 1236250
Total [candidate] (11.059 s) : 0, 11058508
section iast
Agent [baseline] (1.236 s) : 0, 1236438
Total [baseline] (11.256 s) : 0, 11255593
Agent [candidate] (1.238 s) : 0, 1238302
Total [candidate] (11.281 s) : 0, 11280543
section profiling
Agent [baseline] (1.19 s) : 0, 1190499
Total [baseline] (11.045 s) : 0, 11044755
Agent [candidate] (1.192 s) : 0, 1192231
Total [candidate] (11.042 s) : 0, 11042384
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.241 s 178.885 ms (16.8%)
Agent iast 1.236 s 173.969 ms (16.4%)
Agent profiling 1.19 s 128.029 ms (12.1%)
Total tracing 10.955 s -
Total appsec 11.143 s 187.784 ms (1.7%)
Total iast 11.256 s 300.123 ms (2.7%)
Total profiling 11.045 s 89.286 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.236 s 161.066 ms (15.0%)
Agent iast 1.238 s 163.118 ms (15.2%)
Agent profiling 1.192 s 117.047 ms (10.9%)
Total tracing 10.815 s -
Total appsec 11.059 s 243.729 ms (2.3%)
Total iast 11.281 s 465.763 ms (4.3%)
Total profiling 11.042 s 227.604 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (628.63 ms) : 0, 628630
BytebuddyAgent [candidate] (633.598 ms) : 0, 633598
AgentMeter [baseline] (28.95 ms) : 0, 28950
AgentMeter [candidate] (29.177 ms) : 0, 29177
GlobalTracer [baseline] (257.298 ms) : 0, 257298
GlobalTracer [candidate] (259.516 ms) : 0, 259516
AppSec [baseline] (32.861 ms) : 0, 32861
AppSec [candidate] (33.257 ms) : 0, 33257
Debugger [baseline] (62.283 ms) : 0, 62283
Debugger [candidate] (62.203 ms) : 0, 62203
Remote Config [baseline] (683.593 µs) : 0, 684
Remote Config [candidate] (641.133 µs) : 0, 641
Telemetry [baseline] (11.457 ms) : 0, 11457
Telemetry [candidate] (14.654 ms) : 0, 14654
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (5.377 ms) : 0, 5377
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (658.729 ms) : 0, 658729
BytebuddyAgent [candidate] (655.951 ms) : 0, 655951
AgentMeter [baseline] (12.023 ms) : 0, 12023
AgentMeter [candidate] (11.956 ms) : 0, 11956
GlobalTracer [baseline] (258.694 ms) : 0, 258694
GlobalTracer [candidate] (258.038 ms) : 0, 258038
AppSec [baseline] (168.283 ms) : 0, 168283
AppSec [candidate] (167.774 ms) : 0, 167774
Debugger [baseline] (67.598 ms) : 0, 67598
Debugger [candidate] (66.964 ms) : 0, 66964
Remote Config [baseline] (646.351 µs) : 0, 646
Remote Config [candidate] (644.036 µs) : 0, 644
Telemetry [baseline] (9.664 ms) : 0, 9664
Telemetry [candidate] (9.68 ms) : 0, 9680
Flare Poller [baseline] (3.822 ms) : 0, 3822
Flare Poller [candidate] (3.682 ms) : 0, 3682
IAST [baseline] (25.232 ms) : 0, 25232
IAST [candidate] (25.053 ms) : 0, 25053
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (798.16 ms) : 0, 798160
BytebuddyAgent [candidate] (799.747 ms) : 0, 799747
AgentMeter [baseline] (11.281 ms) : 0, 11281
AgentMeter [candidate] (11.3 ms) : 0, 11300
GlobalTracer [baseline] (248.711 ms) : 0, 248711
GlobalTracer [candidate] (249.775 ms) : 0, 249775
AppSec [baseline] (31.599 ms) : 0, 31599
AppSec [candidate] (35.601 ms) : 0, 35601
Debugger [baseline] (70.354 ms) : 0, 70354
Debugger [candidate] (65.548 ms) : 0, 65548
Remote Config [baseline] (541.652 µs) : 0, 542
Remote Config [candidate] (537.066 µs) : 0, 537
Telemetry [baseline] (8.589 ms) : 0, 8589
Telemetry [candidate] (8.671 ms) : 0, 8671
Flare Poller [baseline] (3.436 ms) : 0, 3436
Flare Poller [candidate] (3.469 ms) : 0, 3469
IAST [baseline] (27.108 ms) : 0, 27108
IAST [candidate] (27.034 ms) : 0, 27034
section profiling
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (682.253 ms) : 0, 682253
BytebuddyAgent [candidate] (683.47 ms) : 0, 683470
AgentMeter [baseline] (8.622 ms) : 0, 8622
AgentMeter [candidate] (8.681 ms) : 0, 8681
GlobalTracer [baseline] (215.645 ms) : 0, 215645
GlobalTracer [candidate] (216.053 ms) : 0, 216053
AppSec [baseline] (32.527 ms) : 0, 32527
AppSec [candidate] (32.769 ms) : 0, 32769
Debugger [baseline] (67.419 ms) : 0, 67419
Debugger [candidate] (67.281 ms) : 0, 67281
Remote Config [baseline] (628.563 µs) : 0, 629
Remote Config [candidate] (623.401 µs) : 0, 623
Telemetry [baseline] (8.933 ms) : 0, 8933
Telemetry [candidate] (8.932 ms) : 0, 8932
Flare Poller [baseline] (3.749 ms) : 0, 3749
Flare Poller [candidate] (3.807 ms) : 0, 3807
ProfilingAgent [baseline] (99.615 ms) : 0, 99615
ProfilingAgent [candidate] (99.291 ms) : 0, 99291
Profiling [baseline] (100.195 ms) : 0, 100195
Profiling [candidate] (99.869 ms) : 0, 99869
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069125
Total [baseline] (8.792 s) : 0, 8792020
Agent [candidate] (1.075 s) : 0, 1074663
Total [candidate] (8.784 s) : 0, 8784242
section iast
Agent [baseline] (1.234 s) : 0, 1233584
Total [baseline] (9.37 s) : 0, 9370201
Agent [candidate] (1.241 s) : 0, 1241464
Total [candidate] (9.386 s) : 0, 9386323
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.234 s 164.459 ms (15.4%)
Total tracing 8.792 s -
Total iast 9.37 s 578.181 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent iast 1.241 s 166.801 ms (15.5%)
Total tracing 8.784 s -
Total iast 9.386 s 602.081 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (629.994 ms) : 0, 629994
BytebuddyAgent [candidate] (633.975 ms) : 0, 633975
AgentMeter [baseline] (29.297 ms) : 0, 29297
AgentMeter [candidate] (29.251 ms) : 0, 29251
GlobalTracer [baseline] (259.129 ms) : 0, 259129
GlobalTracer [candidate] (259.951 ms) : 0, 259951
AppSec [baseline] (33.062 ms) : 0, 33062
AppSec [candidate] (33.231 ms) : 0, 33231
Debugger [baseline] (60.956 ms) : 0, 60956
Debugger [candidate] (60.459 ms) : 0, 60459
Remote Config [baseline] (634.143 µs) : 0, 634
Remote Config [candidate] (630.32 µs) : 0, 630
Telemetry [baseline] (12.441 ms) : 0, 12441
Telemetry [candidate] (15.844 ms) : 0, 15844
Flare Poller [baseline] (6.933 ms) : 0, 6933
Flare Poller [candidate] (4.579 ms) : 0, 4579
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (797.145 ms) : 0, 797145
BytebuddyAgent [candidate] (803.212 ms) : 0, 803212
AgentMeter [baseline] (11.204 ms) : 0, 11204
AgentMeter [candidate] (11.547 ms) : 0, 11547
GlobalTracer [baseline] (248.518 ms) : 0, 248518
GlobalTracer [candidate] (249.933 ms) : 0, 249933
AppSec [baseline] (33.134 ms) : 0, 33134
AppSec [candidate] (35.001 ms) : 0, 35001
Debugger [baseline] (67.483 ms) : 0, 67483
Debugger [candidate] (65.275 ms) : 0, 65275
Remote Config [baseline] (553.636 µs) : 0, 554
Remote Config [candidate] (530.918 µs) : 0, 531
Telemetry [baseline] (8.588 ms) : 0, 8588
Telemetry [candidate] (8.574 ms) : 0, 8574
Flare Poller [baseline] (3.458 ms) : 0, 3458
Flare Poller [candidate] (3.474 ms) : 0, 3474
IAST [baseline] (26.962 ms) : 0, 26962
IAST [candidate] (27.254 ms) : 0, 27254
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771537472
git_commit_sha 16f3647 5cd257e
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~5cd257e5f4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771539844 1771539844
ci_job_id 1441419151 1441419151
ci_pipeline_id 97730393 97730393
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aokcyjld 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aokcyjld 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+58.366µs; +216.978µs] or [+2.205%; +8.199%]		 unsure
[+146.663µs; +684.157µs] or [+1.935%; +9.025%]		 unstable
[-217.635op/s; +58.260op/s] or [-16.012%; +4.286%]		 2.784ms 7.996ms 1279.500op/s 2.647ms 7.581ms 1359.188op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-364.940µs; -153.204µs] or [-6.934%; -2.911%]		 unsure
[-661.918µs; -37.926µs] or [-5.355%; -0.307%]		 unstable
[-48.750op/s; +115.687op/s] or [-6.197%; +14.706%]		 5.004ms 12.010ms 820.125op/s 5.263ms 12.360ms 786.656op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.194 ms) : 1182, 1205
.   : milestone, 1194,
iast (3.208 ms) : 3165, 3250
.   : milestone, 3208,
iast_FULL (5.878 ms) : 5818, 5937
.   : milestone, 5878,
iast_GLOBAL (3.37 ms) : 3322, 3418
.   : milestone, 3370,
profiling (2.135 ms) : 2115, 2155
.   : milestone, 2135,
tracing (1.819 ms) : 1803, 1834
.   : milestone, 1819,
section candidate
no_agent (1.204 ms) : 1192, 1216
.   : milestone, 1204,
iast (3.167 ms) : 3124, 3210
.   : milestone, 3167,
iast_FULL (5.633 ms) : 5577, 5688
.   : milestone, 5633,
iast_GLOBAL (3.585 ms) : 3525, 3645
.   : milestone, 3585,
profiling (2.035 ms) : 2017, 2053
.   : milestone, 2035,
tracing (1.773 ms) : 1758, 1787
.   : milestone, 1773,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.194 ms [1.182 ms, 1.205 ms] -
iast 3.208 ms [3.165 ms, 3.25 ms] 2.014 ms (168.7%)
iast_FULL 5.878 ms [5.818 ms, 5.937 ms] 4.684 ms (392.4%)
iast_GLOBAL 3.37 ms [3.322 ms, 3.418 ms] 2.176 ms (182.3%)
profiling 2.135 ms [2.115 ms, 2.155 ms] 941.24 µs (78.8%)
tracing 1.819 ms [1.803 ms, 1.834 ms] 625.192 µs (52.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.192 ms, 1.216 ms] -
iast 3.167 ms [3.124 ms, 3.21 ms] 1.963 ms (163.1%)
iast_FULL 5.633 ms [5.577 ms, 5.688 ms] 4.429 ms (367.9%)
iast_GLOBAL 3.585 ms [3.525 ms, 3.645 ms] 2.381 ms (197.8%)
profiling 2.035 ms [2.017 ms, 2.053 ms] 831.357 µs (69.1%)
tracing 1.773 ms [1.758 ms, 1.787 ms] 568.795 µs (47.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.47 ms) : 18280, 18660
.   : milestone, 18470,
appsec (18.443 ms) : 18257, 18628
.   : milestone, 18443,
code_origins (17.58 ms) : 17406, 17755
.   : milestone, 17580,
iast (17.345 ms) : 17173, 17518
.   : milestone, 17345,
profiling (19.533 ms) : 19338, 19728
.   : milestone, 19533,
tracing (17.541 ms) : 17363, 17719
.   : milestone, 17541,
section candidate
no_agent (18.159 ms) : 17973, 18345
.   : milestone, 18159,
appsec (18.38 ms) : 18193, 18567
.   : milestone, 18380,
code_origins (17.653 ms) : 17478, 17828
.   : milestone, 17653,
iast (17.782 ms) : 17604, 17960
.   : milestone, 17782,
profiling (19.304 ms) : 19114, 19494
.   : milestone, 19304,
tracing (17.479 ms) : 17307, 17651
.   : milestone, 17479,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.47 ms [18.28 ms, 18.66 ms] -
appsec 18.443 ms [18.257 ms, 18.628 ms] -27.035 µs (-0.1%)
code_origins 17.58 ms [17.406 ms, 17.755 ms] -889.189 µs (-4.8%)
iast 17.345 ms [17.173 ms, 17.518 ms] -1.124 ms (-6.1%)
profiling 19.533 ms [19.338 ms, 19.728 ms] 1.063 ms (5.8%)
tracing 17.541 ms [17.363 ms, 17.719 ms] -928.331 µs (-5.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.159 ms [17.973 ms, 18.345 ms] -
appsec 18.38 ms [18.193 ms, 18.567 ms] 220.845 µs (1.2%)
code_origins 17.653 ms [17.478 ms, 17.828 ms] -505.955 µs (-2.8%)
iast 17.782 ms [17.604 ms, 17.96 ms] -376.892 µs (-2.1%)
profiling 19.304 ms [19.114 ms, 19.494 ms] 1.145 ms (6.3%)
tracing 17.479 ms [17.307 ms, 17.651 ms] -680.277 µs (-3.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771537472
git_commit_sha 16f3647 5cd257e
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~5cd257e5f4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771539497 1771539497
ci_job_id 1441419153 1441419153
ci_pipeline_id 97730393 97730393
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mep0mano 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mep0mano 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,
appsec (14.902 s) : 14902000, 14902000
.   : milestone, 14902000,
iast (18.196 s) : 18196000, 18196000
.   : milestone, 18196000,
iast_GLOBAL (18.132 s) : 18132000, 18132000
.   : milestone, 18132000,
profiling (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
tracing (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
section candidate
no_agent (15.061 s) : 15061000, 15061000
.   : milestone, 15061000,
appsec (14.958 s) : 14958000, 14958000
.   : milestone, 14958000,
iast (18.146 s) : 18146000, 18146000
.   : milestone, 18146000,
iast_GLOBAL (17.921 s) : 17921000, 17921000
.   : milestone, 17921000,
profiling (15.45 s) : 15450000, 15450000
.   : milestone, 15450000,
tracing (14.79 s) : 14790000, 14790000
.   : milestone, 14790000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.906 s [14.906 s, 14.906 s] -
appsec 14.902 s [14.902 s, 14.902 s] -4.0 ms (-0.0%)
iast 18.196 s [18.196 s, 18.196 s] 3.29 s (22.1%)
iast_GLOBAL 18.132 s [18.132 s, 18.132 s] 3.226 s (21.6%)
profiling 14.948 s [14.948 s, 14.948 s] 42.0 ms (0.3%)
tracing 14.928 s [14.928 s, 14.928 s] 22.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.061 s [15.061 s, 15.061 s] -
appsec 14.958 s [14.958 s, 14.958 s] -103.0 ms (-0.7%)
iast 18.146 s [18.146 s, 18.146 s] 3.085 s (20.5%)
iast_GLOBAL 17.921 s [17.921 s, 17.921 s] 2.86 s (19.0%)
profiling 15.45 s [15.45 s, 15.45 s] 389.0 ms (2.6%)
tracing 14.79 s [14.79 s, 14.79 s] -271.0 ms (-1.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~5cd257e5f4, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.745 ms) : 3521, 3968
.   : milestone, 3745,
iast (2.26 ms) : 2191, 2329
.   : milestone, 2260,
iast_GLOBAL (2.313 ms) : 2243, 2383
.   : milestone, 2313,
profiling (2.08 ms) : 2025, 2134
.   : milestone, 2080,
tracing (2.061 ms) : 2008, 2115
.   : milestone, 2061,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.81 ms) : 3589, 4031
.   : milestone, 3810,
iast (2.269 ms) : 2200, 2338
.   : milestone, 2269,
iast_GLOBAL (2.311 ms) : 2241, 2380
.   : milestone, 2311,
profiling (2.091 ms) : 2036, 2145
.   : milestone, 2091,
tracing (2.069 ms) : 2015, 2122
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.745 ms [3.521 ms, 3.968 ms] 2.264 ms (152.9%)
iast 2.26 ms [2.191 ms, 2.329 ms] 779.116 µs (52.6%)
iast_GLOBAL 2.313 ms [2.243 ms, 2.383 ms] 832.405 µs (56.2%)
profiling 2.08 ms [2.025 ms, 2.134 ms] 599.135 µs (40.5%)
tracing 2.061 ms [2.008 ms, 2.115 ms] 580.905 µs (39.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.81 ms [3.589 ms, 4.031 ms] 2.331 ms (157.6%)
iast 2.269 ms [2.2 ms, 2.338 ms] 790.288 µs (53.4%)
iast_GLOBAL 2.311 ms [2.241 ms, 2.38 ms] 831.656 µs (56.2%)
profiling 2.091 ms [2.036 ms, 2.145 ms] 611.632 µs (41.4%)
tracing 2.069 ms [2.015 ms, 2.122 ms] 589.507 µs (39.9%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@ygree ygree

Labels

comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ygree