Tweak CI for better resources utilization.#10612
Draft
AlexeyKuznetsov-DD wants to merge 16 commits intomasterfrom
Draft
Tweak CI for better resources utilization.#10612AlexeyKuznetsov-DD wants to merge 16 commits intomasterfrom
AlexeyKuznetsov-DD wants to merge 16 commits intomasterfrom
Conversation
# Conflicts: # .gitlab-ci.yml
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061587
Total [baseline] (8.695 s) : 0, 8695019
Agent [candidate] (1.072 s) : 0, 1072159
Total [candidate] (8.718 s) : 0, 8717924
section iast
Agent [baseline] (1.239 s) : 0, 1238841
Total [baseline] (9.373 s) : 0, 9373036
Agent [candidate] (1.231 s) : 0, 1230872
Total [candidate] (9.327 s) : 0, 9326789
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (627.647 ms) : 0, 627647
BytebuddyAgent [candidate] (634.272 ms) : 0, 634272
AgentMeter [baseline] (28.86 ms) : 0, 28860
AgentMeter [candidate] (29.135 ms) : 0, 29135
GlobalTracer [baseline] (256.531 ms) : 0, 256531
GlobalTracer [candidate] (259.183 ms) : 0, 259183
AppSec [baseline] (32.788 ms) : 0, 32788
AppSec [candidate] (32.935 ms) : 0, 32935
Debugger [baseline] (60.53 ms) : 0, 60530
Debugger [candidate] (62.53 ms) : 0, 62530
Remote Config [baseline] (630.78 µs) : 0, 631
Remote Config [candidate] (617.436 µs) : 0, 617
Telemetry [baseline] (12.138 ms) : 0, 12138
Telemetry [candidate] (12.991 ms) : 0, 12991
Flare Poller [baseline] (5.993 ms) : 0, 5993
Flare Poller [candidate] (3.772 ms) : 0, 3772
section iast
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (801.84 ms) : 0, 801840
BytebuddyAgent [candidate] (796.101 ms) : 0, 796101
AgentMeter [baseline] (11.473 ms) : 0, 11473
AgentMeter [candidate] (11.259 ms) : 0, 11259
GlobalTracer [baseline] (248.847 ms) : 0, 248847
GlobalTracer [candidate] (248.408 ms) : 0, 248408
AppSec [baseline] (32.41 ms) : 0, 32410
AppSec [candidate] (34.523 ms) : 0, 34523
Debugger [baseline] (67.815 ms) : 0, 67815
Debugger [candidate] (64.828 ms) : 0, 64828
Remote Config [baseline] (529.43 µs) : 0, 529
Remote Config [candidate] (536.743 µs) : 0, 537
Telemetry [baseline] (8.64 ms) : 0, 8640
Telemetry [candidate] (8.533 ms) : 0, 8533
Flare Poller [baseline] (3.525 ms) : 0, 3525
Flare Poller [candidate] (3.493 ms) : 0, 3493
IAST [baseline] (27.198 ms) : 0, 27198
IAST [candidate] (26.811 ms) : 0, 26811
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067505
Total [baseline] (10.73 s) : 0, 10730149
Agent [candidate] (1.073 s) : 0, 1073177
Total [candidate] (10.81 s) : 0, 10810109
section appsec
Agent [baseline] (1.253 s) : 0, 1253388
Total [baseline] (11.139 s) : 0, 11138572
Agent [candidate] (1.239 s) : 0, 1238509
Total [candidate] (11.041 s) : 0, 11041206
section iast
Agent [baseline] (1.236 s) : 0, 1236004
Total [baseline] (11.157 s) : 0, 11157325
Agent [candidate] (1.234 s) : 0, 1234274
Total [candidate] (11.19 s) : 0, 11189692
section profiling
Agent [baseline] (1.188 s) : 0, 1188357
Total [baseline] (10.869 s) : 0, 10868601
Agent [candidate] (1.19 s) : 0, 1189553
Total [candidate] (10.926 s) : 0, 10926157
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (631.589 ms) : 0, 631589
BytebuddyAgent [candidate] (634.057 ms) : 0, 634057
AgentMeter [baseline] (28.892 ms) : 0, 28892
AgentMeter [candidate] (29.215 ms) : 0, 29215
GlobalTracer [baseline] (257.129 ms) : 0, 257129
GlobalTracer [candidate] (259.554 ms) : 0, 259554
AppSec [baseline] (32.866 ms) : 0, 32866
AppSec [candidate] (33.109 ms) : 0, 33109
Debugger [baseline] (61.471 ms) : 0, 61471
Debugger [candidate] (63.117 ms) : 0, 63117
Remote Config [baseline] (622.147 µs) : 0, 622
Remote Config [candidate] (618.997 µs) : 0, 619
Telemetry [baseline] (12.262 ms) : 0, 12262
Telemetry [candidate] (12.338 ms) : 0, 12338
Flare Poller [baseline] (6.074 ms) : 0, 6074
Flare Poller [candidate] (4.547 ms) : 0, 4547
section appsec
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (666.63 ms) : 0, 666630
BytebuddyAgent [candidate] (657.61 ms) : 0, 657610
AgentMeter [baseline] (12.11 ms) : 0, 12110
AgentMeter [candidate] (11.909 ms) : 0, 11909
GlobalTracer [baseline] (260.659 ms) : 0, 260659
GlobalTracer [candidate] (257.887 ms) : 0, 257887
AppSec [baseline] (169.105 ms) : 0, 169105
AppSec [candidate] (167.659 ms) : 0, 167659
Debugger [baseline] (68.129 ms) : 0, 68129
Debugger [candidate] (67.709 ms) : 0, 67709
Remote Config [baseline] (698.882 µs) : 0, 699
Remote Config [candidate] (651.384 µs) : 0, 651
Telemetry [baseline] (9.9 ms) : 0, 9900
Telemetry [candidate] (9.816 ms) : 0, 9816
Flare Poller [baseline] (3.815 ms) : 0, 3815
Flare Poller [candidate] (3.768 ms) : 0, 3768
IAST [baseline] (25.678 ms) : 0, 25678
IAST [candidate] (25.065 ms) : 0, 25065
section iast
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (797.265 ms) : 0, 797265
BytebuddyAgent [candidate] (797.079 ms) : 0, 797079
AgentMeter [baseline] (11.337 ms) : 0, 11337
AgentMeter [candidate] (11.232 ms) : 0, 11232
GlobalTracer [baseline] (249.906 ms) : 0, 249906
GlobalTracer [candidate] (248.873 ms) : 0, 248873
AppSec [baseline] (33.783 ms) : 0, 33783
AppSec [candidate] (33.783 ms) : 0, 33783
Debugger [baseline] (67.25 ms) : 0, 67250
Debugger [candidate] (67.191 ms) : 0, 67191
Remote Config [baseline] (543.953 µs) : 0, 544
Remote Config [candidate] (553.246 µs) : 0, 553
Telemetry [baseline] (8.695 ms) : 0, 8695
Telemetry [candidate] (8.591 ms) : 0, 8591
Flare Poller [baseline] (3.557 ms) : 0, 3557
Flare Poller [candidate] (3.48 ms) : 0, 3480
IAST [baseline] (27.189 ms) : 0, 27189
IAST [candidate] (27.011 ms) : 0, 27011
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (681.263 ms) : 0, 681263
BytebuddyAgent [candidate] (681.978 ms) : 0, 681978
AgentMeter [baseline] (8.661 ms) : 0, 8661
AgentMeter [candidate] (8.624 ms) : 0, 8624
GlobalTracer [baseline] (215.524 ms) : 0, 215524
GlobalTracer [candidate] (215.815 ms) : 0, 215815
AppSec [baseline] (32.656 ms) : 0, 32656
AppSec [candidate] (32.441 ms) : 0, 32441
Debugger [baseline] (67.221 ms) : 0, 67221
Debugger [candidate] (67.028 ms) : 0, 67028
Remote Config [baseline] (620.874 µs) : 0, 621
Remote Config [candidate] (626.922 µs) : 0, 627
Telemetry [baseline] (8.843 ms) : 0, 8843
Telemetry [candidate] (9.008 ms) : 0, 9008
Flare Poller [baseline] (3.717 ms) : 0, 3717
Flare Poller [candidate] (3.761 ms) : 0, 3761
ProfilingAgent [baseline] (98.788 ms) : 0, 98788
ProfilingAgent [candidate] (99.341 ms) : 0, 99341
Profiling [baseline] (99.356 ms) : 0, 99356
Profiling [candidate] (99.91 ms) : 0, 99910
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section baseline
no_agent (1.182 ms) : 1170, 1193
. : milestone, 1182,
iast (3.1 ms) : 3058, 3142
. : milestone, 3100,
iast_FULL (5.7 ms) : 5643, 5757
. : milestone, 5700,
iast_GLOBAL (3.558 ms) : 3510, 3606
. : milestone, 3558,
profiling (1.944 ms) : 1927, 1961
. : milestone, 1944,
tracing (1.77 ms) : 1756, 1784
. : milestone, 1770,
section candidate
no_agent (1.184 ms) : 1173, 1195
. : milestone, 1184,
iast (3.166 ms) : 3124, 3208
. : milestone, 3166,
iast_FULL (5.883 ms) : 5823, 5943
. : milestone, 5883,
iast_GLOBAL (3.453 ms) : 3405, 3500
. : milestone, 3453,
profiling (1.915 ms) : 1898, 1931
. : milestone, 1915,
tracing (1.787 ms) : 1772, 1802
. : milestone, 1787,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section baseline
no_agent (19.198 ms) : 19000, 19396
. : milestone, 19198,
appsec (18.463 ms) : 18272, 18654
. : milestone, 18463,
code_origins (17.799 ms) : 17621, 17978
. : milestone, 17799,
iast (17.836 ms) : 17659, 18014
. : milestone, 17836,
profiling (18.598 ms) : 18411, 18784
. : milestone, 18598,
tracing (17.395 ms) : 17222, 17569
. : milestone, 17395,
section candidate
no_agent (17.788 ms) : 17607, 17969
. : milestone, 17788,
appsec (18.569 ms) : 18383, 18755
. : milestone, 18569,
code_origins (17.475 ms) : 17305, 17646
. : milestone, 17475,
iast (17.535 ms) : 17359, 17711
. : milestone, 17535,
profiling (18.786 ms) : 18599, 18974
. : milestone, 18786,
tracing (18.386 ms) : 18201, 18571
. : milestone, 18386,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section baseline
no_agent (14.835 s) : 14835000, 14835000
. : milestone, 14835000,
appsec (14.745 s) : 14745000, 14745000
. : milestone, 14745000,
iast (17.974 s) : 17974000, 17974000
. : milestone, 17974000,
iast_GLOBAL (17.916 s) : 17916000, 17916000
. : milestone, 17916000,
profiling (15.158 s) : 15158000, 15158000
. : milestone, 15158000,
tracing (14.694 s) : 14694000, 14694000
. : milestone, 14694000,
section candidate
no_agent (15.332 s) : 15332000, 15332000
. : milestone, 15332000,
appsec (14.765 s) : 14765000, 14765000
. : milestone, 14765000,
iast (18.6 s) : 18600000, 18600000
. : milestone, 18600000,
iast_GLOBAL (17.889 s) : 17889000, 17889000
. : milestone, 17889000,
profiling (15.238 s) : 15238000, 15238000
. : milestone, 15238000,
tracing (14.87 s) : 14870000, 14870000
. : milestone, 14870000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~89f0807781, baseline=1.60.0-SNAPSHOT~d6880f7801
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (3.782 ms) : 3561, 4003
. : milestone, 3782,
iast (2.259 ms) : 2189, 2328
. : milestone, 2259,
iast_GLOBAL (2.294 ms) : 2225, 2364
. : milestone, 2294,
profiling (2.114 ms) : 2057, 2171
. : milestone, 2114,
tracing (2.073 ms) : 2019, 2126
. : milestone, 2073,
section candidate
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (3.739 ms) : 3523, 3955
. : milestone, 3739,
iast (2.27 ms) : 2201, 2340
. : milestone, 2270,
iast_GLOBAL (2.303 ms) : 2234, 2373
. : milestone, 2303,
profiling (2.112 ms) : 2055, 2170
. : milestone, 2112,
tracing (2.064 ms) : 2011, 2118
. : milestone, 2064,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
TODO, DO NOT MERGE
Motivation
Additional Notes