-
Notifications
You must be signed in to change notification settings - Fork 323
Revert pin-system-tests workflow and add print job #10306
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
PerfectSlayer
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Let's wait for the next release and see why it's skipped
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.082 s) : 0, 1081566
Total [baseline] (8.683 s) : 0, 8683088
Agent [candidate] (1.083 s) : 0, 1082535
Total [candidate] (8.713 s) : 0, 8713034
section iast
Agent [baseline] (1.219 s) : 0, 1219096
Total [baseline] (9.294 s) : 0, 9293610
Agent [candidate] (1.229 s) : 0, 1228785
Total [candidate] (9.354 s) : 0, 9354192
gantt
title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (650.195 ms) : 0, 650195
BytebuddyAgent [candidate] (650.402 ms) : 0, 650402
GlobalTracer [baseline] (281.798 ms) : 0, 281798
GlobalTracer [candidate] (282.35 ms) : 0, 282350
AppSec [baseline] (32.474 ms) : 0, 32474
AppSec [candidate] (32.515 ms) : 0, 32515
Debugger [baseline] (67.203 ms) : 0, 67203
Debugger [candidate] (67.357 ms) : 0, 67357
Remote Config [baseline] (629.599 µs) : 0, 630
Remote Config [candidate] (633.322 µs) : 0, 633
Telemetry [baseline] (8.981 ms) : 0, 8981
Telemetry [candidate] (8.916 ms) : 0, 8916
Flare Poller [baseline] (3.683 ms) : 0, 3683
Flare Poller [candidate] (3.706 ms) : 0, 3706
section iast
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (788.95 ms) : 0, 788950
BytebuddyAgent [candidate] (795.923 ms) : 0, 795923
GlobalTracer [baseline] (255.097 ms) : 0, 255097
GlobalTracer [candidate] (257.043 ms) : 0, 257043
AppSec [baseline] (34.313 ms) : 0, 34313
AppSec [candidate] (32.925 ms) : 0, 32925
Debugger [baseline] (64.88 ms) : 0, 64880
Debugger [candidate] (66.405 ms) : 0, 66405
Remote Config [baseline] (585.169 µs) : 0, 585
Remote Config [candidate] (573.793 µs) : 0, 574
Telemetry [baseline] (8.461 ms) : 0, 8461
Telemetry [candidate] (8.492 ms) : 0, 8492
Flare Poller [baseline] (3.538 ms) : 0, 3538
Flare Poller [candidate] (3.584 ms) : 0, 3584
IAST [baseline] (26.772 ms) : 0, 26772
IAST [candidate] (27.181 ms) : 0, 27181
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085373
Total [baseline] (10.91 s) : 0, 10909862
Agent [candidate] (1.086 s) : 0, 1085860
Total [candidate] (10.857 s) : 0, 10857327
section appsec
Agent [baseline] (1.263 s) : 0, 1263284
Total [baseline] (10.852 s) : 0, 10852365
Agent [candidate] (1.265 s) : 0, 1265115
Total [candidate] (10.981 s) : 0, 10980698
section iast
Agent [baseline] (1.219 s) : 0, 1219150
Total [baseline] (11.118 s) : 0, 11118271
Agent [candidate] (1.221 s) : 0, 1221021
Total [candidate] (11.177 s) : 0, 11176751
section profiling
Agent [baseline] (1.204 s) : 0, 1204402
Total [baseline] (11.084 s) : 0, 11084481
Agent [candidate] (1.205 s) : 0, 1205281
Total [candidate] (10.997 s) : 0, 10996569
gantt
title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (651.652 ms) : 0, 651652
BytebuddyAgent [candidate] (652.032 ms) : 0, 652032
GlobalTracer [baseline] (282.576 ms) : 0, 282576
GlobalTracer [candidate] (283.167 ms) : 0, 283167
AppSec [baseline] (32.655 ms) : 0, 32655
AppSec [candidate] (32.561 ms) : 0, 32561
Debugger [baseline] (68.507 ms) : 0, 68507
Debugger [candidate] (68.062 ms) : 0, 68062
Remote Config [baseline] (613.778 µs) : 0, 614
Remote Config [candidate] (626.827 µs) : 0, 627
Telemetry [baseline] (9.057 ms) : 0, 9057
Telemetry [candidate] (8.963 ms) : 0, 8963
Flare Poller [baseline] (3.707 ms) : 0, 3707
Flare Poller [candidate] (3.706 ms) : 0, 3706
section appsec
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (689.46 ms) : 0, 689460
BytebuddyAgent [candidate] (691.695 ms) : 0, 691695
GlobalTracer [baseline] (257.419 ms) : 0, 257419
GlobalTracer [candidate] (257.678 ms) : 0, 257678
AppSec [baseline] (173.672 ms) : 0, 173672
AppSec [candidate] (173.013 ms) : 0, 173013
Debugger [baseline] (67.683 ms) : 0, 67683
Debugger [candidate] (67.572 ms) : 0, 67572
Remote Config [baseline] (747.498 µs) : 0, 747
Remote Config [candidate] (769.803 µs) : 0, 770
Telemetry [baseline] (9.486 ms) : 0, 9486
Telemetry [candidate] (9.489 ms) : 0, 9489
Flare Poller [baseline] (3.812 ms) : 0, 3812
Flare Poller [candidate] (3.806 ms) : 0, 3806
IAST [baseline] (24.476 ms) : 0, 24476
IAST [candidate] (24.474 ms) : 0, 24474
section iast
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.171 ms) : 0, 1171
BytebuddyAgent [baseline] (788.322 ms) : 0, 788322
BytebuddyAgent [candidate] (789.17 ms) : 0, 789170
GlobalTracer [baseline] (255.106 ms) : 0, 255106
GlobalTracer [candidate] (255.948 ms) : 0, 255948
AppSec [baseline] (34.691 ms) : 0, 34691
AppSec [candidate] (34.34 ms) : 0, 34340
Debugger [baseline] (65.162 ms) : 0, 65162
Debugger [candidate] (65.614 ms) : 0, 65614
Remote Config [baseline] (559.647 µs) : 0, 560
Remote Config [candidate] (571.866 µs) : 0, 572
Telemetry [baseline] (8.351 ms) : 0, 8351
Telemetry [candidate] (8.44 ms) : 0, 8440
Flare Poller [baseline] (3.559 ms) : 0, 3559
Flare Poller [candidate] (3.553 ms) : 0, 3553
IAST [baseline] (26.95 ms) : 0, 26950
IAST [candidate] (26.932 ms) : 0, 26932
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (700.875 ms) : 0, 700875
BytebuddyAgent [candidate] (702.063 ms) : 0, 702063
GlobalTracer [baseline] (221.171 ms) : 0, 221171
GlobalTracer [candidate] (220.494 ms) : 0, 220494
AppSec [baseline] (32.325 ms) : 0, 32325
AppSec [candidate] (32.049 ms) : 0, 32049
Debugger [baseline] (68.653 ms) : 0, 68653
Debugger [candidate] (68.567 ms) : 0, 68567
Remote Config [baseline] (637.835 µs) : 0, 638
Remote Config [candidate] (644.126 µs) : 0, 644
Telemetry [baseline] (8.763 ms) : 0, 8763
Telemetry [candidate] (8.77 ms) : 0, 8770
Flare Poller [baseline] (3.7 ms) : 0, 3700
Flare Poller [candidate] (3.688 ms) : 0, 3688
ProfilingAgent [baseline] (97.446 ms) : 0, 97446
ProfilingAgent [candidate] (98.075 ms) : 0, 98075
Profiling [baseline] (98.031 ms) : 0, 98031
Profiling [candidate] (98.674 ms) : 0, 98674
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section baseline
no_agent (18.017 ms) : 17831, 18202
. : milestone, 18017,
appsec (18.6 ms) : 18411, 18789
. : milestone, 18600,
code_origins (17.868 ms) : 17689, 18048
. : milestone, 17868,
iast (18.016 ms) : 17835, 18197
. : milestone, 18016,
profiling (19.215 ms) : 19022, 19407
. : milestone, 19215,
tracing (17.77 ms) : 17596, 17944
. : milestone, 17770,
section candidate
no_agent (19.328 ms) : 19128, 19528
. : milestone, 19328,
appsec (18.341 ms) : 18155, 18527
. : milestone, 18341,
code_origins (17.855 ms) : 17681, 18029
. : milestone, 17855,
iast (17.914 ms) : 17737, 18091
. : milestone, 17914,
profiling (18.937 ms) : 18750, 19125
. : milestone, 18937,
tracing (17.867 ms) : 17689, 18045
. : milestone, 17867,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section baseline
no_agent (1.178 ms) : 1166, 1189
. : milestone, 1178,
iast (3.2 ms) : 3155, 3244
. : milestone, 3200,
iast_FULL (5.957 ms) : 5898, 6017
. : milestone, 5957,
iast_GLOBAL (3.438 ms) : 3390, 3486
. : milestone, 3438,
profiling (2.034 ms) : 2016, 2052
. : milestone, 2034,
tracing (1.796 ms) : 1781, 1811
. : milestone, 1796,
section candidate
no_agent (1.172 ms) : 1160, 1183
. : milestone, 1172,
iast (3.089 ms) : 3056, 3122
. : milestone, 3089,
iast_FULL (5.665 ms) : 5609, 5721
. : milestone, 5665,
iast_GLOBAL (3.542 ms) : 3490, 3595
. : milestone, 3542,
profiling (1.919 ms) : 1904, 1935
. : milestone, 1919,
tracing (1.816 ms) : 1799, 1832
. : milestone, 1816,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.45 ms) : 2398, 2502
. : milestone, 2450,
iast (2.207 ms) : 2142, 2271
. : milestone, 2207,
iast_GLOBAL (2.246 ms) : 2181, 2310
. : milestone, 2246,
profiling (2.085 ms) : 2031, 2140
. : milestone, 2085,
tracing (2.045 ms) : 1994, 2096
. : milestone, 2045,
section candidate
no_agent (1.469 ms) : 1457, 1480
. : milestone, 1469,
appsec (3.72 ms) : 3501, 3940
. : milestone, 3720,
iast (2.207 ms) : 2142, 2272
. : milestone, 2207,
iast_GLOBAL (2.253 ms) : 2188, 2318
. : milestone, 2253,
profiling (2.461 ms) : 2307, 2615
. : milestone, 2461,
tracing (2.051 ms) : 1999, 2102
. : milestone, 2051,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~1d30ce2a2f, baseline=1.59.0-SNAPSHOT~740201a597
dateFormat X
axisFormat %s
section baseline
no_agent (15.007 s) : 15007000, 15007000
. : milestone, 15007000,
appsec (14.762 s) : 14762000, 14762000
. : milestone, 14762000,
iast (18.333 s) : 18333000, 18333000
. : milestone, 18333000,
iast_GLOBAL (18.064 s) : 18064000, 18064000
. : milestone, 18064000,
profiling (14.674 s) : 14674000, 14674000
. : milestone, 14674000,
tracing (14.722 s) : 14722000, 14722000
. : milestone, 14722000,
section candidate
no_agent (14.965 s) : 14965000, 14965000
. : milestone, 14965000,
appsec (14.842 s) : 14842000, 14842000
. : milestone, 14842000,
iast (18.309 s) : 18309000, 18309000
. : milestone, 18309000,
iast_GLOBAL (17.89 s) : 17890000, 17890000
. : milestone, 17890000,
profiling (14.786 s) : 14786000, 14786000
. : milestone, 14786000,
tracing (14.887 s) : 14887000, 14887000
. : milestone, 14887000,
|
What Does This Do
Revert
pin-system-testsworkflow from #10297 to usereleasebranches again.Also separate the
github.refprinting to a separate job before theif:check.Motivation
In the future, if the job is again skipped for a release, we'll be able to see the
github.refthat triggered the workflow.Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any useful labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]