[DJM-0000] Debug Databricks #10328

charlesmyu · 2026-01-09T19:41:17Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2026-01-09T21:00:05Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/debug-databricks-job-id
git_commit_date	1767984400	1768230209
git_commit_sha	`6d2b809`	`e2e4a66`
release_version	1.59.0-SNAPSHOT~6d2b809818	1.59.0-SNAPSHOT~e2e4a66b9d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768232072	1768232072
ci_job_id	1343296038	1343296038
ci_pipeline_id	90211302	90211302
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-jlmsmjbf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-jlmsmjbf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1082675
Total [baseline] (8.747 s) : 0, 8746808
Agent [candidate] (1.092 s) : 0, 1092246
Total [candidate] (8.769 s) : 0, 8769370
section iast
Agent [baseline] (1.22 s) : 0, 1219556
Total [baseline] (9.318 s) : 0, 9317651
Agent [candidate] (1.222 s) : 0, 1222423
Total [candidate] (9.3 s) : 0, 9299964

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.083 s	-
Agent	iast	1.22 s	136.881 ms (12.6%)
Total	tracing	8.747 s	-
Total	iast	9.318 s	570.844 ms (6.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.092 s	-
Agent	iast	1.222 s	130.177 ms (11.9%)
Total	tracing	8.769 s	-
Total	iast	9.3 s	530.594 ms (6.1%)

gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (650.793 ms) : 0, 650793
BytebuddyAgent [candidate] (657.931 ms) : 0, 657931
GlobalTracer [baseline] (281.924 ms) : 0, 281924
GlobalTracer [candidate] (283.734 ms) : 0, 283734
AppSec [baseline] (32.535 ms) : 0, 32535
AppSec [candidate] (32.942 ms) : 0, 32942
Debugger [baseline] (67.312 ms) : 0, 67312
Debugger [candidate] (67.307 ms) : 0, 67307
Remote Config [baseline] (644.218 µs) : 0, 644
Remote Config [candidate] (639.346 µs) : 0, 639
Telemetry [baseline] (8.975 ms) : 0, 8975
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (3.717 ms) : 0, 3717
Flare Poller [candidate] (3.679 ms) : 0, 3679
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (788.673 ms) : 0, 788673
BytebuddyAgent [candidate] (790.069 ms) : 0, 790069
GlobalTracer [baseline] (255.465 ms) : 0, 255465
GlobalTracer [candidate] (255.314 ms) : 0, 255314
IAST [baseline] (26.923 ms) : 0, 26923
IAST [candidate] (27.139 ms) : 0, 27139
AppSec [baseline] (31.742 ms) : 0, 31742
AppSec [candidate] (35.477 ms) : 0, 35477
Debugger [baseline] (67.674 ms) : 0, 67674
Debugger [candidate] (64.977 ms) : 0, 64977
Remote Config [baseline] (606.807 µs) : 0, 607
Remote Config [candidate] (585.958 µs) : 0, 586
Telemetry [baseline] (8.368 ms) : 0, 8368
Telemetry [candidate] (8.624 ms) : 0, 8624
Flare Poller [baseline] (3.505 ms) : 0, 3505
Flare Poller [candidate] (3.585 ms) : 0, 3585

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1093095
Total [baseline] (10.839 s) : 0, 10838573
Agent [candidate] (1.099 s) : 0, 1099186
Total [candidate] (10.879 s) : 0, 10879294
section appsec
Agent [baseline] (1.266 s) : 0, 1265696
Total [baseline] (10.906 s) : 0, 10906184
Agent [candidate] (1.266 s) : 0, 1266340
Total [candidate] (10.93 s) : 0, 10930098
section iast
Agent [baseline] (1.229 s) : 0, 1229314
Total [baseline] (11.199 s) : 0, 11198515
Agent [candidate] (1.234 s) : 0, 1233879
Total [candidate] (11.206 s) : 0, 11206120
section profiling
Agent [baseline] (1.206 s) : 0, 1206067
Total [baseline] (11.017 s) : 0, 11017044
Agent [candidate] (1.214 s) : 0, 1213544
Total [candidate] (11.02 s) : 0, 11019784

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.093 s	-
Agent	appsec	1.266 s	172.602 ms (15.8%)
Agent	iast	1.229 s	136.219 ms (12.5%)
Agent	profiling	1.206 s	112.972 ms (10.3%)
Total	tracing	10.839 s	-
Total	appsec	10.906 s	67.611 ms (0.6%)
Total	iast	11.199 s	359.943 ms (3.3%)
Total	profiling	11.017 s	178.471 ms (1.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.099 s	-
Agent	appsec	1.266 s	167.153 ms (15.2%)
Agent	iast	1.234 s	134.692 ms (12.3%)
Agent	profiling	1.214 s	114.358 ms (10.4%)
Total	tracing	10.879 s	-
Total	appsec	10.93 s	50.804 ms (0.5%)
Total	iast	11.206 s	326.826 ms (3.0%)
Total	profiling	11.02 s	140.49 ms (1.3%)

gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (656.407 ms) : 0, 656407
BytebuddyAgent [candidate] (660.993 ms) : 0, 660993
GlobalTracer [baseline] (284.524 ms) : 0, 284524
GlobalTracer [candidate] (285.916 ms) : 0, 285916
AppSec [baseline] (32.91 ms) : 0, 32910
AppSec [candidate] (33.114 ms) : 0, 33114
Debugger [baseline] (67.984 ms) : 0, 67984
Debugger [candidate] (68.683 ms) : 0, 68683
Remote Config [baseline] (619.285 µs) : 0, 619
Remote Config [candidate] (615.069 µs) : 0, 615
Telemetry [baseline] (9.063 ms) : 0, 9063
Telemetry [candidate] (8.989 ms) : 0, 8989
Flare Poller [baseline] (4.61 ms) : 0, 4610
Flare Poller [candidate] (3.768 ms) : 0, 3768
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (691.069 ms) : 0, 691069
BytebuddyAgent [candidate] (691.936 ms) : 0, 691936
GlobalTracer [baseline] (257.964 ms) : 0, 257964
GlobalTracer [candidate] (258.244 ms) : 0, 258244
IAST [baseline] (24.649 ms) : 0, 24649
IAST [candidate] (24.606 ms) : 0, 24606
AppSec [baseline] (173.313 ms) : 0, 173313
AppSec [candidate] (173.418 ms) : 0, 173418
Debugger [baseline] (67.89 ms) : 0, 67890
Debugger [candidate] (67.383 ms) : 0, 67383
Remote Config [baseline] (768.826 µs) : 0, 769
Remote Config [candidate] (815.102 µs) : 0, 815
Telemetry [baseline] (9.521 ms) : 0, 9521
Telemetry [candidate] (9.5 ms) : 0, 9500
Flare Poller [baseline] (3.87 ms) : 0, 3870
Flare Poller [candidate] (3.738 ms) : 0, 3738
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (793.969 ms) : 0, 793969
BytebuddyAgent [candidate] (797.336 ms) : 0, 797336
GlobalTracer [baseline] (257.899 ms) : 0, 257899
GlobalTracer [candidate] (258.86 ms) : 0, 258860
IAST [baseline] (27.266 ms) : 0, 27266
IAST [candidate] (27.429 ms) : 0, 27429
AppSec [baseline] (33.625 ms) : 0, 33625
AppSec [candidate] (35.01 ms) : 0, 35010
Debugger [baseline] (67.112 ms) : 0, 67112
Debugger [candidate] (65.912 ms) : 0, 65912
Remote Config [baseline] (562.504 µs) : 0, 563
Remote Config [candidate] (602.856 µs) : 0, 603
Telemetry [baseline] (8.591 ms) : 0, 8591
Telemetry [candidate] (8.456 ms) : 0, 8456
Flare Poller [baseline] (3.555 ms) : 0, 3555
Flare Poller [candidate] (3.487 ms) : 0, 3487
section profiling
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.245 ms) : 0, 1245
BytebuddyAgent [baseline] (703.023 ms) : 0, 703023
BytebuddyAgent [candidate] (707.946 ms) : 0, 707946
GlobalTracer [baseline] (220.506 ms) : 0, 220506
GlobalTracer [candidate] (221.886 ms) : 0, 221886
AppSec [baseline] (32.303 ms) : 0, 32303
AppSec [candidate] (32.469 ms) : 0, 32469
Debugger [baseline] (68.302 ms) : 0, 68302
Debugger [candidate] (68.236 ms) : 0, 68236
Remote Config [baseline] (622.577 µs) : 0, 623
Remote Config [candidate] (619.09 µs) : 0, 619
Telemetry [baseline] (8.832 ms) : 0, 8832
Telemetry [candidate] (8.877 ms) : 0, 8877
Flare Poller [baseline] (3.632 ms) : 0, 3632
Flare Poller [candidate] (3.676 ms) : 0, 3676
ProfilingAgent [baseline] (97.653 ms) : 0, 97653
ProfilingAgent [candidate] (98.302 ms) : 0, 98302
Profiling [baseline] (98.239 ms) : 0, 98239
Profiling [candidate] (98.893 ms) : 0, 98893

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/debug-databricks-job-id
git_commit_date	1767984400	1768230209
git_commit_sha	`6d2b809`	`e2e4a66`
release_version	1.59.0-SNAPSHOT~6d2b809818	1.59.0-SNAPSHOT~e2e4a66b9d

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768232570	1768232570
ci_job_id	1343296040	1343296040
ci_pipeline_id	90211302	90211302
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8lgvs8us 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8lgvs8us 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 17 performance regressions! Performance is the same for 3 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+664.411µs; +765.491µs] or [+23.283%; +26.825%]	worse [+1.472ms; +1.888ms] or [+18.216%; +23.360%]	unstable [-327.747op/s; -87.378op/s] or [-25.913%; -6.909%]	3.569ms	9.763ms	1057.219op/s	2.854ms	8.083ms	1264.781op/s
scenario:load:insecure-bank:tracing:high_load	worse [+532.587µs; +603.297µs] or [+35.657%; +40.391%]	unstable [+0.650ms; +1.372ms] or [+15.736%; +33.196%]	unstable [-851.714op/s; -355.786op/s] or [-33.910%; -14.165%]	2.062ms	5.145ms	1907.906op/s	1.494ms	4.134ms	2511.656op/s
scenario:load:insecure-bank:profiling:high_load	worse [+0.986ms; +1.087ms] or [+60.804%; +67.086%]	unstable [+2.751ms; +3.443ms] or [+59.679%; +74.692%]	unstable [-1105.510op/s; -695.427op/s] or [-48.926%; -30.777%]	2.658ms	7.706ms	1359.094op/s	1.621ms	4.609ms	2259.562op/s
scenario:load:insecure-bank:iast:high_load	worse [+717.924µs; +802.096µs] or [+28.548%; +31.895%]	worse [+1.665ms; +2.110ms] or [+22.385%; +28.375%]	unstable [-395.396op/s; -126.979op/s] or [-27.979%; -8.985%]	3.275ms	9.325ms	1152.000op/s	2.515ms	7.438ms	1413.188op/s
scenario:load:insecure-bank:iast_FULL:high_load	unstable [-2.770ms; -2.220ms] or [-53.856%; -43.159%]	worse [+10.032ms; +10.823ms] or [+80.846%; +87.220%]	unstable [-181.197op/s; -33.116op/s] or [-22.835%; -4.173%]	2.649ms	22.837ms	686.344op/s	5.144ms	12.409ms	793.500op/s
scenario:load:petclinic:code_origins:high_load	worse [+0.897ms; +1.635ms] or [+5.109%; +9.316%]	worse [+0.593ms; +2.022ms] or [+2.036%; +6.944%]	unstable [-43.143op/s; +8.455op/s] or [-16.558%; +3.245%]	18.821ms	30.428ms	243.219op/s	17.555ms	29.121ms	260.562op/s
scenario:load:petclinic:appsec:high_load	worse [+0.997ms; +1.878ms] or [+5.407%; +10.181%]	worse [+0.974ms; +2.685ms] or [+3.253%; +8.973%]	unstable [-42.613op/s; +6.675op/s] or [-17.062%; +2.673%]	19.881ms	31.759ms	231.781op/s	18.444ms	29.929ms	249.750op/s
scenario:load:petclinic:iast:high_load	worse [+1.149ms; +1.767ms] or [+6.678%; +10.265%]	worse [+1.316ms; +2.287ms] or [+4.650%; +8.081%]	unstable [-45.432op/s; +6.870op/s] or [-17.128%; +2.590%]	18.668ms	30.106ms	245.969op/s	17.210ms	28.305ms	265.250op/s
scenario:load:petclinic:profiling:high_load	worse [+1.057ms; +1.553ms] or [+5.734%; +8.423%]	worse [+1.131ms; +2.508ms] or [+3.793%; +8.411%]	unstable [-41.758op/s; +7.320op/s] or [-16.728%; +2.933%]	19.738ms	31.638ms	232.406op/s	18.433ms	29.818ms	249.625op/s
scenario:load:petclinic:tracing:high_load	worse [+549.758µs; +1059.247µs] or [+3.116%; +6.004%]	worse [+1.003ms; +1.814ms] or [+3.486%; +6.305%]	unstable [-38.173op/s; +13.173op/s] or [-14.689%; +5.069%]	18.448ms	30.184ms	247.375op/s	17.644ms	28.775ms	259.875op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.237 ms) : 3199, 3275
.   : milestone, 3237,
iast_FULL (5.827 ms) : 5768, 5885
.   : milestone, 5827,
iast_GLOBAL (3.626 ms) : 3573, 3679
.   : milestone, 3626,
profiling (1.998 ms) : 1981, 2015
.   : milestone, 1998,
tracing (1.789 ms) : 1774, 1804
.   : milestone, 1789,
section candidate
no_agent (1.174 ms) : 1163, 1186
.   : milestone, 1174,
iast (3.988 ms) : 3945, 4031
.   : milestone, 3988,
iast_FULL (6.749 ms) : 6613, 6886
.   : milestone, 6749,
iast_GLOBAL (4.353 ms) : 4302, 4403
.   : milestone, 4353,
profiling (3.369 ms) : 3339, 3400
.   : milestone, 3369,
tracing (2.379 ms) : 2362, 2396
.   : milestone, 2379,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.181 ms [1.169 ms, 1.192 ms]	-
iast	3.237 ms [3.199 ms, 3.275 ms]	2.056 ms (174.1%)
iast_FULL	5.827 ms [5.768 ms, 5.885 ms]	4.646 ms (393.5%)
iast_GLOBAL	3.626 ms [3.573 ms, 3.679 ms]	2.445 ms (207.1%)
profiling	1.998 ms [1.981 ms, 2.015 ms]	816.749 µs (69.2%)
tracing	1.789 ms [1.774 ms, 1.804 ms]	608.053 µs (51.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.174 ms [1.163 ms, 1.186 ms]	-
iast	3.988 ms [3.945 ms, 4.031 ms]	2.814 ms (239.6%)
iast_FULL	6.749 ms [6.613 ms, 6.886 ms]	5.575 ms (474.7%)
iast_GLOBAL	4.353 ms [4.302 ms, 4.403 ms]	3.178 ms (270.6%)
profiling	3.369 ms [3.339 ms, 3.4 ms]	2.195 ms (186.9%)
tracing	2.379 ms [2.362 ms, 2.396 ms]	1.204 ms (102.5%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.766 ms) : 19558, 19973
.   : milestone, 19766,
appsec (18.686 ms) : 18496, 18875
.   : milestone, 18686,
code_origins (17.903 ms) : 17721, 18085
.   : milestone, 17903,
iast (17.59 ms) : 17417, 17763
.   : milestone, 17590,
profiling (18.695 ms) : 18508, 18882
.   : milestone, 18695,
tracing (17.957 ms) : 17781, 18133
.   : milestone, 17957,
section candidate
no_agent (19.206 ms) : 19009, 19403
.   : milestone, 19206,
appsec (20.141 ms) : 19937, 20344
.   : milestone, 20141,
code_origins (19.189 ms) : 18996, 19382
.   : milestone, 19189,
iast (18.972 ms) : 18782, 19163
.   : milestone, 18972,
profiling (20.085 ms) : 19884, 20286
.   : milestone, 20085,
tracing (18.864 ms) : 18675, 19054
.   : milestone, 18864,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.766 ms [19.558 ms, 19.973 ms]	-
appsec	18.686 ms [18.496 ms, 18.875 ms]	-1.08 ms (-5.5%)
code_origins	17.903 ms [17.721 ms, 18.085 ms]	-1.863 ms (-9.4%)
iast	17.59 ms [17.417 ms, 17.763 ms]	-2.176 ms (-11.0%)
profiling	18.695 ms [18.508 ms, 18.882 ms]	-1.071 ms (-5.4%)
tracing	17.957 ms [17.781 ms, 18.133 ms]	-1.809 ms (-9.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.206 ms [19.009 ms, 19.403 ms]	-
appsec	20.141 ms [19.937 ms, 20.344 ms]	935.126 µs (4.9%)
code_origins	19.189 ms [18.996 ms, 19.382 ms]	-16.61 µs (-0.1%)
iast	18.972 ms [18.782 ms, 19.163 ms]	-233.197 µs (-1.2%)
profiling	20.085 ms [19.884 ms, 20.286 ms]	879.436 µs (4.6%)
tracing	18.864 ms [18.675 ms, 19.054 ms]	-341.516 µs (-1.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/debug-databricks-job-id
git_commit_date	1767984400	1768230209
git_commit_sha	`6d2b809`	`e2e4a66`
release_version	1.59.0-SNAPSHOT~6d2b809818	1.59.0-SNAPSHOT~e2e4a66b9d

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1768232364	1768232364
ci_job_id	1343296042	1343296042
ci_pipeline_id	90211302	90211302
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-gwx2a6nt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-gwx2a6nt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 4 performance regressions! Performance is the same for 7 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.225ms; -0.880ms] or [-32.887%; -23.628%]	2.672ms	3.725ms
scenario:dacapo:tomcat:iast	worse [+156.275µs; +295.311µs] or [+7.070%; +13.361%]	2.436ms	2.210ms
scenario:dacapo:tomcat:iast_GLOBAL	worse [+151.134µs; +291.435µs] or [+6.710%; +12.939%]	2.474ms	2.252ms
scenario:dacapo:tomcat:profiling	worse [+162.335µs; +278.648µs] or [+7.768%; +13.335%]	2.310ms	2.090ms
scenario:dacapo:tomcat:tracing	worse [+169.730µs; +280.176µs] or [+8.326%; +13.744%]	2.263ms	2.038ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.725 ms) : 3505, 3945
.   : milestone, 3725,
iast (2.21 ms) : 2146, 2275
.   : milestone, 2210,
iast_GLOBAL (2.252 ms) : 2187, 2317
.   : milestone, 2252,
profiling (2.09 ms) : 2035, 2144
.   : milestone, 2090,
tracing (2.038 ms) : 1988, 2089
.   : milestone, 2038,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.672 ms) : 2619, 2726
.   : milestone, 2672,
iast (2.436 ms) : 2371, 2501
.   : milestone, 2436,
iast_GLOBAL (2.474 ms) : 2408, 2539
.   : milestone, 2474,
profiling (2.31 ms) : 2256, 2364
.   : milestone, 2310,
tracing (2.263 ms) : 2212, 2315
.   : milestone, 2263,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	3.725 ms [3.505 ms, 3.945 ms]	2.254 ms (153.1%)
iast	2.21 ms [2.146 ms, 2.275 ms]	738.765 µs (50.2%)
iast_GLOBAL	2.252 ms [2.187 ms, 2.317 ms]	780.87 µs (53.1%)
profiling	2.09 ms [2.035 ms, 2.144 ms]	618.207 µs (42.0%)
tracing	2.038 ms [1.988 ms, 2.089 ms]	567.018 µs (38.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	2.672 ms [2.619 ms, 2.726 ms]	1.201 ms (81.6%)
iast	2.436 ms [2.371 ms, 2.501 ms]	964.567 µs (65.6%)
iast_GLOBAL	2.474 ms [2.408 ms, 2.539 ms]	1.002 ms (68.1%)
profiling	2.31 ms [2.256 ms, 2.364 ms]	838.708 µs (57.0%)
tracing	2.263 ms [2.212 ms, 2.315 ms]	791.98 µs (53.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e2e4a66b9d, baseline=1.59.0-SNAPSHOT~6d2b809818
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.634 s) : 15634000, 15634000
.   : milestone, 15634000,
appsec (14.582 s) : 14582000, 14582000
.   : milestone, 14582000,
iast (17.942 s) : 17942000, 17942000
.   : milestone, 17942000,
iast_GLOBAL (17.771 s) : 17771000, 17771000
.   : milestone, 17771000,
profiling (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
tracing (14.547 s) : 14547000, 14547000
.   : milestone, 14547000,
section candidate
no_agent (15.321 s) : 15321000, 15321000
.   : milestone, 15321000,
appsec (14.73 s) : 14730000, 14730000
.   : milestone, 14730000,
iast (18.244 s) : 18244000, 18244000
.   : milestone, 18244000,
iast_GLOBAL (17.696 s) : 17696000, 17696000
.   : milestone, 17696000,
profiling (14.629 s) : 14629000, 14629000
.   : milestone, 14629000,
tracing (14.692 s) : 14692000, 14692000
.   : milestone, 14692000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.634 s [15.634 s, 15.634 s]	-
appsec	14.582 s [14.582 s, 14.582 s]	-1.052 s (-6.7%)
iast	17.942 s [17.942 s, 17.942 s]	2.308 s (14.8%)
iast_GLOBAL	17.771 s [17.771 s, 17.771 s]	2.137 s (13.7%)
profiling	15.024 s [15.024 s, 15.024 s]	-610.0 ms (-3.9%)
tracing	14.547 s [14.547 s, 14.547 s]	-1.087 s (-7.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.321 s [15.321 s, 15.321 s]	-
appsec	14.73 s [14.73 s, 14.73 s]	-591.0 ms (-3.9%)
iast	18.244 s [18.244 s, 18.244 s]	2.923 s (19.1%)
iast_GLOBAL	17.696 s [17.696 s, 17.696 s]	2.375 s (15.5%)
profiling	14.629 s [14.629 s, 14.629 s]	-692.0 ms (-4.5%)
tracing	14.692 s [14.692 s, 14.692 s]	-629.0 ms (-4.1%)

charlesmyu force-pushed the charles.yu/djm-0000/debug-databricks-job-id branch from d2122db to 404dac6 Compare January 9, 2026 19:45

charlesmyu temporarily deployed to ci-build January 9, 2026 19:45 — with GitHub Actions Inactive

charlesmyu force-pushed the charles.yu/djm-0000/debug-databricks-job-id branch from 404dac6 to 09ebd0e Compare January 9, 2026 20:13

charlesmyu temporarily deployed to ci-build January 9, 2026 20:17 — with GitHub Actions Inactive

charlesmyu force-pushed the charles.yu/djm-0000/debug-databricks-job-id branch from 09ebd0e to 139a78c Compare January 9, 2026 22:12

charlesmyu temporarily deployed to ci-build January 9, 2026 22:12 — with GitHub Actions Inactive

[DJM-0000] Debug Databricks

e2e4a66

charlesmyu force-pushed the charles.yu/djm-0000/debug-databricks-job-id branch from 139a78c to e2e4a66 Compare January 12, 2026 15:03

charlesmyu temporarily deployed to ci-build January 12, 2026 15:03 — with GitHub Actions Inactive

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[DJM-0000] Debug Databricks #10328

[DJM-0000] Debug Databricks #10328

charlesmyu commented Jan 9, 2026

Uh oh!

pr-commenter bot commented Jan 9, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[DJM-0000] Debug Databricks #10328

Are you sure you want to change the base?

[DJM-0000] Debug Databricks #10328

Conversation

charlesmyu commented Jan 9, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jan 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter bot commented Jan 9, 2026 •

edited

Loading