Skip to content

Fix Pekko HTTP async test exception flakiness#10799

Open
bm1549 wants to merge 1 commit intomasterfrom
brian.marks/fix-pekko-http-async-flaky-test-v2
Open

Fix Pekko HTTP async test exception flakiness#10799
bm1549 wants to merge 1 commit intomasterfrom
brian.marks/fix-pekko-http-async-flaky-test-v2

Conversation

@bm1549
Copy link
Contributor

@bm1549 bm1549 commented Mar 10, 2026 •
edited
Loading

What Does This Do

Fixes the root cause of flaky PekkoHttpServerInstrumentationAsyncTest and PekkoHttpServerInstrumentationAsyncHttp2Test "test exception" failures by recovering from exceptions in the async handler to return a proper HTTP 500 response instead of a failed Future.

Removes the @Flaky annotation from the "test exception" test since the root cause is now addressed.

Motivation

The "test exception" test was failing intermittently (~2x in 30 days) with TimeoutException from ListWriter.waitForTraces. The root cause: when the async handler throws an exception, the Future fails, and span completion flows through the DatadogAsyncHandlerWrapper's error transform callback. With strictTraceWrites=true (used in tests), the PendingTraceBuffer is a discarding buffer. If the root span finishes while Scala Future continuation references are still pending (count > 0), the trace is enqueued to the discarding buffer and never written, causing the 20-second timeout.

By adding .recover to the asyncHandler's Future, exceptions are converted to a proper HttpResponse(500) response. This routes span completion through the success path of the transform callback, which avoids the problematic failed-Future continuation cleanup race entirely. The server span is still correctly marked as errored because the HTTP 500 status triggers the server error check in the decorator.

Relates to #9396

Additional Notes

  • The fix is scoped to the test web server's asyncHandler, not the production instrumentation code
  • All existing test assertions continue to pass because expectedExtraErrorInformation permits null values for error tags
  • The syncHandler's exception behavior is unchanged; the .recover only affects the Future wrapper used by BindAndHandleAsync and BindAndHandleAsyncHttp2
  • The latestDepTest variants automatically benefit from this fix since they share the same source files

Contributor Checklist

Jira ticket: N/A

@bm1549 @claude
Fix Pekko HTTP async test exception flakiness
c5a177c 
The async handler's exception path caused a failed Future whose span
completion depended on Scala continuation cleanup. With strict trace
writes enabled in tests, if the root span finished while continuations
were still pending, the trace was enqueued to a discarding buffer and
never written, causing a 20-second timeout in waitForTraces.

Fix by recovering from exceptions in the async handler to return a
proper 500 HTTP response instead of a failed Future. This routes span
completion through the success path of the DatadogAsyncHandlerWrapper
transform callback, avoiding the problematic continuation cleanup race.

Also remove the @flaky annotation from the "test exception" test since
the root cause is now fixed.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@bm1549 bm1549 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes tag: ai generated Largely based on code generated by an AI or LLM tag: flaky test Flaky tests labels Mar 10, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 10, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master brian.marks/fix-pekko-http-async-flaky-test-v2
git_commit_date 1773169596 1773173313
git_commit_sha cc12228 c5a177c
release_version 1.61.0-SNAPSHOT~cc122288e5 1.61.0-SNAPSHOT~c5a177c1ef
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773175002 1773175002
ci_job_id 1494511974 1494511974
ci_pipeline_id 101732759 101732759
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-uxfndf3w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-uxfndf3w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056781
Total [baseline] (8.801 s) : 0, 8800684
Agent [candidate] (1.074 s) : 0, 1073676
Total [candidate] (8.822 s) : 0, 8822176
section iast
Agent [baseline] (1.225 s) : 0, 1224849
Total [baseline] (9.552 s) : 0, 9551565
Agent [candidate] (1.225 s) : 0, 1224817
Total [candidate] (9.569 s) : 0, 9568988
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.225 s 168.068 ms (15.9%)
Total tracing 8.801 s -
Total iast 9.552 s 750.88 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.225 s 151.14 ms (14.1%)
Total tracing 8.822 s -
Total iast 9.569 s 746.812 ms (8.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (626.62 ms) : 0, 626620
BytebuddyAgent [candidate] (636.446 ms) : 0, 636446
AgentMeter [baseline] (29.1 ms) : 0, 29100
AgentMeter [candidate] (29.456 ms) : 0, 29456
GlobalTracer [baseline] (256.517 ms) : 0, 256517
GlobalTracer [candidate] (259.975 ms) : 0, 259975
AppSec [baseline] (31.553 ms) : 0, 31553
AppSec [candidate] (31.978 ms) : 0, 31978
Debugger [baseline] (58.702 ms) : 0, 58702
Debugger [candidate] (59.53 ms) : 0, 59530
Remote Config [baseline] (585.489 µs) : 0, 585
Remote Config [candidate] (596.694 µs) : 0, 597
Telemetry [baseline] (8.629 ms) : 0, 8629
Telemetry [candidate] (8.738 ms) : 0, 8738
Flare Poller [baseline] (7.845 ms) : 0, 7845
Flare Poller [candidate] (9.424 ms) : 0, 9424
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (794.943 ms) : 0, 794943
BytebuddyAgent [candidate] (794.639 ms) : 0, 794639
AgentMeter [baseline] (11.304 ms) : 0, 11304
AgentMeter [candidate] (11.297 ms) : 0, 11297
GlobalTracer [baseline] (246.819 ms) : 0, 246819
GlobalTracer [candidate] (247.111 ms) : 0, 247111
AppSec [baseline] (26.251 ms) : 0, 26251
AppSec [candidate] (26.341 ms) : 0, 26341
Debugger [baseline] (62.978 ms) : 0, 62978
Debugger [candidate] (62.675 ms) : 0, 62675
Remote Config [baseline] (526.64 µs) : 0, 527
Remote Config [candidate] (540.89 µs) : 0, 541
Telemetry [baseline] (14.799 ms) : 0, 14799
Telemetry [candidate] (14.957 ms) : 0, 14957
Flare Poller [baseline] (4.869 ms) : 0, 4869
Flare Poller [candidate] (4.734 ms) : 0, 4734
IAST [baseline] (25.103 ms) : 0, 25103
IAST [candidate] (25.105 ms) : 0, 25105
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060192
Total [baseline] (11.05 s) : 0, 11050247
Agent [candidate] (1.058 s) : 0, 1057937
Total [candidate] (11.006 s) : 0, 11006049
section appsec
Agent [baseline] (1.253 s) : 0, 1252653
Total [baseline] (11.132 s) : 0, 11132372
Agent [candidate] (1.246 s) : 0, 1245647
Total [candidate] (11.143 s) : 0, 11142587
section iast
Agent [baseline] (1.23 s) : 0, 1230122
Total [baseline] (11.31 s) : 0, 11310378
Agent [candidate] (1.23 s) : 0, 1230379
Total [candidate] (11.415 s) : 0, 11414710
section profiling
Agent [baseline] (1.179 s) : 0, 1178558
Total [baseline] (10.987 s) : 0, 10986922
Agent [candidate] (1.196 s) : 0, 1196197
Total [candidate] (11.18 s) : 0, 11180329
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.253 s 192.461 ms (18.2%)
Agent iast 1.23 s 169.93 ms (16.0%)
Agent profiling 1.179 s 118.366 ms (11.2%)
Total tracing 11.05 s -
Total appsec 11.132 s 82.125 ms (0.7%)
Total iast 11.31 s 260.132 ms (2.4%)
Total profiling 10.987 s -63.324 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.246 s 187.71 ms (17.7%)
Agent iast 1.23 s 172.443 ms (16.3%)
Agent profiling 1.196 s 138.261 ms (13.1%)
Total tracing 11.006 s -
Total appsec 11.143 s 136.537 ms (1.2%)
Total iast 11.415 s 408.661 ms (3.7%)
Total profiling 11.18 s 174.28 ms (1.6%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (627.6 ms) : 0, 627600
BytebuddyAgent [candidate] (627.2 ms) : 0, 627200
AgentMeter [baseline] (29.162 ms) : 0, 29162
AgentMeter [candidate] (29.042 ms) : 0, 29042
GlobalTracer [baseline] (257.197 ms) : 0, 257197
GlobalTracer [candidate] (256.979 ms) : 0, 256979
AppSec [baseline] (31.56 ms) : 0, 31560
AppSec [candidate] (31.522 ms) : 0, 31522
Debugger [baseline] (59.427 ms) : 0, 59427
Debugger [candidate] (59.416 ms) : 0, 59416
Remote Config [baseline] (590.4 µs) : 0, 590
Remote Config [candidate] (583.054 µs) : 0, 583
Telemetry [baseline] (8.638 ms) : 0, 8638
Telemetry [candidate] (8.595 ms) : 0, 8595
Flare Poller [baseline] (8.797 ms) : 0, 8797
Flare Poller [candidate] (7.311 ms) : 0, 7311
section appsec
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (662.019 ms) : 0, 662019
BytebuddyAgent [candidate] (657.268 ms) : 0, 657268
AgentMeter [baseline] (12.054 ms) : 0, 12054
AgentMeter [candidate] (12.097 ms) : 0, 12097
GlobalTracer [baseline] (259.946 ms) : 0, 259946
GlobalTracer [candidate] (258.269 ms) : 0, 258269
AppSec [baseline] (178.057 ms) : 0, 178057
AppSec [candidate] (177.685 ms) : 0, 177685
Debugger [baseline] (65.774 ms) : 0, 65774
Debugger [candidate] (64.812 ms) : 0, 64812
Remote Config [baseline] (586.874 µs) : 0, 587
Remote Config [candidate] (577.331 µs) : 0, 577
Telemetry [baseline] (8.935 ms) : 0, 8935
Telemetry [candidate] (9.887 ms) : 0, 9887
Flare Poller [baseline] (3.557 ms) : 0, 3557
Flare Poller [candidate] (3.666 ms) : 0, 3666
IAST [baseline] (24.112 ms) : 0, 24112
IAST [candidate] (23.904 ms) : 0, 23904
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (799.226 ms) : 0, 799226
BytebuddyAgent [candidate] (799.033 ms) : 0, 799033
AgentMeter [baseline] (11.342 ms) : 0, 11342
AgentMeter [candidate] (11.367 ms) : 0, 11367
GlobalTracer [baseline] (247.276 ms) : 0, 247276
GlobalTracer [candidate] (247.368 ms) : 0, 247368
AppSec [baseline] (26.321 ms) : 0, 26321
AppSec [candidate] (26.459 ms) : 0, 26459
Debugger [baseline] (63.206 ms) : 0, 63206
Debugger [candidate] (64.046 ms) : 0, 64046
Remote Config [baseline] (531.28 µs) : 0, 531
Remote Config [candidate] (524.036 µs) : 0, 524
Telemetry [baseline] (14.818 ms) : 0, 14818
Telemetry [candidate] (14.321 ms) : 0, 14321
Flare Poller [baseline] (4.707 ms) : 0, 4707
Flare Poller [candidate] (4.743 ms) : 0, 4743
IAST [baseline] (25.151 ms) : 0, 25151
IAST [candidate] (25.144 ms) : 0, 25144
section profiling
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (680.4 ms) : 0, 680400
BytebuddyAgent [candidate] (691.21 ms) : 0, 691210
AgentMeter [baseline] (8.587 ms) : 0, 8587
AgentMeter [candidate] (8.705 ms) : 0, 8705
GlobalTracer [baseline] (215.174 ms) : 0, 215174
GlobalTracer [candidate] (217.782 ms) : 0, 217782
AppSec [baseline] (31.743 ms) : 0, 31743
AppSec [candidate] (32.375 ms) : 0, 32375
Debugger [baseline] (65.143 ms) : 0, 65143
Debugger [candidate] (63.451 ms) : 0, 63451
Remote Config [baseline] (581.973 µs) : 0, 582
Remote Config [candidate] (600.213 µs) : 0, 600
Telemetry [baseline] (8.185 ms) : 0, 8185
Telemetry [candidate] (10.575 ms) : 0, 10575
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.547 ms) : 0, 3547
ProfilingAgent [baseline] (93.404 ms) : 0, 93404
ProfilingAgent [candidate] (95.146 ms) : 0, 95146
Profiling [baseline] (93.977 ms) : 0, 93977
Profiling [candidate] (95.716 ms) : 0, 95716
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master brian.marks/fix-pekko-http-async-flaky-test-v2
git_commit_date 1773169596 1773173313
git_commit_sha cc12228 c5a177c
release_version 1.61.0-SNAPSHOT~cc122288e5 1.61.0-SNAPSHOT~c5a177c1ef
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773175594 1773175594
ci_job_id 1494511975 1494511975
ci_pipeline_id 101732759 101732759
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-yayghraa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-yayghraa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 6 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+89.952µs; +222.281µs] or [+3.676%; +9.083%]		 worse
[+247.540µs; +721.828µs] or [+3.436%; +10.018%]		 unstable
[-214.031op/s; +61.031op/s] or [-14.780%; +4.214%]		 2.603ms 7.690ms 1371.656op/s 2.447ms 7.205ms 1448.156op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+119.481µs; +215.622µs] or [+4.484%; +8.092%]		 worse
[+192.127µs; +617.783µs] or [+2.539%; +8.165%]		 unstable
[-183.598op/s; +68.660op/s] or [-13.744%; +5.140%]		 2.832ms 7.971ms 1278.375op/s 2.665ms 7.566ms 1335.844op/s
scenario:load:petclinic:appsec:high_load worse
[+581.874µs; +1345.510µs] or [+3.191%; +7.379%]		 worse
[+1.013ms; +2.313ms] or [+3.413%; +7.792%]		 unstable
[-38.148op/s; +13.273op/s] or [-15.181%; +5.282%]		 19.197ms 31.350ms 238.844op/s 18.233ms 29.686ms 251.281op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.654 ms) : 19448, 19860
.   : milestone, 19654,
appsec (18.571 ms) : 18385, 18757
.   : milestone, 18571,
code_origins (17.623 ms) : 17450, 17795
.   : milestone, 17623,
iast (17.575 ms) : 17402, 17748
.   : milestone, 17575,
profiling (18.602 ms) : 18419, 18785
.   : milestone, 18602,
tracing (17.88 ms) : 17702, 18058
.   : milestone, 17880,
section candidate
no_agent (19.207 ms) : 19010, 19404
.   : milestone, 19207,
appsec (19.544 ms) : 19339, 19750
.   : milestone, 19544,
code_origins (17.835 ms) : 17657, 18014
.   : milestone, 17835,
iast (17.78 ms) : 17603, 17957
.   : milestone, 17780,
profiling (18.374 ms) : 18188, 18561
.   : milestone, 18374,
tracing (17.436 ms) : 17263, 17609
.   : milestone, 17436,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.654 ms [19.448 ms, 19.86 ms] -
appsec 18.571 ms [18.385 ms, 18.757 ms] -1.083 ms (-5.5%)
code_origins 17.623 ms [17.45 ms, 17.795 ms] -2.031 ms (-10.3%)
iast 17.575 ms [17.402 ms, 17.748 ms] -2.079 ms (-10.6%)
profiling 18.602 ms [18.419 ms, 18.785 ms] -1.052 ms (-5.4%)
tracing 17.88 ms [17.702 ms, 18.058 ms] -1.774 ms (-9.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.207 ms [19.01 ms, 19.404 ms] -
appsec 19.544 ms [19.339 ms, 19.75 ms] 337.391 µs (1.8%)
code_origins 17.835 ms [17.657 ms, 18.014 ms] -1.372 ms (-7.1%)
iast 17.78 ms [17.603 ms, 17.957 ms] -1.427 ms (-7.4%)
profiling 18.374 ms [18.188 ms, 18.561 ms] -832.764 µs (-4.3%)
tracing 17.436 ms [17.263 ms, 17.609 ms] -1.771 ms (-9.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.161 ms) : 1150, 1172
.   : milestone, 1161,
iast (3.159 ms) : 3117, 3200
.   : milestone, 3159,
iast_FULL (5.792 ms) : 5734, 5849
.   : milestone, 5792,
iast_GLOBAL (3.43 ms) : 3376, 3485
.   : milestone, 3430,
profiling (2.147 ms) : 2127, 2167
.   : milestone, 2147,
tracing (1.745 ms) : 1731, 1759
.   : milestone, 1745,
section candidate
no_agent (1.179 ms) : 1167, 1191
.   : milestone, 1179,
iast (3.338 ms) : 3297, 3379
.   : milestone, 3338,
iast_FULL (5.937 ms) : 5876, 5998
.   : milestone, 5937,
iast_GLOBAL (3.587 ms) : 3529, 3645
.   : milestone, 3587,
profiling (2.092 ms) : 2073, 2111
.   : milestone, 2092,
tracing (1.76 ms) : 1745, 1775
.   : milestone, 1760,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.161 ms [1.15 ms, 1.172 ms] -
iast 3.159 ms [3.117 ms, 3.2 ms] 1.997 ms (172.0%)
iast_FULL 5.792 ms [5.734 ms, 5.849 ms] 4.631 ms (398.8%)
iast_GLOBAL 3.43 ms [3.376 ms, 3.485 ms] 2.269 ms (195.4%)
profiling 2.147 ms [2.127 ms, 2.167 ms] 985.709 µs (84.9%)
tracing 1.745 ms [1.731 ms, 1.759 ms] 583.449 µs (50.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.179 ms [1.167 ms, 1.191 ms] -
iast 3.338 ms [3.297 ms, 3.379 ms] 2.159 ms (183.1%)
iast_FULL 5.937 ms [5.876 ms, 5.998 ms] 4.758 ms (403.6%)
iast_GLOBAL 3.587 ms [3.529 ms, 3.645 ms] 2.408 ms (204.2%)
profiling 2.092 ms [2.073 ms, 2.111 ms] 912.943 µs (77.4%)
tracing 1.76 ms [1.745 ms, 1.775 ms] 581.066 µs (49.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master brian.marks/fix-pekko-http-async-flaky-test-v2
git_commit_date 1773169596 1773173313
git_commit_sha cc12228 c5a177c
release_version 1.61.0-SNAPSHOT~cc122288e5 1.61.0-SNAPSHOT~c5a177c1ef
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773175223 1773175223
ci_job_id 1494511976 1494511976
ci_pipeline_id 101732759 101732759
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-yzrwuyav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-yzrwuyav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.603 s) : 15603000, 15603000
.   : milestone, 15603000,
appsec (15.18 s) : 15180000, 15180000
.   : milestone, 15180000,
iast (18.442 s) : 18442000, 18442000
.   : milestone, 18442000,
iast_GLOBAL (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
profiling (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
tracing (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
section candidate
no_agent (15.503 s) : 15503000, 15503000
.   : milestone, 15503000,
appsec (15.112 s) : 15112000, 15112000
.   : milestone, 15112000,
iast (17.739 s) : 17739000, 17739000
.   : milestone, 17739000,
iast_GLOBAL (17.771 s) : 17771000, 17771000
.   : milestone, 17771000,
profiling (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
tracing (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.603 s [15.603 s, 15.603 s] -
appsec 15.18 s [15.18 s, 15.18 s] -423.0 ms (-2.7%)
iast 18.442 s [18.442 s, 18.442 s] 2.839 s (18.2%)
iast_GLOBAL 18.077 s [18.077 s, 18.077 s] 2.474 s (15.9%)
profiling 15.017 s [15.017 s, 15.017 s] -586.0 ms (-3.8%)
tracing 14.965 s [14.965 s, 14.965 s] -638.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.503 s [15.503 s, 15.503 s] -
appsec 15.112 s [15.112 s, 15.112 s] -391.0 ms (-2.5%)
iast 17.739 s [17.739 s, 17.739 s] 2.236 s (14.4%)
iast_GLOBAL 17.771 s [17.771 s, 17.771 s] 2.268 s (14.6%)
profiling 15.329 s [15.329 s, 15.329 s] -174.0 ms (-1.1%)
tracing 14.965 s [14.965 s, 14.965 s] -538.0 ms (-3.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~c5a177c1ef, baseline=1.61.0-SNAPSHOT~cc122288e5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.864 ms) : 3642, 4087
.   : milestone, 3864,
iast (2.268 ms) : 2199, 2337
.   : milestone, 2268,
iast_GLOBAL (2.318 ms) : 2248, 2389
.   : milestone, 2318,
profiling (2.112 ms) : 2056, 2168
.   : milestone, 2112,
tracing (2.094 ms) : 2040, 2149
.   : milestone, 2094,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.825 ms) : 3603, 4046
.   : milestone, 3825,
iast (2.266 ms) : 2196, 2335
.   : milestone, 2266,
iast_GLOBAL (2.314 ms) : 2244, 2385
.   : milestone, 2314,
profiling (2.11 ms) : 2053, 2167
.   : milestone, 2110,
tracing (2.074 ms) : 2020, 2128
.   : milestone, 2074,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.864 ms [3.642 ms, 4.087 ms] 2.388 ms (161.7%)
iast 2.268 ms [2.199 ms, 2.337 ms] 791.822 µs (53.6%)
iast_GLOBAL 2.318 ms [2.248 ms, 2.389 ms] 841.891 µs (57.0%)
profiling 2.112 ms [2.056 ms, 2.168 ms] 635.655 µs (43.1%)
tracing 2.094 ms [2.04 ms, 2.149 ms] 617.996 µs (41.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.825 ms [3.603 ms, 4.046 ms] 2.343 ms (158.1%)
iast 2.266 ms [2.196 ms, 2.335 ms] 784.165 µs (52.9%)
iast_GLOBAL 2.314 ms [2.244 ms, 2.385 ms] 832.595 µs (56.2%)
profiling 2.11 ms [2.053 ms, 2.167 ms] 628.747 µs (42.4%)
tracing 2.074 ms [2.02 ms, 2.128 ms] 592.576 µs (40.0%)

@bm1549 bm1549 marked this pull request as ready for review March 10, 2026 21:07
@bm1549 bm1549 requested review from a team as code owners March 10, 2026 21:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

tag: ai generated Largely based on code generated by an AI or LLM tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@bm1549