Skip to content

Remove instrumentation from workbench#1959

Open
ijjk wants to merge 2 commits intomainfrom
ijjk/remove-instrumentation
Open

Remove instrumentation from workbench#1959
ijjk wants to merge 2 commits intomainfrom
ijjk/remove-instrumentation

Conversation

@ijjk
Copy link
Copy Markdown
Member

@ijjk ijjk commented May 7, 2026

This removes the instrumentation world setup stub that we had from the beginning but is not in our getting started docs https://workflow-sdk.dev/docs/getting-started/next so this ensures we're testing what we actually tell users to do.

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented May 7, 2026

⚠️ No Changeset found

Latest commit: 5058f34

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented May 7, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment May 7, 2026 4:56pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment May 7, 2026 4:56pm
example-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-astro-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-express-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-fastify-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-hono-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-nitro-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-nuxt-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-sveltekit-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-tanstack-start-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workbench-vite-workflow Ready Ready Preview, Comment May 7, 2026 4:56pm
workflow-swc-playground Ready Ready Preview, Comment May 7, 2026 4:56pm
workflow-tarballs Ready Ready Preview, Comment May 7, 2026 4:56pm
workflow-web Ready Ready Preview, Comment May 7, 2026 4:56pm
1 Skipped Deployment
Project Deployment Actions Updated (UTC)
workflow-docs Skipped Skipped May 7, 2026 4:56pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 1191 9 219 1419
✅ 💻 Local Development 1587 0 219 1806
✅ 📦 Local Production 1587 0 219 1806
❌ 🐘 Local Postgres 1585 2 219 1806
✅ 🪟 Windows 129 0 0 129
✅ 📋 Other 727 0 176 903
Total 6806 11 1052 7869

❌ Failed Tests

▲ Vercel Production (9 failed)

nextjs-turbopack (5 failed):

  • webhookWorkflow | wrun_01KR1NVHYWKWM0EB014XCJ1TAV | 🔍 observability
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • AbortController abortFromStepWorkflow: step abort cancels an in-flight sibling step

nextjs-webpack (4 failed):

  • webhookWorkflow | wrun_01KR1NVHYWKWM0EB014XCJ1TAV | 🔍 observability
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
🐘 Local Postgres (2 failed)

nextjs-turbopack-stable-lazy-discovery-disabled (1 failed):

  • DurableAgent e2e core basic text response

nextjs-webpack-stable-lazy-discovery-enabled (1 failed):

  • DurableAgent e2e core basic text response

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 103 0 26
✅ example 103 0 26
✅ express 103 0 26
✅ fastify 103 0 26
✅ hono 103 0 26
❌ nextjs-turbopack 122 5 2
❌ nextjs-webpack 123 4 2
✅ nitro 103 0 26
✅ nuxt 103 0 26
✅ sveltekit 122 0 7
✅ vite 103 0 26
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 104 0 25
✅ express-stable 104 0 25
✅ fastify-stable 104 0 25
✅ hono-stable 104 0 25
✅ nextjs-turbopack-canary 110 0 19
✅ nextjs-turbopack-stable-lazy-discovery-disabled 129 0 0
✅ nextjs-turbopack-stable-lazy-discovery-enabled 129 0 0
✅ nextjs-webpack-canary 110 0 19
✅ nextjs-webpack-stable-lazy-discovery-disabled 129 0 0
✅ nextjs-webpack-stable-lazy-discovery-enabled 129 0 0
✅ nitro-stable 104 0 25
✅ nuxt-stable 104 0 25
✅ sveltekit-stable 123 0 6
✅ vite-stable 104 0 25
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 104 0 25
✅ express-stable 104 0 25
✅ fastify-stable 104 0 25
✅ hono-stable 104 0 25
✅ nextjs-turbopack-canary 110 0 19
✅ nextjs-turbopack-stable-lazy-discovery-disabled 129 0 0
✅ nextjs-turbopack-stable-lazy-discovery-enabled 129 0 0
✅ nextjs-webpack-canary 110 0 19
✅ nextjs-webpack-stable-lazy-discovery-disabled 129 0 0
✅ nextjs-webpack-stable-lazy-discovery-enabled 129 0 0
✅ nitro-stable 104 0 25
✅ nuxt-stable 104 0 25
✅ sveltekit-stable 123 0 6
✅ vite-stable 104 0 25
❌ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 104 0 25
✅ express-stable 104 0 25
✅ fastify-stable 104 0 25
✅ hono-stable 104 0 25
✅ nextjs-turbopack-canary 110 0 19
❌ nextjs-turbopack-stable-lazy-discovery-disabled 128 1 0
✅ nextjs-turbopack-stable-lazy-discovery-enabled 129 0 0
✅ nextjs-webpack-canary 110 0 19
✅ nextjs-webpack-stable-lazy-discovery-disabled 129 0 0
❌ nextjs-webpack-stable-lazy-discovery-enabled 128 1 0
✅ nitro-stable 104 0 25
✅ nuxt-stable 104 0 25
✅ sveltekit-stable 123 0 6
✅ vite-stable 104 0 25
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 129 0 0
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 104 0 25
✅ e2e-local-dev-tanstack-start- 104 0 25
✅ e2e-local-postgres-nest-stable 104 0 25
✅ e2e-local-postgres-tanstack-start- 104 0 25
✅ e2e-local-prod-nest-stable 104 0 25
✅ e2e-local-prod-tanstack-start- 104 0 25
✅ e2e-vercel-prod-tanstack-start 103 0 26

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.032s (-25.1% 🟢) 1.005s (~) 0.972s 10 1.00x
💻 Local Express 0.035s (-20.5% 🟢) 1.006s (~) 0.971s 10 1.09x
🐘 Postgres Express 0.048s (-17.2% 🟢) 1.012s (~) 0.964s 10 1.49x
🐘 Postgres Nitro 0.052s (-45.3% 🟢) 1.013s (-2.9%) 0.961s 10 1.61x
workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.073s (-4.6%) 2.007s (~) 0.933s 10 1.00x
💻 Local Nitro 1.078s (-4.7%) 2.005s (~) 0.927s 10 1.00x
🐘 Postgres Express 1.090s (-5.0%) 2.009s (~) 0.919s 10 1.01x
🐘 Postgres Nitro 1.090s (-4.4%) 2.010s (~) 0.920s 10 1.02x
workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 10.423s (-4.6%) 11.022s (~) 0.599s 3 1.00x
🐘 Postgres Nitro 10.424s (-4.1%) 11.021s (~) 0.597s 3 1.00x
💻 Local Nitro 10.441s (-4.6%) 11.021s (~) 0.579s 3 1.00x
🐘 Postgres Express 10.442s (-4.8%) 11.012s (~) 0.570s 3 1.00x
workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 13.464s (-10.6% 🟢) 14.026s (-12.5% 🟢) 0.562s 5 1.00x
🐘 Postgres Express 13.510s (-7.4% 🟢) 14.020s (-6.7% 🟢) 0.510s 5 1.00x
💻 Local Express 13.524s (-9.7% 🟢) 14.029s (-6.7% 🟢) 0.505s 5 1.00x
🐘 Postgres Nitro 13.528s (-7.3% 🟢) 14.024s (-6.7% 🟢) 0.497s 5 1.00x
workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 11.959s (-28.0% 🟢) 12.022s (-29.4% 🟢) 0.063s 8 1.00x
💻 Local Nitro 11.959s (-28.7% 🟢) 12.272s (-27.9% 🟢) 0.313s 8 1.00x
🐘 Postgres Express 11.973s (-14.5% 🟢) 12.267s (-15.9% 🟢) 0.293s 8 1.00x
🐘 Postgres Nitro 12.356s (-11.5% 🟢) 12.880s (-10.0% 🟢) 0.523s 7 1.03x
Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.153s (-9.5% 🟢) 2.007s (~) 0.854s 15 1.00x
💻 Local Nitro 1.171s (-28.2% 🟢) 2.005s (-3.3%) 0.834s 15 1.02x
🐘 Postgres Express 1.200s (-4.8%) 2.077s (+3.4%) 0.877s 15 1.04x
💻 Local Express 1.204s (-19.1% 🟢) 2.006s (~) 0.802s 15 1.04x
Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.220s (-48.3% 🟢) 2.008s (-33.3% 🟢) 0.788s 15 1.00x
🐘 Postgres Nitro 1.236s (-47.4% 🟢) 2.006s (-33.3% 🟢) 0.771s 15 1.01x
💻 Local Nitro 1.627s (-48.3% 🟢) 2.005s (-48.4% 🟢) 0.379s 15 1.33x
💻 Local Express 1.781s (-39.7% 🟢) 2.008s (-41.9% 🟢) 0.227s 15 1.46x
Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.374s (-60.6% 🟢) 2.007s (-50.0% 🟢) 0.633s 15 1.00x
🐘 Postgres Nitro 1.402s (-59.7% 🟢) 2.008s (-49.9% 🟢) 0.606s 15 1.02x
💻 Local Nitro 4.372s (-47.6% 🟢) 5.014s (-44.4% 🟢) 0.642s 7 3.18x
💻 Local Express 5.541s (-33.5% 🟢) 6.013s (-33.4% 🟢) 0.472s 6 4.03x
Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.164s (-7.4% 🟢) 2.008s (~) 0.845s 15 1.00x
🐘 Postgres Nitro 1.170s (-6.9% 🟢) 2.007s (~) 0.837s 15 1.01x
💻 Local Nitro 1.386s (-25.7% 🟢) 2.007s (-14.3% 🟢) 0.620s 15 1.19x
💻 Local Express 1.402s (-26.0% 🟢) 2.006s (-15.1% 🟢) 0.605s 15 1.20x
Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.250s (-46.6% 🟢) 2.009s (-33.3% 🟢) 0.758s 15 1.00x
🐘 Postgres Nitro 1.252s (-46.5% 🟢) 2.009s (-33.3% 🟢) 0.757s 15 1.00x
💻 Local Nitro 1.733s (-43.5% 🟢) 2.073s (-46.7% 🟢) 0.340s 15 1.39x
💻 Local Express 2.111s (-32.6% 🟢) 2.592s (-31.1% 🟢) 0.481s 12 1.69x
Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.379s (-60.4% 🟢) 2.008s (-49.9% 🟢) 0.629s 15 1.00x
🐘 Postgres Express 1.391s (-60.2% 🟢) 2.007s (-50.0% 🟢) 0.616s 15 1.01x
💻 Local Nitro 4.878s (-46.7% 🟢) 5.345s (-46.7% 🟢) 0.468s 6 3.54x
💻 Local Express 5.449s (-38.1% 🟢) 6.217s (-33.0% 🟢) 0.768s 5 3.95x
workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.448s (-46.7% 🟢) 1.007s (-1.6%) 0.559s 60 1.00x
🐘 Postgres Nitro 0.459s (-44.1% 🟢) 1.007s (~) 0.548s 60 1.02x
💻 Local Nitro 0.491s (-49.9% 🟢) 1.005s (-8.2% 🟢) 0.513s 60 1.10x
💻 Local Express 0.523s (-46.8% 🟢) 1.005s (-6.6% 🟢) 0.482s 60 1.17x
workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.057s (-46.5% 🟢) 1.705s (-24.5% 🟢) 0.648s 53 1.00x
🐘 Postgres Nitro 1.158s (-39.9% 🟢) 2.008s (-4.4%) 0.850s 45 1.10x
💻 Local Express 1.210s (-59.9% 🟢) 2.006s (-44.0% 🟢) 0.797s 45 1.14x
💻 Local Nitro 1.219s (-59.8% 🟢) 2.006s (-46.6% 🟢) 0.787s 45 1.15x
workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.068s (-48.2% 🟢) 2.616s (-40.1% 🟢) 0.548s 46 1.00x
🐘 Postgres Nitro 2.210s (-46.1% 🟢) 2.984s (-35.2% 🟢) 0.774s 41 1.07x
💻 Local Nitro 2.675s (-71.2% 🟢) 3.008s (-70.0% 🟢) 0.333s 40 1.29x
💻 Local Express 2.736s (-70.3% 🟢) 3.008s (-70.0% 🟢) 0.272s 40 1.32x
workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.187s (-34.0% 🟢) 1.006s (~) 0.819s 60 1.00x
🐘 Postgres Express 0.189s (-33.0% 🟢) 1.006s (~) 0.817s 60 1.01x
💻 Local Nitro 0.407s (-32.6% 🟢) 1.004s (-1.7%) 0.597s 60 2.18x
💻 Local Express 0.470s (-16.1% 🟢) 1.004s (~) 0.534s 60 2.52x
workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.322s (-36.9% 🟢) 1.007s (~) 0.685s 90 1.00x
🐘 Postgres Nitro 0.333s (-32.8% 🟢) 1.007s (~) 0.673s 90 1.04x
💻 Local Nitro 2.214s (-12.8% 🟢) 2.912s (-3.2%) 0.698s 31 6.88x
💻 Local Express 2.278s (-9.4% 🟢) 3.009s (~) 0.731s 30 7.08x
workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.668s (-15.4% 🟢) 1.006s (~) 0.338s 120 1.00x
🐘 Postgres Express 0.669s (-18.3% 🟢) 1.006s (-1.1%) 0.337s 120 1.00x
💻 Local Nitro 9.793s (-12.5% 🟢) 10.278s (-11.9% 🟢) 0.485s 12 14.66x
💻 Local Express 10.579s (-5.5% 🟢) 11.302s (-5.3% 🟢) 0.724s 11 15.83x
Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.124s (+426.0% 🔺) 2.004s (+99.5% 🔺) 0.010s (-19.2% 🟢) 2.016s (+97.9% 🔺) 0.892s 10 1.00x
🐘 Postgres Nitro 1.128s (+450.4% 🔺) 2.001s (+100.1% 🔺) 0.002s (~) 2.009s (+98.7% 🔺) 0.881s 10 1.00x
💻 Local Express 1.140s (+472.6% 🔺) 2.006s (+99.7% 🔺) 0.013s (+6.6% 🔺) 2.020s (+98.5% 🔺) 0.880s 10 1.01x
🐘 Postgres Express 1.144s (+457.9% 🔺) 1.997s (+100.0% 🔺) 0.001s (-25.0% 🟢) 2.011s (+98.8% 🔺) 0.867s 10 1.02x
stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.516s (+140.6% 🔺) 2.004s (+99.1% 🔺) 0.004s (+4.4%) 2.026s (+98.0% 🔺) 0.510s 30 1.00x
💻 Local Nitro 1.546s (+84.3% 🔺) 2.011s (+98.7% 🔺) 0.011s (+14.9% 🔺) 2.024s (+81.4% 🔺) 0.478s 30 1.02x
🐘 Postgres Nitro 1.548s (+148.0% 🔺) 2.008s (+99.5% 🔺) 0.004s (-4.1%) 2.028s (+98.3% 🔺) 0.480s 30 1.02x
💻 Local Express 1.577s (+108.3% 🔺) 2.012s (+95.6% 🔺) 0.010s (+8.7% 🔺) 2.024s (+94.7% 🔺) 0.447s 30 1.04x
10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.672s (-30.6% 🟢) 1.050s (-15.8% 🟢) 0.000s (+26.3% 🔺) 1.060s (-15.7% 🟢) 0.388s 57 1.00x
🐘 Postgres Express 0.681s (-29.1% 🟢) 1.032s (-19.2% 🟢) 0.000s (-59.6% 🟢) 1.069s (-18.1% 🟢) 0.388s 57 1.01x
💻 Local Nitro 1.376s (+12.5% 🔺) 2.015s (~) 0.000s (+300.0% 🔺) 2.017s (~) 0.641s 30 2.05x
💻 Local Express 1.437s (+17.3% 🔺) 2.016s (~) 0.000s (-30.0% 🟢) 2.018s (~) 0.581s 30 2.14x
fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.301s (-27.4% 🟢) 2.031s (-5.2% 🟢) 0.000s (-6.7% 🟢) 2.054s (-5.5% 🟢) 0.754s 30 1.00x
🐘 Postgres Express 1.360s (-23.3% 🟢) 2.066s (-5.1% 🟢) 0.000s (+Infinity% 🔺) 2.080s (-5.4% 🟢) 0.720s 29 1.05x
💻 Local Nitro 3.164s (-6.6% 🟢) 3.902s (-3.2%) 0.001s (-6.2% 🟢) 3.907s (-3.2%) 0.743s 16 2.43x
💻 Local Express 3.231s (-6.8% 🟢) 4.033s (~) 0.001s (~) 4.036s (~) 0.805s 15 2.48x

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 17/21
🐘 Postgres Express 13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 16/21
Nitro 🐘 Postgres 15/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants