Skip to content

Upgrade JSON Schema Test Suite to 60755c1097769e313fae3ec4d63bcc9d49b5d2d5#838

Merged
jviotti merged 1 commit into
mainfrom
new-suite-no-patches
May 29, 2026
Merged

Upgrade JSON Schema Test Suite to 60755c1097769e313fae3ec4d63bcc9d49b5d2d5#838
jviotti merged 1 commit into
mainfrom
new-suite-no-patches

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 29, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

…b5d2d5`

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 5 files

Re-trigger cubic

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 29, 2026

🤖 Augment PR Summary

Summary: This PR upgrades the vendored JSON Schema Test Suite to upstream commit 60755c1.

Changes:

  • Updates the jsonschema-test-suite entry in DEPENDENCIES to the new upstream SHA.
  • Removes the local patch that adjusted the Draft 3 format: regex lookbehind expectations (now present upstream).
  • Adds new unevaluatedProperties test cases for Draft 2019-09, Draft 2020-12, and v1.
  • The new tests ensure evaluated-properties tracking is instance-location aware (nested patternProperties/additionalProperties should not “evaluate” same-named properties at other object locations).

Technical Notes: This is a pure test-suite/vendor update; behavior changes will surface via newly-added conformance tests around unevaluatedProperties annotation collection.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
Schema_Iterator_ISO_Language 4026052.3333329055 ns/iter 3594879.95049424 ns/iter 1.12
Schema_Tracker_ISO_Language 9569818.402985506 ns/iter 9990410.168832675 ns/iter 0.96
Schema_Tracker_ISO_Language_To_JSON 25300488.807689503 ns/iter 20004954.16666581 ns/iter 1.26
Schema_Frame_WoT_References 7376736.400000912 ns/iter 7019046.524273841 ns/iter 1.05
Schema_Frame_OMC_References 35963146.89474112 ns/iter 39507191.650000095 ns/iter 0.91
Schema_Frame_OMC_Locations 39740770.85000545 ns/iter 38770811.4210574 ns/iter 1.03
Schema_Frame_ISO_Language_Locations 123428736.00001287 ns/iter 98976263.83334076 ns/iter 1.25
Schema_Frame_KrakenD_References 68566109.90908766 ns/iter 71464635.4166651 ns/iter 0.96
Schema_Frame_KrakenD_Reachable 684743791.0000736 ns/iter 653063333.000091 ns/iter 1.05
Schema_Frame_ISO_Language_Locations_To_JSON 138179279.71428746 ns/iter 130064930.66666281 ns/iter 1.06
Schema_Frame_Many_Resources_References 510376646.0000543 ns/iter 424848874.9999524 ns/iter 1.20
Schema_Bundle_Meta_2020_12 1760176.4653401985 ns/iter 1654654.5225465184 ns/iter 1.06
Schema_Format_ISO_Language_To_JSON 100048965.16674459 ns/iter 128831649.99993822 ns/iter 0.78
E2E_Compiler_adaptivecard 86172529.20000738 ns/iter 100395321.42858271 ns/iter 0.86
E2E_Compiler_ansible_meta 42584782.89473619 ns/iter 41693920.85000254 ns/iter 1.02
E2E_Compiler_aws_cdk 438199.58674751304 ns/iter 412976.54138700507 ns/iter 1.06
E2E_Compiler_babelrc 3061576.013513266 ns/iter 3028904.028436636 ns/iter 1.01
E2E_Compiler_clang_format 21805807.448274583 ns/iter 22375354.14705609 ns/iter 0.97
E2E_Compiler_cmake_presets 35756320.15789971 ns/iter 34142327.68182046 ns/iter 1.05
E2E_Compiler_code_climate 3209170.7317072065 ns/iter 3164444.504425299 ns/iter 1.01
E2E_Compiler_cql2 17193920.642858714 ns/iter 17533542.763155647 ns/iter 0.98
E2E_Compiler_cspell 47083623.04761847 ns/iter 30303899.703708507 ns/iter 1.55
E2E_Compiler_cypress 5462971.544715386 ns/iter 5037374.170001385 ns/iter 1.08
E2E_Compiler_deno 9172605.6666663 ns/iter 8693440.7745079 ns/iter 1.06
E2E_Compiler_dependabot 4986781.24999936 ns/iter 5520995.419999507 ns/iter 0.90
E2E_Compiler_draft_04 3102839.32876716 ns/iter 3067569.3133643977 ns/iter 1.01
E2E_Compiler_fabric_mod 5744858.993377709 ns/iter 5523150.4200014565 ns/iter 1.04
E2E_Compiler_geojson 31562250.000000685 ns/iter 27521682.956524316 ns/iter 1.15
E2E_Compiler_gitpod_configuration 5576407.500000187 ns/iter 5785188.749998724 ns/iter 0.96
E2E_Compiler_helm_chart_lock 681360.6541698589 ns/iter 740834.461315357 ns/iter 0.92
E2E_Compiler_importmap 254890.36885251396 ns/iter 257849.96452996807 ns/iter 0.99
E2E_Compiler_jasmine 1355536.6614665457 ns/iter 1626479.8429604063 ns/iter 0.83
E2E_Compiler_jshintrc 4816941.77483405 ns/iter 5125587.20000048 ns/iter 0.94
E2E_Compiler_jsconfig 27575198.863628842 ns/iter 28739802.07142982 ns/iter 0.96
E2E_Compiler_krakend 198307149.99998236 ns/iter 179362562.49998906 ns/iter 1.11
E2E_Compiler_lazygit 46516436.294121586 ns/iter 47995348.214288116 ns/iter 0.97
E2E_Compiler_lerna 1909047.7463000473 ns/iter 1580715.7933879865 ns/iter 1.21
E2E_Compiler_nest_cli 8946531.3548395 ns/iter 9087964.022727005 ns/iter 0.98
E2E_Compiler_omc 273580055.6667224 ns/iter 203807777.6666493 ns/iter 1.34
E2E_Compiler_omnisharp 10240206.521737728 ns/iter 6836261.137930799 ns/iter 1.50
E2E_Compiler_openapi 27754721.679993965 ns/iter 36898986.72726858 ns/iter 0.75
E2E_Compiler_pre_commit_hooks 5385897.900764194 ns/iter 6373466.304348371 ns/iter 0.85
E2E_Compiler_pulumi 5114479.579999625 ns/iter 4770026.686273447 ns/iter 1.07
E2E_Compiler_semantic_release 1445277.4318618483 ns/iter 1992940.4923074727 ns/iter 0.73
E2E_Compiler_stale 1494366.4104881482 ns/iter 1836243.957500301 ns/iter 0.81
E2E_Compiler_stylecop 5998085.513044276 ns/iter 7668882.641667097 ns/iter 0.78
E2E_Compiler_tmuxinator 1896348.6657302578 ns/iter 2615605.836236755 ns/iter 0.73
E2E_Compiler_ui5 56205701.923073106 ns/iter 84653898.11110274 ns/iter 0.66
E2E_Compiler_ui5_manifest 342763729.00001204 ns/iter 453297312.5000126 ns/iter 0.76
E2E_Compiler_unreal_engine_uproject 3963893.3615819467 ns/iter 5987743.230768975 ns/iter 0.66
E2E_Compiler_users_array 970688.5164585724 ns/iter 1325761.157303181 ns/iter 0.73
E2E_Compiler_vercel 14322510.999998588 ns/iter 19111606.06060879 ns/iter 0.75
E2E_Compiler_yamllint 332234.8186102111 ns/iter 443398.35463810276 ns/iter 0.75
E2E_Evaluator_adaptivecard 25177.43803087193 ns/iter 26456.52197916743 ns/iter 0.95
E2E_Evaluator_ansible_meta 234823.1731843467 ns/iter 235966.32081805746 ns/iter 1.00
E2E_Evaluator_aws_cdk 48999.08503496469 ns/iter 53187.82500000907 ns/iter 0.92
E2E_Evaluator_babelrc 109991.04543985092 ns/iter 107824.41735069406 ns/iter 1.02
E2E_Evaluator_cerebrum_criminal_case 1061597.0357942283 ns/iter 987217.5583634841 ns/iter 1.08
E2E_Evaluator_clang_format 141100.73379962292 ns/iter 130789.01958525644 ns/iter 1.08
E2E_Evaluator_cmake_presets 5534744.999999929 ns/iter 5951333.326731743 ns/iter 0.93
E2E_Evaluator_code_climate 211720.79677413538 ns/iter 197120.3284257936 ns/iter 1.07
E2E_Evaluator_cql2 220929.17335472436 ns/iter 204958.72213075004 ns/iter 1.08
E2E_Evaluator_cspell 572809.2787510538 ns/iter 522966.7919998065 ns/iter 1.10
E2E_Evaluator_cypress 203815.89399190148 ns/iter 199901.65175045418 ns/iter 1.02
E2E_Evaluator_deno 430018.75582091603 ns/iter 280545.305401337 ns/iter 1.53
E2E_Evaluator_dependabot 349161.32335320703 ns/iter 329836.60409562004 ns/iter 1.06
E2E_Evaluator_draft_04 9220276.200000755 ns/iter 7212588.835165542 ns/iter 1.28
E2E_Evaluator_fabric_mod 820250.6661830638 ns/iter 695954.0463768739 ns/iter 1.18
E2E_Evaluator_geojson 14878349.585365513 ns/iter 15049211.303570637 ns/iter 0.99
E2E_Evaluator_gitpod_configuration 256564.19884617557 ns/iter 224854.182832957 ns/iter 1.14
E2E_Evaluator_helm_chart_lock 367374.16723548586 ns/iter 275258.07632923755 ns/iter 1.33
E2E_Evaluator_importmap 45660.62508622852 ns/iter 40610.83654484486 ns/iter 1.12
E2E_Evaluator_jasmine 127491.3391693392 ns/iter 104899.02575217513 ns/iter 1.22
E2E_Evaluator_jshintrc 1546316.2350595964 ns/iter 1034460.3347458632 ns/iter 1.49
E2E_Evaluator_jsconfig 486654.757754806 ns/iter 406718.85245909006 ns/iter 1.20
E2E_Evaluator_krakend 224769.96860835372 ns/iter 203073.51085660775 ns/iter 1.11
E2E_Evaluator_lazygit 166105.86661300657 ns/iter 141128.95231585013 ns/iter 1.18
E2E_Evaluator_lerna 183115.01996006345 ns/iter 133113.69730903624 ns/iter 1.38
E2E_Evaluator_nest_cli 199968.22747572084 ns/iter 180839.84869142433 ns/iter 1.11
E2E_Evaluator_omc 21995.97864643625 ns/iter 19317.93004248897 ns/iter 1.14
E2E_Evaluator_omnisharp 745099.191580699 ns/iter 602237.1239067179 ns/iter 1.24
E2E_Evaluator_openapi 13823630.859377544 ns/iter 8087140.756096809 ns/iter 1.71
E2E_Evaluator_pre_commit_hooks 577077.0055556163 ns/iter 494394.64838932565 ns/iter 1.17
E2E_Evaluator_pulumi 854912.8839848527 ns/iter 643617.9925061603 ns/iter 1.33
E2E_Evaluator_semantic_release 113266.66387367206 ns/iter 100597.10568241647 ns/iter 1.13
E2E_Evaluator_stale 146467.61300052307 ns/iter 163088.3184685982 ns/iter 0.90
E2E_Evaluator_stylecop 305429.4127688209 ns/iter 237695.23114210568 ns/iter 1.28
E2E_Evaluator_tmuxinator 119248.49672657896 ns/iter 88202.40895911425 ns/iter 1.35
E2E_Evaluator_ui5 490362.7622047142 ns/iter 549115.9882698775 ns/iter 0.89
E2E_Evaluator_ui5_manifest 3203351.2845855188 ns/iter 2366462.962962902 ns/iter 1.35
E2E_Evaluator_unreal_engine_uproject 475808.3087718974 ns/iter 432279.3848166801 ns/iter 1.10
E2E_Evaluator_users_array 541498.9999999306 ns/iter 569359.1101694754 ns/iter 0.95
E2E_Evaluator_vercel 339890.8227160221 ns/iter 267989.0724947109 ns/iter 1.27
E2E_Evaluator_yamllint 7995.145381534103 ns/iter 9189.679254835059 ns/iter 0.87
Micro_Draft4_Meta_1_No_Callback 166.04073178743425 ns/iter 183.35787073711657 ns/iter 0.91
Micro_Draft4_Required_Properties 838.280004202591 ns/iter 840.2876868330757 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.855174892584724 ns/iter 21.722861203204864 ns/iter 1.10
Micro_Draft4_Few_Optional_Properties_Minimal_Match 9.912737230232525 ns/iter 9.957805336687597 ns/iter 1.00
Micro_Draft4_Items_Schema 323.872447001447 ns/iter 325.5354536632121 ns/iter 0.99
Micro_Draft4_Nested_Object 0.8093639937464657 ns/iter 0.9329508169960471 ns/iter 0.87
Micro_Draft4_Properties_Triad_Optional 258.4691710734978 ns/iter 320.839313502711 ns/iter 0.81
Micro_Draft4_Properties_Triad_Closed 296.8889256583203 ns/iter 244.6290523966422 ns/iter 1.21
Micro_Draft4_Properties_Triad_Required 326.84362900970575 ns/iter 271.477982625057 ns/iter 1.20
Micro_Draft4_Properties_Closed 56.21273921457404 ns/iter 44.45796069651559 ns/iter 1.26
Micro_Draft4_Non_Recursive_Ref 11.720176659443291 ns/iter 12.012825659271526 ns/iter 0.98
Micro_Draft4_Pattern_Properties_True 179.07042413176814 ns/iter 185.01955277912313 ns/iter 0.97
Micro_Draft4_Ref_To_Single_Property 8.796272627588694 ns/iter 9.28185935648602 ns/iter 0.95
Micro_Draft4_Additional_Properties_Type 23.77057295808905 ns/iter 25.185905809054294 ns/iter 0.94
Micro_Draft4_Nested_Oneof 50.242374999993444 ns/iter 52.09266316161828 ns/iter 0.96
Micro_Draft4_Short_Enum 6.169742974691018 ns/iter 6.842405363837775 ns/iter 0.90
Micro_Draft4_Long_Enum 13.631810685833162 ns/iter 12.907448747338302 ns/iter 1.06
Micro_Draft4_Long_Enum_Short_Strings 8.249916748690145 ns/iter 9.091646149772451 ns/iter 0.91
Micro_Draft4_Type_Object 3.095768996747449 ns/iter 3.2170516837828904 ns/iter 0.96
Micro_Draft4_Ref_Single_100 2324603.4699999047 ns/iter 2372796.245420568 ns/iter 0.98
Micro_Draft4_Compile_Ref_Many_Nested 1810699.809195661 ns/iter 1845445.6264776525 ns/iter 0.98
Micro_Draft4_Compile_Wrap 2719075.473309773 ns/iter 2807748.4366195668 ns/iter 0.97
Micro_Draft6_Property_Names 120.48841772274793 ns/iter 128.48834293805112 ns/iter 0.94
Micro_Draft6_Compile_FHIR 13467360709.000105 ns/iter 15191748375.000088 ns/iter 0.89
Micro_Draft7_If_Then_Else 20.861473872981602 ns/iter 21.898787125984803 ns/iter 0.95
Micro_2019_09_Unevaluated_Properties 32.79295167863799 ns/iter 28.694435049021376 ns/iter 1.14
Micro_2019_09_Compile_Wrap 377094000.00005645 ns/iter 367221374.9999855 ns/iter 1.03
Micro_2020_12_Dynamic_Ref 285.80572858542286 ns/iter 214.7785461505219 ns/iter 1.33
Micro_2020_12_Dynamic_Ref_Single 3.7035020329856367 ns/iter 2.7252023719292913 ns/iter 1.36
Micro_2020_12_Simple_Output_Mask 1083.6348311352585 ns/iter 914.6081073508537 ns/iter 1.18
Micro_2020_12_Simple_Output_Annotations 123809.40422604693 ns/iter 98137.18457101287 ns/iter 1.26
Micro_2020_12_Compile_NonCircular_Shared_Refs 1176743.8400001202 ns/iter 1100478.4522520076 ns/iter 1.07
Micro_2020_12_Exhaustive_Deep_Numeric 6549.727335387101 ns/iter 5854.114691967209 ns/iter 1.12
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 165259.73258149292 ns/iter 138202.22934348037 ns/iter 1.20
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 18817.004271880895 ns/iter 15743.319691684921 ns/iter 1.20
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 120.46074757924303 ns/iter 129.202296895922 ns/iter 0.93
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 7031.97107623028 ns/iter 8288.955520587075 ns/iter 0.85
Alterschema_Check_Readibility_ISO_Language_Set_3 347280604.5000425 ns/iter 306556000.0000005 ns/iter 1.13
Alterschema_Check_Readibility_OMC 87349515.62499304 ns/iter 83432683.29999773 ns/iter 1.05
Alterschema_Check_Readibility_KrakenD 936467792.0000304 ns/iter 1013121374.9998552 ns/iter 0.92
Alterschema_Apply_Readibility_KrakenD 91555406791 ns/iter 96816744708.99997 ns/iter 0.95
Alterschema_Check_Invalid_External_Refs 190202104.24997684 ns/iter 215253062.49998266 ns/iter 0.88

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
E2E_Evaluator_adaptivecard 104607 ns 106030 ns 0.99
E2E_Evaluator_ansible-meta 326779 ns 430401 ns 0.76
E2E_Evaluator_aws-cdk 107337 ns 134856 ns 0.80
E2E_Evaluator_babelrc 253326 ns 271836 ns 0.93
E2E_Evaluator_cerebrum-criminal-case 1622801 ns 2291567 ns 0.71
E2E_Evaluator_clang-format 179977 ns 205636 ns 0.88
E2E_Evaluator_cmake-presets 11957678 ns 13879998 ns 0.86
E2E_Evaluator_code-climate 404246 ns 425548 ns 0.95
E2E_Evaluator_cql2 1000221 ns 1563234 ns 0.64
E2E_Evaluator_cspell 1362840 ns 1426135 ns 0.96
E2E_Evaluator_cypress 652366 ns 672207 ns 0.97
E2E_Evaluator_deno 808894 ns 1047733 ns 0.77
E2E_Evaluator_dependabot 932988 ns 1195607 ns 0.78
E2E_Evaluator_draft-04 18696925 ns 23813364 ns 0.79
E2E_Evaluator_fabric-mod 1884866 ns 1963891 ns 0.96
E2E_Evaluator_geojson 17258874 ns 17772443 ns 0.97
E2E_Evaluator_gitpod-configuration 574852 ns 638255 ns 0.90
E2E_Evaluator_helm-chart-lock 950572 ns 948397 ns 1.00
E2E_Evaluator_importmap 251798 ns 253385 ns 0.99
E2E_Evaluator_jasmine 241895 ns 261173 ns 0.93
E2E_Evaluator_jsconfig 1046661 ns 1002686 ns 1.04
E2E_Evaluator_jshintrc 2064160 ns 2304893 ns 0.90
E2E_Evaluator_krakend 472637 ns 536533 ns 0.88
E2E_Evaluator_lazygit 373054 ns 350459 ns 1.06
E2E_Evaluator_lerna 395858 ns 402560 ns 0.98
E2E_Evaluator_nest-cli 475586 ns 492477 ns 0.97
E2E_Evaluator_omc 81392 ns 79641 ns 1.02
E2E_Evaluator_omnisharp 1115379 ns 1202431 ns 0.93
E2E_Evaluator_openapi 18147196 ns 19578097 ns 0.93
E2E_Evaluator_pre-commit-hooks 1445791 ns 1624383 ns 0.89
E2E_Evaluator_pulumi 1727762 ns 2021228 ns 0.85
E2E_Evaluator_semantic-release 180295 ns 204380 ns 0.88
E2E_Evaluator_stale 289440 ns 374214 ns 0.77
E2E_Evaluator_stylecop 1134829 ns 1332783 ns 0.85
E2E_Evaluator_tmuxinator 176556 ns 189685 ns 0.93
E2E_Evaluator_ui5 1735669 ns 1952556 ns 0.89
E2E_Evaluator_ui5-manifest 11155194 ns 11000932 ns 1.01
E2E_Evaluator_unreal-engine-uproject 1369721 ns 1624008 ns 0.84
E2E_Evaluator_users-array 2908092 ns 2602809 ns 1.12
E2E_Evaluator_vercel 819108 ns 896951 ns 0.91
E2E_Evaluator_yamllint 24862 ns 27523 ns 0.90

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
Schema_Iterator_ISO_Language 3045894.7678572 ns/iter 3042554.593220094 ns/iter 1.00
Schema_Tracker_ISO_Language 4817698.272726394 ns/iter 4715673.821916948 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 20459721.17647419 ns/iter 20455663.29412154 ns/iter 1.00
Schema_Frame_WoT_References 5384427.09302386 ns/iter 5318245.938930976 ns/iter 1.01
Schema_Frame_OMC_References 21610103.56250159 ns/iter 22357678.40625158 ns/iter 0.97
Schema_Frame_OMC_Locations 19934948.485713124 ns/iter 20213105.61764601 ns/iter 0.99
Schema_Frame_ISO_Language_Locations 102579808.00001103 ns/iter 103404473.33336063 ns/iter 0.99
Schema_Frame_KrakenD_References 40123589.83334252 ns/iter 40959063.11764499 ns/iter 0.98
Schema_Frame_KrakenD_Reachable 554953974 ns/iter 590444498.9998865 ns/iter 0.94
Schema_Frame_ISO_Language_Locations_To_JSON 119513449.79997885 ns/iter 122076998.666671 ns/iter 0.98
Schema_Frame_Many_Resources_References 374133515.5000343 ns/iter 382452958.50003916 ns/iter 0.98
Schema_Bundle_Meta_2020_12 1755047.836682527 ns/iter 1746747.7443670374 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 113163849.33324267 ns/iter 111491449.4999842 ns/iter 1.02
E2E_Compiler_adaptivecard 65943191.09091306 ns/iter 65114581.54545835 ns/iter 1.01
E2E_Compiler_ansible_meta 29581418.458330214 ns/iter 30244090.82608461 ns/iter 0.98
E2E_Compiler_aws_cdk 392932.81710755883 ns/iter 393236.4451356701 ns/iter 1.00
E2E_Compiler_babelrc 2659417.1603051974 ns/iter 2673165.5725190216 ns/iter 0.99
E2E_Compiler_clang_format 18861755.567568988 ns/iter 19073650.648652874 ns/iter 0.99
E2E_Compiler_cmake_presets 26383285.66666604 ns/iter 26659623.192306124 ns/iter 0.99
E2E_Compiler_code_climate 2663491.916030733 ns/iter 2689390.9423078047 ns/iter 0.99
E2E_Compiler_cql2 13149782.716979798 ns/iter 13324097.566038411 ns/iter 0.99
E2E_Compiler_cspell 23462205.966666263 ns/iter 23803584.689654473 ns/iter 0.99
E2E_Compiler_cypress 4104646.9532162594 ns/iter 4136830.147929272 ns/iter 0.99
E2E_Compiler_deno 8114752.0348849865 ns/iter 8157632.802326483 ns/iter 0.99
E2E_Compiler_dependabot 4039858.421965829 ns/iter 4078908.0639535505 ns/iter 0.99
E2E_Compiler_draft_04 2795648.3705172767 ns/iter 2806255.288000102 ns/iter 1.00
E2E_Compiler_fabric_mod 4934146.19718415 ns/iter 4950929.936169215 ns/iter 1.00
E2E_Compiler_geojson 22601663.70967542 ns/iter 22769252.96774284 ns/iter 0.99
E2E_Compiler_gitpod_configuration 5105548.729927024 ns/iter 5112362.102189876 ns/iter 1.00
E2E_Compiler_helm_chart_lock 737282.0031644778 ns/iter 742353.277248772 ns/iter 0.99
E2E_Compiler_importmap 299816.29004703305 ns/iter 298301.5451064467 ns/iter 1.01
E2E_Compiler_jasmine 1421204.1135903744 ns/iter 1423912.603658712 ns/iter 1.00
E2E_Compiler_jshintrc 4537728.363637249 ns/iter 4559557.24183113 ns/iter 1.00
E2E_Compiler_jsconfig 22412124.322580628 ns/iter 22550326.838705998 ns/iter 0.99
E2E_Compiler_krakend 141907347.99999517 ns/iter 144711397.19998974 ns/iter 0.98
E2E_Compiler_lazygit 34031164.57143153 ns/iter 34582629.15000887 ns/iter 0.98
E2E_Compiler_lerna 1665042.1357142131 ns/iter 1671148.1285716174 ns/iter 1.00
E2E_Compiler_nest_cli 7707951.2857131045 ns/iter 7761587.5888896985 ns/iter 0.99
E2E_Compiler_omc 160436577.4999792 ns/iter 167044203.49998373 ns/iter 0.96
E2E_Compiler_omnisharp 6995166.090000566 ns/iter 7033384.040000783 ns/iter 0.99
E2E_Compiler_openapi 25897208.22222969 ns/iter 26424508.185182612 ns/iter 0.98
E2E_Compiler_pre_commit_hooks 5475071.695313361 ns/iter 5514131.905511738 ns/iter 0.99
E2E_Compiler_pulumi 4155337.769231218 ns/iter 4198318.491018686 ns/iter 0.99
E2E_Compiler_semantic_release 1620909.944444259 ns/iter 1631115.4265733766 ns/iter 0.99
E2E_Compiler_stale 1618834.4064666363 ns/iter 1625321.236658898 ns/iter 1.00
E2E_Compiler_stylecop 6428629.431192507 ns/iter 6454593.925927501 ns/iter 1.00
E2E_Compiler_tmuxinator 1999346.5071634208 ns/iter 2015374.083333197 ns/iter 0.99
E2E_Compiler_ui5 47740876.46666582 ns/iter 49442094.3077085 ns/iter 0.97
E2E_Compiler_ui5_manifest 320085224.49996233 ns/iter 334945516.49994266 ns/iter 0.96
E2E_Compiler_unreal_engine_uproject 4763386.101350952 ns/iter 4785908.417809642 ns/iter 1.00
E2E_Compiler_users_array 820044.9953377468 ns/iter 822330.727699659 ns/iter 1.00
E2E_Compiler_vercel 12790128.690907791 ns/iter 12912068.962965284 ns/iter 0.99
E2E_Compiler_yamllint 362898.70783598424 ns/iter 362995.94288683677 ns/iter 1.00
E2E_Evaluator_adaptivecard 25276.165042558794 ns/iter 26329.374656063734 ns/iter 0.96
E2E_Evaluator_ansible_meta 237721.84560577312 ns/iter 246972.90446083437 ns/iter 0.96
E2E_Evaluator_aws_cdk 51032.41122847847 ns/iter 50461.6673260032 ns/iter 1.01
E2E_Evaluator_babelrc 107127.15343345595 ns/iter 108166.67491387184 ns/iter 0.99
E2E_Evaluator_cerebrum_criminal_case 990898.9435027925 ns/iter 1029089.8577713 ns/iter 0.96
E2E_Evaluator_clang_format 117530.53250878048 ns/iter 120231.1361637357 ns/iter 0.98
E2E_Evaluator_cmake_presets 4404165.731707175 ns/iter 4291126.257668429 ns/iter 1.03
E2E_Evaluator_code_climate 179820.88454663407 ns/iter 180633.8997409389 ns/iter 1.00
E2E_Evaluator_cql2 210195.01636417615 ns/iter 225954.39722939557 ns/iter 0.93
E2E_Evaluator_cspell 585052.1514900421 ns/iter 584558.5559264268 ns/iter 1.00
E2E_Evaluator_cypress 190883.68641974923 ns/iter 190081.7819569527 ns/iter 1.00
E2E_Evaluator_deno 317801.4359560564 ns/iter 317203.2330723239 ns/iter 1.00
E2E_Evaluator_dependabot 324920.5876048347 ns/iter 331331.2192563791 ns/iter 0.98
E2E_Evaluator_draft_04 8816909.632908886 ns/iter 7681071.915662156 ns/iter 1.15
E2E_Evaluator_fabric_mod 672874.1298948922 ns/iter 667004.5488867742 ns/iter 1.01
E2E_Evaluator_geojson 19393520.944441255 ns/iter 20009210.58333284 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 237665.69084743378 ns/iter 237182.29075627791 ns/iter 1.00
E2E_Evaluator_helm_chart_lock 316825.5500227928 ns/iter 325044.37694421253 ns/iter 0.97
E2E_Evaluator_importmap 47220.881904233516 ns/iter 48237.145489819464 ns/iter 0.98
E2E_Evaluator_jasmine 106023.04121542592 ns/iter 107084.6237458144 ns/iter 0.99
E2E_Evaluator_jshintrc 1194348.7223171084 ns/iter 1197303.7025639229 ns/iter 1.00
E2E_Evaluator_jsconfig 422463.3335365702 ns/iter 424358.43264564325 ns/iter 1.00
E2E_Evaluator_krakend 210417.7797330354 ns/iter 210838.72533089836 ns/iter 1.00
E2E_Evaluator_lazygit 147602.52312322022 ns/iter 150449.1953578251 ns/iter 0.98
E2E_Evaluator_lerna 138351.4654100107 ns/iter 137357.63326845798 ns/iter 1.01
E2E_Evaluator_nest_cli 184502.9646745915 ns/iter 186182.71332980125 ns/iter 0.99
E2E_Evaluator_omc 19415.960062796028 ns/iter 18915.554374643707 ns/iter 1.03
E2E_Evaluator_omnisharp 613961.5048036176 ns/iter 611634.2770450391 ns/iter 1.00
E2E_Evaluator_openapi 12854744.44444356 ns/iter 10981235.444443796 ns/iter 1.17
E2E_Evaluator_pre_commit_hooks 480073.7578071025 ns/iter 490779.89437585033 ns/iter 0.98
E2E_Evaluator_pulumi 712987.7160495864 ns/iter 717556.8409785931 ns/iter 0.99
E2E_Evaluator_semantic_release 98713.03415799397 ns/iter 100416.97508234199 ns/iter 0.98
E2E_Evaluator_stale 149694.35357370303 ns/iter 147135.3248557331 ns/iter 1.02
E2E_Evaluator_stylecop 293263.52640333073 ns/iter 294174.7265854978 ns/iter 1.00
E2E_Evaluator_tmuxinator 97807.85831478242 ns/iter 99130.34479843266 ns/iter 0.99
E2E_Evaluator_ui5 507600.8507246669 ns/iter 514600.3692762569 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2589916.0629630084 ns/iter 2540661.887681124 ns/iter 1.02
E2E_Evaluator_unreal_engine_uproject 447108.4030514871 ns/iter 443891.7422024154 ns/iter 1.01
E2E_Evaluator_users_array 587845.1476794673 ns/iter 585285.077694354 ns/iter 1.00
E2E_Evaluator_vercel 317789.31008103583 ns/iter 320208.05131694244 ns/iter 0.99
E2E_Evaluator_yamllint 9022.531932489504 ns/iter 8961.386538903844 ns/iter 1.01
Micro_Draft4_Meta_1_No_Callback 201.2186856088217 ns/iter 208.03832744084414 ns/iter 0.97
Micro_Draft4_Required_Properties 793.6326292038354 ns/iter 790.7344438129617 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 24.037279198990134 ns/iter 23.255375940388685 ns/iter 1.03
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.22330442977996 ns/iter 11.22945753854482 ns/iter 1.00
Micro_Draft4_Items_Schema 279.06976795208476 ns/iter 279.5296320815441 ns/iter 1.00
Micro_Draft4_Nested_Object 1.7817184589609734 ns/iter 1.8005401743997353 ns/iter 0.99
Micro_Draft4_Properties_Triad_Optional 334.19920208373253 ns/iter 334.6576026034105 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 272.84431998057096 ns/iter 274.67543046834476 ns/iter 0.99
Micro_Draft4_Properties_Triad_Required 340.2653918134258 ns/iter 341.0382303764519 ns/iter 1.00
Micro_Draft4_Properties_Closed 57.226153859277304 ns/iter 61.02839874717254 ns/iter 0.94
Micro_Draft4_Non_Recursive_Ref 11.613247473799156 ns/iter 11.739160329718585 ns/iter 0.99
Micro_Draft4_Pattern_Properties_True 169.29022256924196 ns/iter 162.65512307964647 ns/iter 1.04
Micro_Draft4_Ref_To_Single_Property 11.235745905953346 ns/iter 11.214067895984401 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 21.56401581926043 ns/iter 21.92212825945124 ns/iter 0.98
Micro_Draft4_Nested_Oneof 58.93904057729736 ns/iter 58.876146009925144 ns/iter 1.00
Micro_Draft4_Short_Enum 12.360678369640945 ns/iter 9.980055062721577 ns/iter 1.24
Micro_Draft4_Long_Enum 15.281074177985593 ns/iter 15.281396887905396 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 12.23640293646839 ns/iter 9.975414209839537 ns/iter 1.23
Micro_Draft4_Type_Object 3.732572448352791 ns/iter 3.7410864331978453 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2455842.817543223 ns/iter 2452549.73776253 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1771936.4147585502 ns/iter 1782573.4822338002 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2442604.264808026 ns/iter 2433412.8749998743 ns/iter 1.00
Micro_Draft6_Property_Names 126.57951627016207 ns/iter 126.5312237532329 ns/iter 1.00
Micro_Draft6_Compile_FHIR 14587066714.999992 ns/iter 13353931673.000034 ns/iter 1.09
Micro_Draft7_If_Then_Else 24.298475865782535 ns/iter 24.34785033880011 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 27.414554111230547 ns/iter 26.49626364976721 ns/iter 1.03
Micro_2019_09_Compile_Wrap 324915427.5000592 ns/iter 298702164.4999004 ns/iter 1.09
Micro_2020_12_Dynamic_Ref 230.54803412739065 ns/iter 230.89806881775485 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 3.4268718925679296 ns/iter 3.4553023608250744 ns/iter 0.99
Micro_2020_12_Simple_Output_Mask 1087.7609919807458 ns/iter 1084.4471627486075 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 104526.69655581146 ns/iter 105687.0089016364 ns/iter 0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs 1136065.907014843 ns/iter 1135322.9886732788 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 8156.647637315581 ns/iter 8498.390254206408 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 181398.98772850027 ns/iter 178714.72861509884 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22588.78700687293 ns/iter 23355.070817302745 ns/iter 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 142.51524686145228 ns/iter 143.1338411533507 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4348.850148257061 ns/iter 4499.240699096208 ns/iter 0.97
Alterschema_Check_Readibility_ISO_Language_Set_3 380164277.50005734 ns/iter 378578610.99996626 ns/iter 1.00
Alterschema_Check_Readibility_OMC 87247287.24999408 ns/iter 83058332.7499994 ns/iter 1.05
Alterschema_Check_Readibility_KrakenD 1227933768.0001845 ns/iter 1174511555.9999704 ns/iter 1.05
Alterschema_Apply_Readibility_KrakenD 119020470875.00023 ns/iter 117388633452.00002 ns/iter 1.01
Alterschema_Check_Invalid_External_Refs 295409694.49999464 ns/iter 305950772.4999548 ns/iter 0.97

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
E2E_Evaluator_adaptivecard 119885 ns 117405 ns 1.02
E2E_Evaluator_ansible-meta 534275 ns 529329 ns 1.01
E2E_Evaluator_aws-cdk 142620 ns 139853 ns 1.02
E2E_Evaluator_babelrc 334871 ns 329612 ns 1.02
E2E_Evaluator_cerebrum-criminal-case 2580449 ns 2569474 ns 1.00
E2E_Evaluator_clang-format 261102 ns 265242 ns 0.98
E2E_Evaluator_cmake-presets 18443068 ns 17756460 ns 1.04
E2E_Evaluator_code-climate 503433 ns 511919 ns 0.98
E2E_Evaluator_cql2 1238477 ns 1254156 ns 0.99
E2E_Evaluator_cspell 1505196 ns 1476225 ns 1.02
E2E_Evaluator_cypress 789292 ns 798119 ns 0.99
E2E_Evaluator_deno 1073595 ns 1057782 ns 1.01
E2E_Evaluator_dependabot 1238694 ns 1167585 ns 1.06
E2E_Evaluator_draft-04 26981885 ns 20680215 ns 1.30
E2E_Evaluator_fabric-mod 2398340 ns 2366212 ns 1.01
E2E_Evaluator_geojson 20658932 ns 21845569 ns 0.95
E2E_Evaluator_gitpod-configuration 726406 ns 717928 ns 1.01
E2E_Evaluator_helm-chart-lock 1002490 ns 1004020 ns 1.00
E2E_Evaluator_importmap 268261 ns 259664 ns 1.03
E2E_Evaluator_jasmine 301874 ns 291500 ns 1.04
E2E_Evaluator_jsconfig 1243425 ns 1293490 ns 0.96
E2E_Evaluator_jshintrc 2763990 ns 2809290 ns 0.98
E2E_Evaluator_krakend 675959 ns 697083 ns 0.97
E2E_Evaluator_lazygit 517669 ns 508806 ns 1.02
E2E_Evaluator_lerna 470221 ns 460839 ns 1.02
E2E_Evaluator_nest-cli 611160 ns 595197 ns 1.03
E2E_Evaluator_omc 93335 ns 91343 ns 1.02
E2E_Evaluator_omnisharp 1452953 ns 1406511 ns 1.03
E2E_Evaluator_openapi 25300174 ns 26163561 ns 0.97
E2E_Evaluator_pre-commit-hooks 1993010 ns 2018702 ns 0.99
E2E_Evaluator_pulumi 1900606 ns 1908420 ns 1.00
E2E_Evaluator_semantic-release 246798 ns 255149 ns 0.97
E2E_Evaluator_stale 420171 ns 396175 ns 1.06
E2E_Evaluator_stylecop 1240714 ns 1262868 ns 0.98
E2E_Evaluator_tmuxinator 227079 ns 224005 ns 1.01
E2E_Evaluator_ui5 2398101 ns 2336240 ns 1.03
E2E_Evaluator_ui5-manifest 12135844 ns 10627674 ns 1.14
E2E_Evaluator_unreal-engine-uproject 1521468 ns 1543307 ns 0.99
E2E_Evaluator_users-array 2839434 ns 2507315 ns 1.13
E2E_Evaluator_vercel 1022501 ns 1026220 ns 1.00
E2E_Evaluator_yamllint 26045 ns 25683 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 327448376.99999607 ns/iter 386391319.50003505 ns/iter 0.85
Alterschema_Check_Readibility_OMC 96915155.00000085 ns/iter 97329007.99999048 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1535551252.9999943 ns/iter 1362082009.0000052 ns/iter 1.13
Alterschema_Apply_Readibility_KrakenD 153125981820.0001 ns/iter 128042887675.99997 ns/iter 1.20
Alterschema_Check_Invalid_External_Refs 249398651.00001648 ns/iter 339250366.5000959 ns/iter 0.74
Micro_2020_12_Dynamic_Ref 292.7552900265926 ns/iter 268.35242675258183 ns/iter 1.09
Micro_2020_12_Dynamic_Ref_Single 4.101957753867429 ns/iter 4.671339151245625 ns/iter 0.88
Micro_2020_12_Simple_Output_Mask 1047.0123223286996 ns/iter 1168.1875864069705 ns/iter 0.90
Micro_2020_12_Simple_Output_Annotations 112117.73901055496 ns/iter 120298.89252657173 ns/iter 0.93
Micro_2020_12_Compile_NonCircular_Shared_Refs 1159894.276033134 ns/iter 1291806.7851850772 ns/iter 0.90
Micro_2020_12_Exhaustive_Deep_Numeric 9176.05177419422 ns/iter 8867.876239796651 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 140907.4723779268 ns/iter 166040.7596899704 ns/iter 0.85
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 24298.040008290056 ns/iter 25395.197641937433 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 156.3188858901486 ns/iter 179.00749189336335 ns/iter 0.87
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4649.17429217077 ns/iter 4911.880551624459 ns/iter 0.95
Micro_2019_09_Unevaluated_Properties 25.973917955343957 ns/iter 28.65873777028704 ns/iter 0.91
Micro_2019_09_Compile_Wrap 297926415.00000626 ns/iter 335356797.0000313 ns/iter 0.89
Micro_Draft7_If_Then_Else 22.18703817731238 ns/iter 24.628505126831108 ns/iter 0.90
Micro_Draft6_Property_Names 143.07768917164995 ns/iter 150.66506283820758 ns/iter 0.95
Micro_Draft6_Compile_FHIR 17048072489.000105 ns/iter 12865413173.000206 ns/iter 1.33
Micro_Draft4_Meta_1_No_Callback 186.65942858598763 ns/iter 182.16981200697833 ns/iter 1.02
Micro_Draft4_Required_Properties 783.904656644525 ns/iter 833.1394370269634 ns/iter 0.94
Micro_Draft4_Many_Optional_Properties_Minimal_Match 24.309980116223706 ns/iter 20.868727703413235 ns/iter 1.16
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.618981711142002 ns/iter 13.439972487903162 ns/iter 0.86
Micro_Draft4_Items_Schema 277.038665965703 ns/iter 324.6024216002958 ns/iter 0.85
Micro_Draft4_Nested_Object 1.7889361618784354 ns/iter 1.8747295786472598 ns/iter 0.95
Micro_Draft4_Properties_Triad_Optional 316.97609082927784 ns/iter 391.5014781552781 ns/iter 0.81
Micro_Draft4_Properties_Triad_Closed 266.15529481222455 ns/iter 324.8652686536835 ns/iter 0.82
Micro_Draft4_Properties_Triad_Required 350.2084283661218 ns/iter 421.0161636452248 ns/iter 0.83
Micro_Draft4_Properties_Closed 64.74798144248965 ns/iter 63.607100374951024 ns/iter 1.02
Micro_Draft4_Non_Recursive_Ref 8.434483481152071 ns/iter 9.353995440523384 ns/iter 0.90
Micro_Draft4_Pattern_Properties_True 168.26579225988093 ns/iter 211.38320811728522 ns/iter 0.80
Micro_Draft4_Ref_To_Single_Property 11.952874157030823 ns/iter 13.756970267683515 ns/iter 0.87
Micro_Draft4_Additional_Properties_Type 12.826153116576652 ns/iter 14.347517851846007 ns/iter 0.89
Micro_Draft4_Nested_Oneof 56.53103472697739 ns/iter 63.1672269944537 ns/iter 0.89
Micro_Draft4_Short_Enum 10.898299555678852 ns/iter 14.695093372017261 ns/iter 0.74
Micro_Draft4_Long_Enum 11.986954119608532 ns/iter 14.869127020945664 ns/iter 0.81
Micro_Draft4_Long_Enum_Short_Strings 10.945992023551845 ns/iter 14.680023537822537 ns/iter 0.75
Micro_Draft4_Type_Object 4.034683967834814 ns/iter 4.673043963086354 ns/iter 0.86
Micro_Draft4_Ref_Single_100 2345820.2006692705 ns/iter 2637246.369811623 ns/iter 0.89
Micro_Draft4_Compile_Ref_Many_Nested 1740230.2029706945 ns/iter 1901487.7568306623 ns/iter 0.92
Micro_Draft4_Compile_Wrap 2432911.613240217 ns/iter 2705485.311538234 ns/iter 0.90
E2E_Compiler_adaptivecard 64146009.00000716 ns/iter 70560436.99999464 ns/iter 0.91
E2E_Compiler_ansible_meta 28368671.4400028 ns/iter 32895681.476193637 ns/iter 0.86
E2E_Compiler_aws_cdk 398947.0538065985 ns/iter 457961.713818006 ns/iter 0.87
E2E_Compiler_babelrc 2617090.2684818557 ns/iter 2945855.4127659034 ns/iter 0.89
E2E_Compiler_clang_format 18256997.657892115 ns/iter 20627640.58823899 ns/iter 0.89
E2E_Compiler_cmake_presets 25998780.444448736 ns/iter 28170472.880001396 ns/iter 0.92
E2E_Compiler_code_climate 2703938.0228141197 ns/iter 2994802.24786348 ns/iter 0.90
E2E_Compiler_cql2 13521757.884614788 ns/iter 14574654.249997819 ns/iter 0.93
E2E_Compiler_cspell 23075246.499994744 ns/iter 25032577.678570893 ns/iter 0.92
E2E_Compiler_cypress 3972700.530726167 ns/iter 4298179.1337581035 ns/iter 0.92
E2E_Compiler_deno 7813190.5505630085 ns/iter 8881564.670886453 ns/iter 0.88
E2E_Compiler_dependabot 3933358.432584172 ns/iter 4483554.5159234945 ns/iter 0.88
E2E_Compiler_draft_04 2827686.502023573 ns/iter 3173100.819004211 ns/iter 0.89
E2E_Compiler_fabric_mod 4886696.0555563485 ns/iter 5500678.085937238 ns/iter 0.89
E2E_Compiler_geojson 23347963.833331656 ns/iter 25278800.821427338 ns/iter 0.92
E2E_Compiler_gitpod_configuration 5000456.05036026 ns/iter 5587012.94400089 ns/iter 0.90
E2E_Compiler_helm_chart_lock 704497.8098591374 ns/iter 817473.7389277326 ns/iter 0.86
E2E_Compiler_importmap 298257.30863156327 ns/iter 342267.44162196736 ns/iter 0.87
E2E_Compiler_jasmine 1419752.7935221302 ns/iter 1590816.7664398914 ns/iter 0.89
E2E_Compiler_jshintrc 4320773.740740735 ns/iter 4981491.464286591 ns/iter 0.87
E2E_Compiler_jsconfig 21207886.969691437 ns/iter 24028111.62068999 ns/iter 0.88
E2E_Compiler_krakend 137064591.6000285 ns/iter 157001577.75000888 ns/iter 0.87
E2E_Compiler_lazygit 33613901.52380885 ns/iter 37290432.63158354 ns/iter 0.90
E2E_Compiler_lerna 1664182.2369667129 ns/iter 1876424.9037432557 ns/iter 0.89
E2E_Compiler_nest_cli 7476447.19148837 ns/iter 8457958.433733022 ns/iter 0.88
E2E_Compiler_omc 166800982.50003538 ns/iter 183796470.49999905 ns/iter 0.91
E2E_Compiler_omnisharp 6765598.733333415 ns/iter 7629586.239130256 ns/iter 0.89
E2E_Compiler_openapi 25964682.74073568 ns/iter 28983121.79166851 ns/iter 0.90
E2E_Compiler_pre_commit_hooks 5265824.616541218 ns/iter 6033432.206897001 ns/iter 0.87
E2E_Compiler_pulumi 4138127.7692313264 ns/iter 4632521.867550179 ns/iter 0.89
E2E_Compiler_semantic_release 1641855.2253523082 ns/iter 1839513.0367454046 ns/iter 0.89
E2E_Compiler_stale 1591104.8018223438 ns/iter 1787295.5268539535 ns/iter 0.89
E2E_Compiler_stylecop 5920030.016950014 ns/iter 6966432.3465360105 ns/iter 0.85
E2E_Compiler_tmuxinator 2001096.6923077272 ns/iter 2267900.9093853394 ns/iter 0.88
E2E_Compiler_ui5 48926280.5333207 ns/iter 51276923.14285273 ns/iter 0.95
E2E_Compiler_ui5_manifest 315294109.4999733 ns/iter 347361728.00000983 ns/iter 0.91
E2E_Compiler_unreal_engine_uproject 4612342.868420838 ns/iter 5216515.088888492 ns/iter 0.88
E2E_Compiler_users_array 867902.3465837027 ns/iter 935202.3097464422 ns/iter 0.93
E2E_Compiler_vercel 12447644.3749992 ns/iter 13568995.411765618 ns/iter 0.92
E2E_Compiler_yamllint 363973.87922950037 ns/iter 417690.41900767083 ns/iter 0.87
E2E_Evaluator_adaptivecard 22661.91794438791 ns/iter 24023.44109788935 ns/iter 0.94
E2E_Evaluator_ansible_meta 232704.93783416483 ns/iter 265867.0582891411 ns/iter 0.88
E2E_Evaluator_aws_cdk 52251.87642131168 ns/iter 55955.57070225654 ns/iter 0.93
E2E_Evaluator_babelrc 98935.77709900675 ns/iter 107291.85175726529 ns/iter 0.92
E2E_Evaluator_cerebrum_criminal_case 1149297.838283664 ns/iter 1095373.8634920488 ns/iter 1.05
E2E_Evaluator_clang_format 105184.69525962391 ns/iter 111522.49231013375 ns/iter 0.94
E2E_Evaluator_cmake_presets 5796810.731092538 ns/iter 5740451.403362997 ns/iter 1.01
E2E_Evaluator_code_climate 204444.39185603248 ns/iter 199192.94355761714 ns/iter 1.03
E2E_Evaluator_cql2 196580.194979055 ns/iter 226345.2236462508 ns/iter 0.87
E2E_Evaluator_cspell 545430.0054815025 ns/iter 560398.2365246031 ns/iter 0.97
E2E_Evaluator_cypress 164271.63987819853 ns/iter 181239.01042213256 ns/iter 0.91
E2E_Evaluator_deno 376143.49705094274 ns/iter 355342.5050709943 ns/iter 1.06
E2E_Evaluator_dependabot 383332.7550463815 ns/iter 392261.274972554 ns/iter 0.98
E2E_Evaluator_draft_04 8694186.762500066 ns/iter 10293620.98437403 ns/iter 0.84
E2E_Evaluator_fabric_mod 762400.6069868916 ns/iter 792073.8134243503 ns/iter 0.96
E2E_Evaluator_geojson 18321716.631577913 ns/iter 18870096.189187746 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 265139.2649056776 ns/iter 274744.5466033892 ns/iter 0.97
E2E_Evaluator_helm_chart_lock 363291.6129707452 ns/iter 324510.69723107066 ns/iter 1.12
E2E_Evaluator_importmap 34338.37567318452 ns/iter 52519.476807292034 ns/iter 0.65
E2E_Evaluator_jasmine 111693.20309261687 ns/iter 118134.5161563126 ns/iter 0.95
E2E_Evaluator_jshintrc 1100340.7331237802 ns/iter 1070521.9709480796 ns/iter 1.03
E2E_Evaluator_jsconfig 370742.55093333096 ns/iter 413497.2742993305 ns/iter 0.90
E2E_Evaluator_krakend 181675.5895697438 ns/iter 225621.455097521 ns/iter 0.81
E2E_Evaluator_lazygit 127315.72164949318 ns/iter 149392.2520757883 ns/iter 0.85
E2E_Evaluator_lerna 195176.67318976895 ns/iter 174570.27573996983 ns/iter 1.12
E2E_Evaluator_nest_cli 200986.76706828224 ns/iter 203604.2456757899 ns/iter 0.99
E2E_Evaluator_omc 18432.530140250172 ns/iter 19148.760390736385 ns/iter 0.96
E2E_Evaluator_omnisharp 583228.9339464053 ns/iter 574134.3793949409 ns/iter 1.02
E2E_Evaluator_openapi 10929180.649124024 ns/iter 12703872.66071436 ns/iter 0.86
E2E_Evaluator_pre_commit_hooks 549354.5219436011 ns/iter 549922.2025218089 ns/iter 1.00
E2E_Evaluator_pulumi 806936.6824478215 ns/iter 765935.3439561487 ns/iter 1.05
E2E_Evaluator_semantic_release 86530.65634978517 ns/iter 105074.99540193999 ns/iter 0.82
E2E_Evaluator_stale 159802.73254222702 ns/iter 171990.9862373798 ns/iter 0.93
E2E_Evaluator_stylecop 303324.369546608 ns/iter 318470.18835301587 ns/iter 0.95
E2E_Evaluator_tmuxinator 92193.36494125474 ns/iter 103664.87390725834 ns/iter 0.89
E2E_Evaluator_ui5 519310.4091248219 ns/iter 565308.3565638623 ns/iter 0.92
E2E_Evaluator_ui5_manifest 2879458.6681414354 ns/iter 3032420.337553133 ns/iter 0.95
E2E_Evaluator_unreal_engine_uproject 460735.62142849714 ns/iter 485865.64275754546 ns/iter 0.95
E2E_Evaluator_users_array 656761.9050331314 ns/iter 647802.3432557462 ns/iter 1.01
E2E_Evaluator_vercel 369714.87307479174 ns/iter 342112.0475489742 ns/iter 1.08
E2E_Evaluator_yamllint 9638.007119607231 ns/iter 10854.984922346022 ns/iter 0.89
Schema_Format_ISO_Language_To_JSON 105436430.57144436 ns/iter 118564694.00000454 ns/iter 0.89
Schema_Bundle_Meta_2020_12 1823095.6458313111 ns/iter 2047335.9854234492 ns/iter 0.89
Schema_Frame_WoT_References 5321919.335877817 ns/iter 6024170.017242184 ns/iter 0.88
Schema_Frame_OMC_References 23235976.533336118 ns/iter 24998887.321430627 ns/iter 0.93
Schema_Frame_OMC_Locations 21912349.151514057 ns/iter 22949517.30000321 ns/iter 0.95
Schema_Frame_ISO_Language_Locations 100598478.4285699 ns/iter 110482550.66665055 ns/iter 0.91
Schema_Frame_KrakenD_References 42835746.647062264 ns/iter 45997455.666656606 ns/iter 0.93
Schema_Frame_KrakenD_Reachable 725995566.9999272 ns/iter 581629209.9998463 ns/iter 1.25
Schema_Frame_ISO_Language_Locations_To_JSON 193104294.49996036 ns/iter 193331532.00000197 ns/iter 1.00
Schema_Frame_Many_Resources_References 370457631.50001675 ns/iter 409681773.9999778 ns/iter 0.90
Schema_Iterator_ISO_Language 3690709.3789463225 ns/iter 4047684.526011904 ns/iter 0.91
Schema_Tracker_ISO_Language 5564479.570312031 ns/iter 5714422.83739813 ns/iter 0.97
Schema_Tracker_ISO_Language_To_JSON 31661407.77272052 ns/iter 29828244.583332736 ns/iter 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: e4d8e87 Previous: 887b6ee Ratio
E2E_Evaluator_adaptivecard 112059 ns 119759 ns 0.94
E2E_Evaluator_ansible-meta 540412 ns 538880 ns 1.00
E2E_Evaluator_aws-cdk 147430 ns 142165 ns 1.04
E2E_Evaluator_babelrc 462028 ns 328321 ns 1.41
E2E_Evaluator_cerebrum-criminal-case 2500236 ns 2591529 ns 0.96
E2E_Evaluator_clang-format 322191 ns 260694 ns 1.24
E2E_Evaluator_cmake-presets 18634950 ns 18807022 ns 0.99
E2E_Evaluator_code-climate 542101 ns 505391 ns 1.07
E2E_Evaluator_cql2 1198344 ns 1227862 ns 0.98
E2E_Evaluator_cspell 1785868 ns 1537523 ns 1.16
E2E_Evaluator_cypress 1006247 ns 778325 ns 1.29
E2E_Evaluator_deno 1174241 ns 1107531 ns 1.06
E2E_Evaluator_dependabot 1214452 ns 1149713 ns 1.06
E2E_Evaluator_draft-04 25920348 ns 28132533 ns 0.92
E2E_Evaluator_fabric-mod 2396151 ns 2370111 ns 1.01
E2E_Evaluator_geojson 25636694 ns 19708681 ns 1.30
E2E_Evaluator_gitpod-configuration 811508 ns 723578 ns 1.12
E2E_Evaluator_helm-chart-lock 1063444 ns 1024000 ns 1.04
E2E_Evaluator_importmap 320472 ns 272753 ns 1.17
E2E_Evaluator_jasmine 339750 ns 298110 ns 1.14
E2E_Evaluator_jsconfig 1662752 ns 1267804 ns 1.31
E2E_Evaluator_jshintrc 3030852 ns 2755437 ns 1.10
E2E_Evaluator_krakend 623422 ns 682489 ns 0.91
E2E_Evaluator_lazygit 498783 ns 520151 ns 0.96
E2E_Evaluator_lerna 487263 ns 476151 ns 1.02
E2E_Evaluator_nest-cli 717369 ns 615883 ns 1.16
E2E_Evaluator_omc 87916 ns 93069 ns 0.94
E2E_Evaluator_omnisharp 1525787 ns 1430251 ns 1.07
E2E_Evaluator_openapi 24000087 ns 27762316 ns 0.86
E2E_Evaluator_pre-commit-hooks 2151456 ns 2100329 ns 1.02
E2E_Evaluator_pulumi 2131124 ns 1925830 ns 1.11
E2E_Evaluator_semantic-release 294714 ns 258474 ns 1.14
E2E_Evaluator_stale 454252 ns 398341 ns 1.14
E2E_Evaluator_stylecop 1257268 ns 1247839 ns 1.01
E2E_Evaluator_tmuxinator 312423 ns 227094 ns 1.38
E2E_Evaluator_ui5 2247607 ns 2318196 ns 0.97
E2E_Evaluator_ui5-manifest 11663456 ns 13569845 ns 0.86
E2E_Evaluator_unreal-engine-uproject 1751499 ns 1569373 ns 1.12
E2E_Evaluator_users-array 2536085 ns 2560406 ns 0.99
E2E_Evaluator_vercel 1083013 ns 1007873 ns 1.07
E2E_Evaluator_yamllint 26691 ns 25696 ns 1.04

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 98565db into main May 29, 2026
14 checks passed
@jviotti jviotti deleted the new-suite-no-patches branch May 29, 2026 20:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant