Skip to content

Support the 2020-12 format assertion vocabulary#839

Merged
jviotti merged 2 commits into
mainfrom
2020-12-format
May 29, 2026
Merged

Support the 2020-12 format assertion vocabulary#839
jviotti merged 2 commits into
mainfrom
2020-12-format

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 29, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 8 files

Tip: cubic can generate docs of your entire codebase and keep them up to date. Try it here.

Re-trigger cubic

Comment thread src/compiler/default_compiler_draft3.h
@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 29, 2026

🤖 Augment PR Summary

Summary: This PR adds first-class support for the JSON Schema 2020-12 format-assertion vocabulary so that format can be evaluated as an assertion (not only as an annotation).

Changes:

  • Registers JSON_Schema_2020_12_Format_Assertion as a supported vocabulary and wires it to the format compiler path.
  • Extends compiler_draft3_validation_format to treat 2020-12 format-assertion as asserting, and to allow the existing format_assertion tweak to force assertion semantics for 2020-12 format-annotation.
  • Removes the previous “tweak not supported in this dialect” behavior for 2020-12 format handling.
  • Updates test resolvers/fixtures to keep an “unsupported vocabulary” coverage path now that format-assertion is supported.
  • Adds extensive 2020-12 evaluator coverage for asserting format across many built-in formats (fast/exhaustive, valid/invalid, string/non-string).
  • Enables the JSON Schema Official Test Suite’s 2020-12 optional format cases by running them with Tweaks{ .format_assertion = true }.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread test/evaluator/evaluator_openapi_3_1_test.cc
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
Schema_Iterator_ISO_Language 3130181.7409092276 ns/iter 3049389.446808628 ns/iter 1.03
Schema_Tracker_ISO_Language 5122408.000000636 ns/iter 5005632.819999164 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 21231029.424239807 ns/iter 20903081.21211999 ns/iter 1.02
Schema_Frame_WoT_References 5332724.213741054 ns/iter 5319375.221374303 ns/iter 1.00
Schema_Frame_OMC_References 24861753.571428835 ns/iter 22537380.645160504 ns/iter 1.10
Schema_Frame_OMC_Locations 22704516.77419817 ns/iter 21073119.093749426 ns/iter 1.08
Schema_Frame_ISO_Language_Locations 110973287.16664378 ns/iter 107375421.5000046 ns/iter 1.03
Schema_Frame_KrakenD_References 46663445.533340566 ns/iter 42766961.31250191 ns/iter 1.09
Schema_Frame_KrakenD_Reachable 701366377.9998751 ns/iter 672548330.0001543 ns/iter 1.04
Schema_Frame_ISO_Language_Locations_To_JSON 126743451.7499737 ns/iter 122423211.6666523 ns/iter 1.04
Schema_Frame_Many_Resources_References 383851733.99990433 ns/iter 382262981.0000535 ns/iter 1.00
Schema_Bundle_Meta_2020_12 1740117.7512501865 ns/iter 1765998.5984885157 ns/iter 0.99
Schema_Format_ISO_Language_To_JSON 116675656.99993551 ns/iter 114916806.16666144 ns/iter 1.02
E2E_Compiler_adaptivecard 68038441.59999244 ns/iter 66696247.54545111 ns/iter 1.02
E2E_Compiler_ansible_meta 29942750.130430795 ns/iter 30623307.130435538 ns/iter 0.98
E2E_Compiler_aws_cdk 392192.44456884486 ns/iter 394424.55180186377 ns/iter 0.99
E2E_Compiler_babelrc 2661654.5171103654 ns/iter 2673038.1072798343 ns/iter 1.00
E2E_Compiler_clang_format 19133038.10810912 ns/iter 19134702.10810546 ns/iter 1.00
E2E_Compiler_cmake_presets 27296128.87999792 ns/iter 27048022.461538214 ns/iter 1.01
E2E_Compiler_code_climate 2677904.7931039054 ns/iter 2695513.0115381437 ns/iter 0.99
E2E_Compiler_cql2 13388116.9056596 ns/iter 13493353.730767082 ns/iter 0.99
E2E_Compiler_cspell 23971283.689661503 ns/iter 23911887.86206275 ns/iter 1.00
E2E_Compiler_cypress 4095798.9590650448 ns/iter 4143704.0946737444 ns/iter 0.99
E2E_Compiler_deno 8124859.441861275 ns/iter 8146382.325583354 ns/iter 1.00
E2E_Compiler_dependabot 4061316.261627749 ns/iter 4082924.8837207328 ns/iter 0.99
E2E_Compiler_draft_04 2801441.5823292667 ns/iter 2814814.6305222074 ns/iter 1.00
E2E_Compiler_fabric_mod 4959443.404256122 ns/iter 4962894.609927892 ns/iter 1.00
E2E_Compiler_geojson 23277842.499995433 ns/iter 22897278.13332926 ns/iter 1.02
E2E_Compiler_gitpod_configuration 5078310.072464603 ns/iter 5136656.9191168975 ns/iter 0.99
E2E_Compiler_helm_chart_lock 736301.4396642726 ns/iter 741293.9936239707 ns/iter 0.99
E2E_Compiler_importmap 298798.9559264221 ns/iter 300494.88588586054 ns/iter 0.99
E2E_Compiler_jasmine 1420336.6169353207 ns/iter 1420950.824489855 ns/iter 1.00
E2E_Compiler_jshintrc 4566956.033112251 ns/iter 4553057.896103311 ns/iter 1.00
E2E_Compiler_jsconfig 23029153.53333598 ns/iter 22673851.580645617 ns/iter 1.02
E2E_Compiler_krakend 159072019.50000173 ns/iter 150255332.0000061 ns/iter 1.06
E2E_Compiler_lazygit 35416713.50000115 ns/iter 34456478.79999569 ns/iter 1.03
E2E_Compiler_lerna 1673301.7095237388 ns/iter 1676420.3831327728 ns/iter 1.00
E2E_Compiler_nest_cli 7722994.681319175 ns/iter 7804959.166666473 ns/iter 0.99
E2E_Compiler_omc 171167340.5000056 ns/iter 169084370.74999937 ns/iter 1.01
E2E_Compiler_omnisharp 6968438.792079391 ns/iter 7009395.249999669 ns/iter 0.99
E2E_Compiler_openapi 26342556.9259181 ns/iter 26458588.96296347 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5478206.425196037 ns/iter 5526385.393700259 ns/iter 0.99
E2E_Compiler_pulumi 4172636.3452393604 ns/iter 4186297.180124412 ns/iter 1.00
E2E_Compiler_semantic_release 1613079.557604105 ns/iter 1634019.4825177537 ns/iter 0.99
E2E_Compiler_stale 1636613.7099766852 ns/iter 1625771.1864801531 ns/iter 1.01
E2E_Compiler_stylecop 6385419.099999787 ns/iter 6458503.583332829 ns/iter 0.99
E2E_Compiler_tmuxinator 2006089.8538679439 ns/iter 2030837.3448272862 ns/iter 0.99
E2E_Compiler_ui5 51535485.21427963 ns/iter 53739810.699994445 ns/iter 0.96
E2E_Compiler_ui5_manifest 340426436.00002974 ns/iter 341188535.5000095 ns/iter 1.00
E2E_Compiler_unreal_engine_uproject 4726445.9189185845 ns/iter 4783055.836733926 ns/iter 0.99
E2E_Compiler_users_array 815811.0780885771 ns/iter 824647.2220903202 ns/iter 0.99
E2E_Compiler_vercel 13044618.981134675 ns/iter 12861061.148147132 ns/iter 1.01
E2E_Compiler_yamllint 361779.3459152465 ns/iter 364996.09422184667 ns/iter 0.99
E2E_Evaluator_adaptivecard 24764.702414388044 ns/iter 26130.717144139217 ns/iter 0.95
E2E_Evaluator_ansible_meta 232851.19633939952 ns/iter 246131.73693256598 ns/iter 0.95
E2E_Evaluator_aws_cdk 50813.90642296543 ns/iter 50795.10904585531 ns/iter 1.00
E2E_Evaluator_babelrc 107111.99189973887 ns/iter 107477.20190240839 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 999876.9713468687 ns/iter 1007004.243831736 ns/iter 0.99
E2E_Evaluator_clang_format 116792.99705523654 ns/iter 117256.81320531717 ns/iter 1.00
E2E_Evaluator_cmake_presets 5693931.074999152 ns/iter 4692049.455695868 ns/iter 1.21
E2E_Evaluator_code_climate 180744.84653338522 ns/iter 182308.23997942003 ns/iter 0.99
E2E_Evaluator_cql2 215477.9629076169 ns/iter 222878.60148515162 ns/iter 0.97
E2E_Evaluator_cspell 580927.8169128555 ns/iter 589778.8535566023 ns/iter 0.98
E2E_Evaluator_cypress 191035.69253894227 ns/iter 190282.43164486822 ns/iter 1.00
E2E_Evaluator_deno 320613.240054904 ns/iter 312474.34539768414 ns/iter 1.03
E2E_Evaluator_dependabot 326996.35170479066 ns/iter 329727.5503731685 ns/iter 0.99
E2E_Evaluator_draft_04 11521754.17460346 ns/iter 10533800.377050014 ns/iter 1.09
E2E_Evaluator_fabric_mod 677543.1841851671 ns/iter 668424.1028846845 ns/iter 1.01
E2E_Evaluator_geojson 19528626.30555627 ns/iter 20041074.657144368 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 235261.59986150466 ns/iter 234688.0288526361 ns/iter 1.00
E2E_Evaluator_helm_chart_lock 312624.95450444985 ns/iter 319890.7687356982 ns/iter 0.98
E2E_Evaluator_importmap 49773.044066884766 ns/iter 48392.88255861698 ns/iter 1.03
E2E_Evaluator_jasmine 109653.85270352264 ns/iter 105959.68063781786 ns/iter 1.03
E2E_Evaluator_jshintrc 1190580.436116016 ns/iter 1203139.2674616715 ns/iter 0.99
E2E_Evaluator_jsconfig 424604.70777638536 ns/iter 422509.1614268544 ns/iter 1.00
E2E_Evaluator_krakend 213319.46275114335 ns/iter 216072.35622320249 ns/iter 0.99
E2E_Evaluator_lazygit 149359.88680466724 ns/iter 148411.73749736013 ns/iter 1.01
E2E_Evaluator_lerna 137232.79759084017 ns/iter 138255.80639428154 ns/iter 0.99
E2E_Evaluator_nest_cli 184938.5216456029 ns/iter 184747.26700186793 ns/iter 1.00
E2E_Evaluator_omc 19837.73462643924 ns/iter 19329.97920395315 ns/iter 1.03
E2E_Evaluator_omnisharp 624767.2335701372 ns/iter 609465.474235946 ns/iter 1.03
E2E_Evaluator_openapi 12473503.946430193 ns/iter 12271003.245900158 ns/iter 1.02
E2E_Evaluator_pre_commit_hooks 476899.9856752569 ns/iter 478171.15654720156 ns/iter 1.00
E2E_Evaluator_pulumi 716027.8924950891 ns/iter 710855.4030303297 ns/iter 1.01
E2E_Evaluator_semantic_release 122897.96943662969 ns/iter 98180.86261576612 ns/iter 1.25
E2E_Evaluator_stale 148717.36982249265 ns/iter 147998.22390573134 ns/iter 1.00
E2E_Evaluator_stylecop 290484.0695254037 ns/iter 290741.16273289255 ns/iter 1.00
E2E_Evaluator_tmuxinator 98828.10867133662 ns/iter 98903.58687420569 ns/iter 1.00
E2E_Evaluator_ui5 511433.33903349075 ns/iter 513945.4565375318 ns/iter 1.00
E2E_Evaluator_ui5_manifest 3592330.4019601187 ns/iter 2552660.942238463 ns/iter 1.41
E2E_Evaluator_unreal_engine_uproject 446697.30876747635 ns/iter 440320.90497444884 ns/iter 1.01
E2E_Evaluator_users_array 642016.014925358 ns/iter 577658.16819327 ns/iter 1.11
E2E_Evaluator_vercel 317530.3397927309 ns/iter 314798.9454463566 ns/iter 1.01
E2E_Evaluator_yamllint 8858.255258555735 ns/iter 8896.435466755222 ns/iter 1.00
Micro_Draft4_Meta_1_No_Callback 198.961175251309 ns/iter 196.10895062557847 ns/iter 1.01
Micro_Draft4_Required_Properties 794.7524065972411 ns/iter 834.6026535260206 ns/iter 0.95
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.28721471587074 ns/iter 23.34215223411245 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.213457384264006 ns/iter 11.226055643196855 ns/iter 1.00
Micro_Draft4_Items_Schema 279.4917444799554 ns/iter 280.48383881284235 ns/iter 1.00
Micro_Draft4_Nested_Object 1.7604343821656683 ns/iter 1.7671638497838675 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 332.26395268532247 ns/iter 332.7086043187519 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 272.11157899921153 ns/iter 273.916005209186 ns/iter 0.99
Micro_Draft4_Properties_Triad_Required 348.0971114130895 ns/iter 340.505386991389 ns/iter 1.02
Micro_Draft4_Properties_Closed 57.65717403064695 ns/iter 57.24127117644632 ns/iter 1.01
Micro_Draft4_Non_Recursive_Ref 11.681373592091887 ns/iter 11.631065589202455 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 165.3390936556179 ns/iter 162.64822084079842 ns/iter 1.02
Micro_Draft4_Ref_To_Single_Property 11.236982460575318 ns/iter 11.239343683284229 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 21.68473141644292 ns/iter 21.614978302443685 ns/iter 1.00
Micro_Draft4_Nested_Oneof 58.843490531596885 ns/iter 58.970535152812964 ns/iter 1.00
Micro_Draft4_Short_Enum 12.367624976831044 ns/iter 12.156641303490735 ns/iter 1.02
Micro_Draft4_Long_Enum 15.280459675244366 ns/iter 15.280545896470251 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 12.227527750680446 ns/iter 12.150400269279874 ns/iter 1.01
Micro_Draft4_Type_Object 3.7376492730271127 ns/iter 3.7353141666810092 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2466173.253521005 ns/iter 2454216.8912280193 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1778885.9262082528 ns/iter 1780773.254452981 ns/iter 1.00
Micro_Draft4_Compile_Wrap 2436805.7317076167 ns/iter 2430968.4636679674 ns/iter 1.00
Micro_Draft6_Property_Names 126.46426386596634 ns/iter 132.26957784570237 ns/iter 0.96
Micro_Draft6_Compile_FHIR 16257390382.00004 ns/iter 13464508540.999987 ns/iter 1.21
Micro_Draft7_If_Then_Else 24.2828874767492 ns/iter 24.28920752986649 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 26.488626371509028 ns/iter 26.490611648992118 ns/iter 1.00
Micro_2019_09_Compile_Wrap 335078057.5000272 ns/iter 328012253.9999866 ns/iter 1.02
Micro_2020_12_Dynamic_Ref 232.5930516800126 ns/iter 230.28289212448684 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 3.440595458381801 ns/iter 3.4254334101944632 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1088.1086185606268 ns/iter 1084.6182194006176 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 104506.9254931699 ns/iter 107644.71503712161 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1126125.3074434618 ns/iter 1139280.6032523455 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric 8223.566829476806 ns/iter 8110.8914117040395 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 181467.3332472052 ns/iter 177128.2079858142 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 23652.841934506534 ns/iter 22942.645134040136 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 144.12261427731858 ns/iter 141.85118727149924 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4360.398783368136 ns/iter 4551.591498833889 ns/iter 0.96
Alterschema_Check_Readibility_ISO_Language_Set_3 400920941.4999759 ns/iter 380129319.9999236 ns/iter 1.05
Alterschema_Check_Readibility_OMC 87378413.87500112 ns/iter 85527074.37499407 ns/iter 1.02
Alterschema_Check_Readibility_KrakenD 1197229009.0000114 ns/iter 1194048419.9999447 ns/iter 1.00
Alterschema_Apply_Readibility_KrakenD 125674812687.00021 ns/iter 119342437326.99997 ns/iter 1.05
Alterschema_Check_Invalid_External_Refs 306371291.99999434 ns/iter 302591129.00000674 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
E2E_Evaluator_adaptivecard 118702 ns 117157 ns 1.01
E2E_Evaluator_ansible-meta 549653 ns 538262 ns 1.02
E2E_Evaluator_aws-cdk 143483 ns 141883 ns 1.01
E2E_Evaluator_babelrc 341934 ns 326732 ns 1.05
E2E_Evaluator_cerebrum-criminal-case 2852890 ns 2499574 ns 1.14
E2E_Evaluator_clang-format 278147 ns 267390 ns 1.04
E2E_Evaluator_cmake-presets 20070914 ns 18534827 ns 1.08
E2E_Evaluator_code-climate 516829 ns 524093 ns 0.99
E2E_Evaluator_cql2 1243912 ns 1209982 ns 1.03
E2E_Evaluator_cspell 1630601 ns 1509664 ns 1.08
E2E_Evaluator_cypress 838305 ns 780553 ns 1.07
E2E_Evaluator_deno 1136680 ns 1102589 ns 1.03
E2E_Evaluator_dependabot 1186341 ns 1203167 ns 0.99
E2E_Evaluator_draft-04 28177606 ns 26643343 ns 1.06
E2E_Evaluator_fabric-mod 2685376 ns 2392047 ns 1.12
E2E_Evaluator_geojson 22550117 ns 23477341 ns 0.96
E2E_Evaluator_gitpod-configuration 757788 ns 718468 ns 1.05
E2E_Evaluator_helm-chart-lock 999377 ns 1071563 ns 0.93
E2E_Evaluator_importmap 271586 ns 271603 ns 1.00
E2E_Evaluator_jasmine 310968 ns 291785 ns 1.07
E2E_Evaluator_jsconfig 1328343 ns 1242520 ns 1.07
E2E_Evaluator_jshintrc 2849449 ns 2784496 ns 1.02
E2E_Evaluator_krakend 687003 ns 679710 ns 1.01
E2E_Evaluator_lazygit 514314 ns 510311 ns 1.01
E2E_Evaluator_lerna 468387 ns 478559 ns 0.98
E2E_Evaluator_nest-cli 619791 ns 587349 ns 1.06
E2E_Evaluator_omc 91868 ns 94942 ns 0.97
E2E_Evaluator_omnisharp 1441894 ns 1422888 ns 1.01
E2E_Evaluator_openapi 27694059 ns 27003985 ns 1.03
E2E_Evaluator_pre-commit-hooks 2105147 ns 2014446 ns 1.05
E2E_Evaluator_pulumi 2134803 ns 1890038 ns 1.13
E2E_Evaluator_semantic-release 260961 ns 248228 ns 1.05
E2E_Evaluator_stale 408818 ns 401100 ns 1.02
E2E_Evaluator_stylecop 1224197 ns 1269075 ns 0.96
E2E_Evaluator_tmuxinator 242018 ns 227748 ns 1.06
E2E_Evaluator_ui5 2374437 ns 2391519 ns 0.99
E2E_Evaluator_ui5-manifest 15435606 ns 12383523 ns 1.25
E2E_Evaluator_unreal-engine-uproject 1543407 ns 1526807 ns 1.01
E2E_Evaluator_users-array 2699146 ns 2478829 ns 1.09
E2E_Evaluator_vercel 1034598 ns 1024555 ns 1.01
E2E_Evaluator_yamllint 26185 ns 25678 ns 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
Schema_Iterator_ISO_Language 3361022.6293098065 ns/iter 2397309.8214290594 ns/iter 1.40
Schema_Tracker_ISO_Language 7997103.166666247 ns/iter 5583248.725190602 ns/iter 1.43
Schema_Tracker_ISO_Language_To_JSON 19499744.05714394 ns/iter 16874198.473685376 ns/iter 1.16
Schema_Frame_WoT_References 6845260.642335333 ns/iter 5454413.749998821 ns/iter 1.25
Schema_Frame_OMC_References 37528896.80952519 ns/iter 27053048.913044024 ns/iter 1.39
Schema_Frame_OMC_Locations 30184692.428563375 ns/iter 23541276.870967142 ns/iter 1.28
Schema_Frame_ISO_Language_Locations 83924029.71428835 ns/iter 78932731.44443609 ns/iter 1.06
Schema_Frame_KrakenD_References 61400435.6363735 ns/iter 47251688.86666324 ns/iter 1.30
Schema_Frame_KrakenD_Reachable 692212708.9999322 ns/iter 442990229.0000882 ns/iter 1.56
Schema_Frame_ISO_Language_Locations_To_JSON 112896159.66666134 ns/iter 76808148.85712348 ns/iter 1.47
Schema_Frame_Many_Resources_References 394516562.4999163 ns/iter 297006874.9999655 ns/iter 1.33
Schema_Bundle_Meta_2020_12 1884754.0866817946 ns/iter 1653642.9692832702 ns/iter 1.14
Schema_Format_ISO_Language_To_JSON 110043930.49987964 ns/iter 100936868.00000037 ns/iter 1.09
E2E_Compiler_adaptivecard 102535592.66665334 ns/iter 60231846.15385337 ns/iter 1.70
E2E_Compiler_ansible_meta 40899386.92857231 ns/iter 32473015.18181509 ns/iter 1.26
E2E_Compiler_aws_cdk 467166.384898682 ns/iter 384343.1770689159 ns/iter 1.22
E2E_Compiler_babelrc 3234279.0862743394 ns/iter 2412375.130990285 ns/iter 1.34
E2E_Compiler_clang_format 23639930.545455586 ns/iter 16833906.25000088 ns/iter 1.40
E2E_Compiler_cmake_presets 40205896.85714661 ns/iter 27899266.038459178 ns/iter 1.44
E2E_Compiler_code_climate 3542597.96585455 ns/iter 2816866.4675769596 ns/iter 1.26
E2E_Compiler_cql2 19247406.021272484 ns/iter 14993774.685182061 ns/iter 1.28
E2E_Compiler_cspell 31358059.000003397 ns/iter 23046062.50000063 ns/iter 1.36
E2E_Compiler_cypress 5612712.080001074 ns/iter 3836829.8611102444 ns/iter 1.46
E2E_Compiler_deno 9259497.810528142 ns/iter 7107478.9819818875 ns/iter 1.30
E2E_Compiler_dependabot 5306224.999999358 ns/iter 4373814.207650608 ns/iter 1.21
E2E_Compiler_draft_04 3637570.6066940604 ns/iter 2380131.237288036 ns/iter 1.53
E2E_Compiler_fabric_mod 4658265.178294141 ns/iter 4023569.8757764148 ns/iter 1.16
E2E_Compiler_geojson 30853613.095229905 ns/iter 26783537.50000042 ns/iter 1.15
E2E_Compiler_gitpod_configuration 5550419.796992016 ns/iter 5037094.6948057525 ns/iter 1.10
E2E_Compiler_helm_chart_lock 739940.1709401149 ns/iter 622168.2508446043 ns/iter 1.19
E2E_Compiler_importmap 341204.13599380956 ns/iter 232457.4043385988 ns/iter 1.47
E2E_Compiler_jasmine 1544547.6338026791 ns/iter 1219629.9258513264 ns/iter 1.27
E2E_Compiler_jshintrc 4128232.7654328216 ns/iter 3483985.552763977 ns/iter 1.18
E2E_Compiler_jsconfig 25370408.333333217 ns/iter 21064995.36111212 ns/iter 1.20
E2E_Compiler_krakend 190388802.0000295 ns/iter 145942325.00003272 ns/iter 1.30
E2E_Compiler_lazygit 42976877.62499436 ns/iter 37982342.10525583 ns/iter 1.13
E2E_Compiler_lerna 1866307.8537169558 ns/iter 1763652.9201028454 ns/iter 1.06
E2E_Compiler_nest_cli 9394855.705264298 ns/iter 7817411.585364891 ns/iter 1.20
E2E_Compiler_omc 198490573.00001505 ns/iter 215886527.6666499 ns/iter 0.92
E2E_Compiler_omnisharp 6750697.290598487 ns/iter 8285085.548673083 ns/iter 0.81
E2E_Compiler_openapi 33489027.230766274 ns/iter 31439424.227270056 ns/iter 1.07
E2E_Compiler_pre_commit_hooks 5211508.087379858 ns/iter 6104532.919998746 ns/iter 0.85
E2E_Compiler_pulumi 4756944.525714581 ns/iter 4323372.0059887925 ns/iter 1.10
E2E_Compiler_semantic_release 1767840.449438256 ns/iter 1832537.533730031 ns/iter 0.96
E2E_Compiler_stale 1870166.009008666 ns/iter 1700166.835699889 ns/iter 1.10
E2E_Compiler_stylecop 7631689.530974421 ns/iter 7303497.855671069 ns/iter 1.04
E2E_Compiler_tmuxinator 2234253.012578184 ns/iter 2072821.8190787341 ns/iter 1.08
E2E_Compiler_ui5 86151555.5555646 ns/iter 71234275.00000617 ns/iter 1.21
E2E_Compiler_ui5_manifest 416490271.00004333 ns/iter 467512958.000043 ns/iter 0.89
E2E_Compiler_unreal_engine_uproject 5040976.660000069 ns/iter 5176215.144230739 ns/iter 0.97
E2E_Compiler_users_array 1088687.2216035535 ns/iter 890507.0356201329 ns/iter 1.22
E2E_Compiler_vercel 15646952.84209967 ns/iter 16589249.267858414 ns/iter 0.94
E2E_Compiler_yamllint 362423.8876575183 ns/iter 338997.8510448559 ns/iter 1.07
E2E_Evaluator_adaptivecard 30005.783938815464 ns/iter 25113.796164441443 ns/iter 1.19
E2E_Evaluator_ansible_meta 206474.39862880463 ns/iter 215244.32164631534 ns/iter 0.96
E2E_Evaluator_aws_cdk 43849.5330220153 ns/iter 47141.40588510319 ns/iter 0.93
E2E_Evaluator_babelrc 108650.07861634236 ns/iter 124726.99188416713 ns/iter 0.87
E2E_Evaluator_cerebrum_criminal_case 940084.8266474236 ns/iter 845205.5103825444 ns/iter 1.11
E2E_Evaluator_clang_format 130681.20220424989 ns/iter 125899.29950925123 ns/iter 1.04
E2E_Evaluator_cmake_presets 5814448.3299997775 ns/iter 5277724.609374701 ns/iter 1.10
E2E_Evaluator_code_climate 174071.87902185452 ns/iter 164026.54229084484 ns/iter 1.06
E2E_Evaluator_cql2 201807.86299213918 ns/iter 205346.67713442276 ns/iter 0.98
E2E_Evaluator_cspell 475983.7995750402 ns/iter 662135.263414767 ns/iter 0.72
E2E_Evaluator_cypress 166597.40180014848 ns/iter 203724.321992255 ns/iter 0.82
E2E_Evaluator_deno 301651.98706337577 ns/iter 290044.8198659628 ns/iter 1.04
E2E_Evaluator_dependabot 281176.4588328925 ns/iter 313561.39053255256 ns/iter 0.90
E2E_Evaluator_draft_04 6223733.739836565 ns/iter 6431314.239584651 ns/iter 0.97
E2E_Evaluator_fabric_mod 647093.7409891352 ns/iter 554681.6249998302 ns/iter 1.17
E2E_Evaluator_geojson 12373989.576924661 ns/iter 12696525.000001203 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 219314.57138732128 ns/iter 242265.09715991994 ns/iter 0.91
E2E_Evaluator_helm_chart_lock 266480.5880052255 ns/iter 287640.2868817725 ns/iter 0.93
E2E_Evaluator_importmap 37636.32370704003 ns/iter 37711.06715233232 ns/iter 1.00
E2E_Evaluator_jasmine 109294.03780389203 ns/iter 98203.22660448648 ns/iter 1.11
E2E_Evaluator_jshintrc 1188972.4052716596 ns/iter 1184087.1277955577 ns/iter 1.00
E2E_Evaluator_jsconfig 336581.69274609 ns/iter 342098.5272727552 ns/iter 0.98
E2E_Evaluator_krakend 197963.9972729075 ns/iter 162665.80166085457 ns/iter 1.22
E2E_Evaluator_lazygit 122670.20343643581 ns/iter 210840.0358198905 ns/iter 0.58
E2E_Evaluator_lerna 152257.90654968453 ns/iter 155330.07812501406 ns/iter 0.98
E2E_Evaluator_nest_cli 182900.24154589776 ns/iter 200559.13057561408 ns/iter 0.91
E2E_Evaluator_omc 19861.910753287495 ns/iter 21024.491765931554 ns/iter 0.94
E2E_Evaluator_omnisharp 704853.6299766259 ns/iter 707553.3925384756 ns/iter 1.00
E2E_Evaluator_openapi 9259425.24999942 ns/iter 7235893.518518311 ns/iter 1.28
E2E_Evaluator_pre_commit_hooks 448634.2982456112 ns/iter 456573.00736757263 ns/iter 0.98
E2E_Evaluator_pulumi 702413.3638212122 ns/iter 674327.3925780002 ns/iter 1.04
E2E_Evaluator_semantic_release 92780.10957642138 ns/iter 96790.60579455065 ns/iter 0.96
E2E_Evaluator_stale 146310.64864865417 ns/iter 150040.72646569193 ns/iter 0.98
E2E_Evaluator_stylecop 283586.1921799617 ns/iter 240262.11500308855 ns/iter 1.18
E2E_Evaluator_tmuxinator 89106.15962084438 ns/iter 131676.45687005736 ns/iter 0.68
E2E_Evaluator_ui5 530537.577834149 ns/iter 609233.4992062538 ns/iter 0.87
E2E_Evaluator_ui5_manifest 2604932.3556486783 ns/iter 3753571.261682167 ns/iter 0.69
E2E_Evaluator_unreal_engine_uproject 393523.00773193466 ns/iter 482790.15698117635 ns/iter 0.82
E2E_Evaluator_users_array 657091.5361255594 ns/iter 584228.2499997964 ns/iter 1.12
E2E_Evaluator_vercel 303565.9009812465 ns/iter 300718.7281029539 ns/iter 1.01
E2E_Evaluator_yamllint 8394.857174190303 ns/iter 8958.243112988319 ns/iter 0.94
Micro_Draft4_Meta_1_No_Callback 184.78832915204535 ns/iter 203.67636872528212 ns/iter 0.91
Micro_Draft4_Required_Properties 855.0436786134505 ns/iter 914.5281273714055 ns/iter 0.93
Micro_Draft4_Many_Optional_Properties_Minimal_Match 25.361917384054944 ns/iter 24.856460560397505 ns/iter 1.02
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.92632811070011 ns/iter 10.259232306219802 ns/iter 0.87
Micro_Draft4_Items_Schema 303.3902927626219 ns/iter 362.3934927682111 ns/iter 0.84
Micro_Draft4_Nested_Object 0.8241076155145172 ns/iter 1.2132505094531414 ns/iter 0.68
Micro_Draft4_Properties_Triad_Optional 276.2817443662467 ns/iter 352.267734177629 ns/iter 0.78
Micro_Draft4_Properties_Triad_Closed 229.051879322537 ns/iter 276.76261081260236 ns/iter 0.83
Micro_Draft4_Properties_Triad_Required 247.3889567619998 ns/iter 327.49217966709114 ns/iter 0.76
Micro_Draft4_Properties_Closed 48.00289821329744 ns/iter 62.30170678043406 ns/iter 0.77
Micro_Draft4_Non_Recursive_Ref 12.140497954615222 ns/iter 14.077999237702162 ns/iter 0.86
Micro_Draft4_Pattern_Properties_True 174.85439329018337 ns/iter 194.88640235904447 ns/iter 0.90
Micro_Draft4_Ref_To_Single_Property 9.093511788969192 ns/iter 9.362131206929439 ns/iter 0.97
Micro_Draft4_Additional_Properties_Type 27.88190119892566 ns/iter 23.443419558378555 ns/iter 1.19
Micro_Draft4_Nested_Oneof 48.98661623597563 ns/iter 45.56000178968179 ns/iter 1.08
Micro_Draft4_Short_Enum 6.617837331164342 ns/iter 6.918512763768571 ns/iter 0.96
Micro_Draft4_Long_Enum 13.06132639168625 ns/iter 12.378466694566441 ns/iter 1.06
Micro_Draft4_Long_Enum_Short_Strings 10.314369457060415 ns/iter 7.827408913061979 ns/iter 1.32
Micro_Draft4_Type_Object 3.268063974731738 ns/iter 2.8172416401113445 ns/iter 1.16
Micro_Draft4_Ref_Single_100 2756546.127090243 ns/iter 1897654.4300701448 ns/iter 1.45
Micro_Draft4_Compile_Ref_Many_Nested 1818958.669355075 ns/iter 1661602.4957805353 ns/iter 1.09
Micro_Draft4_Compile_Wrap 2806440.9460437004 ns/iter 2821007.473282393 ns/iter 0.99
Micro_Draft6_Property_Names 150.44809313087134 ns/iter 127.89775035257746 ns/iter 1.18
Micro_Draft6_Compile_FHIR 16489162291.999947 ns/iter 14663114124.999992 ns/iter 1.12
Micro_Draft7_If_Then_Else 26.02939237838627 ns/iter 21.74613834327612 ns/iter 1.20
Micro_2019_09_Unevaluated_Properties 34.582320551804365 ns/iter 30.83653624310083 ns/iter 1.12
Micro_2019_09_Compile_Wrap 607272459.0001144 ns/iter 388387458.4998921 ns/iter 1.56
Micro_2020_12_Dynamic_Ref 274.8287460058073 ns/iter 236.36276437965682 ns/iter 1.16
Micro_2020_12_Dynamic_Ref_Single 3.078521241017013 ns/iter 2.8954929575409794 ns/iter 1.06
Micro_2020_12_Simple_Output_Mask 911.0950505266102 ns/iter 875.6238507574019 ns/iter 1.04
Micro_2020_12_Simple_Output_Annotations 120503.722867249 ns/iter 115406.226415116 ns/iter 1.04
Micro_2020_12_Compile_NonCircular_Shared_Refs 1222833.8310911304 ns/iter 1286125.8345451048 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric 6496.312217556914 ns/iter 6277.3210717797165 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 147617.18809089882 ns/iter 171838.79018708447 ns/iter 0.86
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 18269.764650477213 ns/iter 17180.894576244867 ns/iter 1.06
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 115.01836730744272 ns/iter 117.27333702298307 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5508.193462467581 ns/iter 7138.383060198152 ns/iter 0.77
Alterschema_Check_Readibility_ISO_Language_Set_3 316795603.9999353 ns/iter 311254666.50007635 ns/iter 1.02
Alterschema_Check_Readibility_OMC 93962434.42857407 ns/iter 91515035.71430503 ns/iter 1.03
Alterschema_Check_Readibility_KrakenD 1143454916.9998717 ns/iter 1070821209.000087 ns/iter 1.07
Alterschema_Apply_Readibility_KrakenD 101881561918.00021 ns/iter 113227147957.99994 ns/iter 0.90
Alterschema_Check_Invalid_External_Refs 247222083.33332673 ns/iter 283391457.9999828 ns/iter 0.87

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
E2E_Evaluator_adaptivecard 110560 ns 158608 ns 0.70
E2E_Evaluator_ansible-meta 373338 ns 619582 ns 0.60
E2E_Evaluator_aws-cdk 131988 ns 168284 ns 0.78
E2E_Evaluator_babelrc 318611 ns 369715 ns 0.86
E2E_Evaluator_cerebrum-criminal-case 2039063 ns 2771268 ns 0.74
E2E_Evaluator_clang-format 251354 ns 311062 ns 0.81
E2E_Evaluator_cmake-presets 13692134 ns 18425381 ns 0.74
E2E_Evaluator_code-climate 517728 ns 559127 ns 0.93
E2E_Evaluator_cql2 1170079 ns 1577195 ns 0.74
E2E_Evaluator_cspell 1780530 ns 1789806 ns 0.99
E2E_Evaluator_cypress 850612 ns 1049392 ns 0.81
E2E_Evaluator_deno 926393 ns 1560923 ns 0.59
E2E_Evaluator_dependabot 930790 ns 1672039 ns 0.56
E2E_Evaluator_draft-04 22153620 ns 27530521 ns 0.80
E2E_Evaluator_fabric-mod 2416967 ns 3485346 ns 0.69
E2E_Evaluator_geojson 22113870 ns 23302566 ns 0.95
E2E_Evaluator_gitpod-configuration 655690 ns 884445 ns 0.74
E2E_Evaluator_helm-chart-lock 1066606 ns 1518324 ns 0.70
E2E_Evaluator_importmap 315364 ns 450704 ns 0.70
E2E_Evaluator_jasmine 264955 ns 388115 ns 0.68
E2E_Evaluator_jsconfig 1356133 ns 1667306 ns 0.81
E2E_Evaluator_jshintrc 2525662 ns 4266043 ns 0.59
E2E_Evaluator_krakend 712043 ns 1123875 ns 0.63
E2E_Evaluator_lazygit 436379 ns 614039 ns 0.71
E2E_Evaluator_lerna 497258 ns 481354 ns 1.03
E2E_Evaluator_nest-cli 621482 ns 814582 ns 0.76
E2E_Evaluator_omc 93561 ns 113780 ns 0.82
E2E_Evaluator_omnisharp 1420123 ns 1931952 ns 0.74
E2E_Evaluator_openapi 22807794 ns 27236126 ns 0.84
E2E_Evaluator_pre-commit-hooks 1934832 ns 2115832 ns 0.91
E2E_Evaluator_pulumi 2901303 ns 2722462 ns 1.07
E2E_Evaluator_semantic-release 266502 ns 280189 ns 0.95
E2E_Evaluator_stale 448000 ns 467126 ns 0.96
E2E_Evaluator_stylecop 1510020 ns 2128909 ns 0.71
E2E_Evaluator_tmuxinator 201902 ns 240512 ns 0.84
E2E_Evaluator_ui5 2776644 ns 3169646 ns 0.88
E2E_Evaluator_ui5-manifest 12306217 ns 18628469 ns 0.66
E2E_Evaluator_unreal-engine-uproject 1766122 ns 2133203 ns 0.83
E2E_Evaluator_users-array 3045894 ns 3991563 ns 0.76
E2E_Evaluator_vercel 1046897 ns 1359351 ns 0.77
E2E_Evaluator_yamllint 38010 ns 28765 ns 1.32

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 369771443.99998 ns/iter 335144209.4999584 ns/iter 1.10
Alterschema_Check_Readibility_OMC 102904592.42855832 ns/iter 96722513.71427722 ns/iter 1.06
Alterschema_Check_Readibility_KrakenD 1444707683.9999228 ns/iter 1543673999.0000205 ns/iter 0.94
Alterschema_Apply_Readibility_KrakenD 139260140623.0001 ns/iter 155040440730.0002 ns/iter 0.90
Alterschema_Check_Invalid_External_Refs 301610734.5000591 ns/iter 253375404.33338287 ns/iter 1.19
Micro_2020_12_Dynamic_Ref 263.1053811598128 ns/iter 286.0553430900869 ns/iter 0.92
Micro_2020_12_Dynamic_Ref_Single 4.225116862836053 ns/iter 4.037280156161501 ns/iter 1.05
Micro_2020_12_Simple_Output_Mask 1117.8175003383055 ns/iter 1049.4822350344878 ns/iter 1.07
Micro_2020_12_Simple_Output_Annotations 102968.75298399158 ns/iter 105910.85861537627 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1268094.6931407033 ns/iter 1169745.2262897952 ns/iter 1.08
Micro_2020_12_Exhaustive_Deep_Numeric 8840.00633556817 ns/iter 9164.936016756677 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 165437.04177184848 ns/iter 139416.38824468007 ns/iter 1.19
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26669.551708393887 ns/iter 24284.800674154005 ns/iter 1.10
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 153.17733076012792 ns/iter 156.25754011272528 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4711.419974976848 ns/iter 4542.993994794094 ns/iter 1.04
Micro_2019_09_Unevaluated_Properties 28.892859202031396 ns/iter 26.019058565942398 ns/iter 1.11
Micro_2019_09_Compile_Wrap 340626666.49992937 ns/iter 298331542.0000281 ns/iter 1.14
Micro_Draft7_If_Then_Else 24.88317201762694 ns/iter 22.270544502166747 ns/iter 1.12
Micro_Draft6_Property_Names 142.66936233726508 ns/iter 141.44850935848652 ns/iter 1.01
Micro_Draft6_Compile_FHIR 14690568575.000044 ns/iter 17046338651.000042 ns/iter 0.86
Micro_Draft4_Meta_1_No_Callback 176.09003828658527 ns/iter 185.8238528610901 ns/iter 0.95
Micro_Draft4_Required_Properties 817.1349488397366 ns/iter 779.7042736690175 ns/iter 1.05
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.141245536203414 ns/iter 24.32714635339811 ns/iter 0.87
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.025586958784231 ns/iter 11.53158039721781 ns/iter 1.13
Micro_Draft4_Items_Schema 295.58110850069187 ns/iter 277.49401831677255 ns/iter 1.07
Micro_Draft4_Nested_Object 2.4715026654015517 ns/iter 1.7510345762100459 ns/iter 1.41
Micro_Draft4_Properties_Triad_Optional 414.8268965354422 ns/iter 318.6165940861354 ns/iter 1.30
Micro_Draft4_Properties_Triad_Closed 382.65585378310647 ns/iter 269.8673635574511 ns/iter 1.42
Micro_Draft4_Properties_Triad_Required 429.716018576006 ns/iter 344.3001775249723 ns/iter 1.25
Micro_Draft4_Properties_Closed 62.07966734657039 ns/iter 66.42039835620037 ns/iter 0.93
Micro_Draft4_Non_Recursive_Ref 8.796133332732625 ns/iter 8.376846628680786 ns/iter 1.05
Micro_Draft4_Pattern_Properties_True 181.97734304195197 ns/iter 170.13673979656946 ns/iter 1.07
Micro_Draft4_Ref_To_Single_Property 12.668051986240176 ns/iter 12.062869321601978 ns/iter 1.05
Micro_Draft4_Additional_Properties_Type 14.33012881851668 ns/iter 12.816329587566761 ns/iter 1.12
Micro_Draft4_Nested_Oneof 63.3391592570505 ns/iter 57.39421023820913 ns/iter 1.10
Micro_Draft4_Short_Enum 14.58168373759586 ns/iter 10.977973006344795 ns/iter 1.33
Micro_Draft4_Long_Enum 14.758874615368706 ns/iter 12.088536665557069 ns/iter 1.22
Micro_Draft4_Long_Enum_Short_Strings 14.481151491219851 ns/iter 11.068107800241565 ns/iter 1.31
Micro_Draft4_Type_Object 4.5776051777470474 ns/iter 4.043239116598656 ns/iter 1.13
Micro_Draft4_Ref_Single_100 2615740.6468401183 ns/iter 2373457.6508474476 ns/iter 1.10
Micro_Draft4_Compile_Ref_Many_Nested 1923673.7829672436 ns/iter 1738101.7990071536 ns/iter 1.11
Micro_Draft4_Compile_Wrap 2718668.7984495205 ns/iter 2460494.6408454822 ns/iter 1.10
E2E_Compiler_adaptivecard 69351992.90001038 ns/iter 64514568.18180387 ns/iter 1.07
E2E_Compiler_ansible_meta 33337992.66665881 ns/iter 28586924.250002235 ns/iter 1.17
E2E_Compiler_aws_cdk 429408.6738329265 ns/iter 401109.3968983131 ns/iter 1.07
E2E_Compiler_babelrc 2931335.436975675 ns/iter 2614926.2105263914 ns/iter 1.12
E2E_Compiler_clang_format 20690573.764708836 ns/iter 18251352.868416782 ns/iter 1.13
E2E_Compiler_cmake_presets 29056025.041664194 ns/iter 26070709.962958198 ns/iter 1.11
E2E_Compiler_code_climate 2989888.9531910326 ns/iter 2677861.9427484274 ns/iter 1.12
E2E_Compiler_cql2 14687976.382979384 ns/iter 13778054.235297745 ns/iter 1.07
E2E_Compiler_cspell 25322876.7777795 ns/iter 22868331.258062042 ns/iter 1.11
E2E_Compiler_cypress 4400420.704401688 ns/iter 3899361.743016884 ns/iter 1.13
E2E_Compiler_deno 8940912.037973296 ns/iter 7811989.944444678 ns/iter 1.14
E2E_Compiler_dependabot 4463679.243590727 ns/iter 3931185.9101125975 ns/iter 1.14
E2E_Compiler_draft_04 3120127.666666627 ns/iter 2843156.857723007 ns/iter 1.10
E2E_Compiler_fabric_mod 5419104.511628215 ns/iter 4892596.818181246 ns/iter 1.11
E2E_Compiler_geojson 25428841.99999662 ns/iter 22729060.16128951 ns/iter 1.12
E2E_Compiler_gitpod_configuration 5588352.920000034 ns/iter 5016844.553956747 ns/iter 1.11
E2E_Compiler_helm_chart_lock 772306.211920536 ns/iter 708329.7474541806 ns/iter 1.09
E2E_Compiler_importmap 318538.86550776183 ns/iter 298087.3427350356 ns/iter 1.07
E2E_Compiler_jasmine 1550596.1796008782 ns/iter 1421628.7560978944 ns/iter 1.09
E2E_Compiler_jshintrc 4884196.5594397625 ns/iter 4324616.6049379725 ns/iter 1.13
E2E_Compiler_jsconfig 24151304.517239437 ns/iter 20921763.3636344 ns/iter 1.15
E2E_Compiler_krakend 152050237.99999255 ns/iter 134138506.59999299 ns/iter 1.13
E2E_Compiler_lazygit 37906793.44443662 ns/iter 33126303.19046981 ns/iter 1.14
E2E_Compiler_lerna 1822627.6484369917 ns/iter 1665304.290476061 ns/iter 1.09
E2E_Compiler_nest_cli 8425902.433734873 ns/iter 7477687.591397881 ns/iter 1.13
E2E_Compiler_omc 183441386.74996203 ns/iter 160056230.99999866 ns/iter 1.15
E2E_Compiler_omnisharp 7591050.326086786 ns/iter 6650447.566038188 ns/iter 1.14
E2E_Compiler_openapi 28869899.291663613 ns/iter 25611831.888892524 ns/iter 1.13
E2E_Compiler_pre_commit_hooks 6009627.10344753 ns/iter 5278513.842104691 ns/iter 1.14
E2E_Compiler_pulumi 4590472.58552621 ns/iter 4138946.3214289076 ns/iter 1.11
E2E_Compiler_semantic_release 1791044.9744249491 ns/iter 1648750.2582159864 ns/iter 1.09
E2E_Compiler_stale 1756309.5427132666 ns/iter 1596331.4624146435 ns/iter 1.10
E2E_Compiler_stylecop 7013136.699999904 ns/iter 5898459.7372878175 ns/iter 1.19
E2E_Compiler_tmuxinator 2205579.6289307936 ns/iter 1997239.3028573217 ns/iter 1.10
E2E_Compiler_ui5 52655273.92307726 ns/iter 46679098.999993585 ns/iter 1.13
E2E_Compiler_ui5_manifest 344383673.5000332 ns/iter 301204959.50006896 ns/iter 1.14
E2E_Compiler_unreal_engine_uproject 5187635.22222293 ns/iter 4618627.079470035 ns/iter 1.12
E2E_Compiler_users_array 912698.5945241302 ns/iter 869828.1181593406 ns/iter 1.05
E2E_Compiler_vercel 13715013.607840292 ns/iter 12257304.175439762 ns/iter 1.12
E2E_Compiler_yamllint 391238.2889882141 ns/iter 374602.74718196446 ns/iter 1.04
E2E_Evaluator_adaptivecard 23116.086153533863 ns/iter 22760.966044965757 ns/iter 1.02
E2E_Evaluator_ansible_meta 240894.99143248372 ns/iter 233408.92381904137 ns/iter 1.03
E2E_Evaluator_aws_cdk 48006.415638999904 ns/iter 52418.9930164495 ns/iter 0.92
E2E_Evaluator_babelrc 86766.537359907 ns/iter 98484.74594213965 ns/iter 0.88
E2E_Evaluator_cerebrum_criminal_case 1132556.388709403 ns/iter 1149257.5711804263 ns/iter 0.99
E2E_Evaluator_clang_format 104306.19463989351 ns/iter 105389.49355374445 ns/iter 0.99
E2E_Evaluator_cmake_presets 4839150.128571289 ns/iter 5293919.949999312 ns/iter 0.91
E2E_Evaluator_code_climate 176743.57149985753 ns/iter 205890.4219259232 ns/iter 0.86
E2E_Evaluator_cql2 210831.0372596323 ns/iter 197081.54445996735 ns/iter 1.07
E2E_Evaluator_cspell 517294.797769411 ns/iter 557118.9749216458 ns/iter 0.93
E2E_Evaluator_cypress 139919.6029940036 ns/iter 163487.0853715653 ns/iter 0.86
E2E_Evaluator_deno 293656.7495798228 ns/iter 373912.5129032477 ns/iter 0.79
E2E_Evaluator_dependabot 357745.87544667313 ns/iter 384399.43437666504 ns/iter 0.93
E2E_Evaluator_draft_04 10982318.600001514 ns/iter 8689305.243589656 ns/iter 1.26
E2E_Evaluator_fabric_mod 732525.5223403029 ns/iter 761236.6994536123 ns/iter 0.96
E2E_Evaluator_geojson 20127282.257141944 ns/iter 19268928.135132324 ns/iter 1.04
E2E_Evaluator_gitpod_configuration 239484.9574898984 ns/iter 263304.1789591688 ns/iter 0.91
E2E_Evaluator_helm_chart_lock 220001.4141898673 ns/iter 368661.18443048204 ns/iter 0.60
E2E_Evaluator_importmap 41701.40014090324 ns/iter 32990.196844120255 ns/iter 1.26
E2E_Evaluator_jasmine 104028.74551385887 ns/iter 111375.21542639463 ns/iter 0.93
E2E_Evaluator_jshintrc 1022703.9277285571 ns/iter 1098403.5884195124 ns/iter 0.93
E2E_Evaluator_jsconfig 367509.22861676215 ns/iter 372510.9230361142 ns/iter 0.99
E2E_Evaluator_krakend 185251.58010161045 ns/iter 183275.9138655304 ns/iter 1.01
E2E_Evaluator_lazygit 131394.36734695546 ns/iter 127537.51357342105 ns/iter 1.03
E2E_Evaluator_lerna 139229.650960168 ns/iter 195583.0680482193 ns/iter 0.71
E2E_Evaluator_nest_cli 182550.83363804602 ns/iter 199769.85316892972 ns/iter 0.91
E2E_Evaluator_omc 18837.418356888968 ns/iter 18400.801674349317 ns/iter 1.02
E2E_Evaluator_omnisharp 533377.780620268 ns/iter 584749.3099414911 ns/iter 0.91
E2E_Evaluator_openapi 12444989.019229524 ns/iter 10420814.258619148 ns/iter 1.19
E2E_Evaluator_pre_commit_hooks 478866.737593481 ns/iter 544089.2990654095 ns/iter 0.88
E2E_Evaluator_pulumi 758463.1930586825 ns/iter 803842.9513326285 ns/iter 0.94
E2E_Evaluator_semantic_release 87207.57688491646 ns/iter 86010.53006268466 ns/iter 1.01
E2E_Evaluator_stale 160399.32736341213 ns/iter 160603.47849950413 ns/iter 1.00
E2E_Evaluator_stylecop 305318.7577036825 ns/iter 298425.8266095248 ns/iter 1.02
E2E_Evaluator_tmuxinator 87272.5754329269 ns/iter 91882.93083916341 ns/iter 0.95
E2E_Evaluator_ui5 522990.48000004404 ns/iter 520919.8540581241 ns/iter 1.00
E2E_Evaluator_ui5_manifest 3553470.4414414577 ns/iter 2787955.8832686148 ns/iter 1.27
E2E_Evaluator_unreal_engine_uproject 442797.7493687902 ns/iter 453434.30110320466 ns/iter 0.98
E2E_Evaluator_users_array 751440.040880546 ns/iter 656740.5404897087 ns/iter 1.14
E2E_Evaluator_vercel 283334.6693515778 ns/iter 371443.9941982663 ns/iter 0.76
E2E_Evaluator_yamllint 9313.515604569708 ns/iter 9402.003196502857 ns/iter 0.99
Schema_Format_ISO_Language_To_JSON 123606222.83335942 ns/iter 107997569.00000072 ns/iter 1.14
Schema_Bundle_Meta_2020_12 1997355.8342845927 ns/iter 1843674.2447288693 ns/iter 1.08
Schema_Frame_WoT_References 6169384.573912912 ns/iter 5314357.381680462 ns/iter 1.16
Schema_Frame_OMC_References 28035571.039999925 ns/iter 22620686.677423548 ns/iter 1.24
Schema_Frame_OMC_Locations 25818397.814814657 ns/iter 20664560.2941147 ns/iter 1.25
Schema_Frame_ISO_Language_Locations 113573373.99999778 ns/iter 96885180.8571409 ns/iter 1.17
Schema_Frame_KrakenD_References 49330897.571426906 ns/iter 40770562.29412205 ns/iter 1.21
Schema_Frame_KrakenD_Reachable 649388250.9998912 ns/iter 724083096.0001858 ns/iter 0.90
Schema_Frame_ISO_Language_Locations_To_JSON 192927151.3333788 ns/iter 191036775.4999811 ns/iter 1.01
Schema_Frame_Many_Resources_References 412532860.00005573 ns/iter 373429623.4999874 ns/iter 1.10
Schema_Iterator_ISO_Language 3712159.0425535846 ns/iter 3655668.691099886 ns/iter 1.02
Schema_Tracker_ISO_Language 6226801.941177448 ns/iter 5293534.13740406 ns/iter 1.18
Schema_Tracker_ISO_Language_To_JSON 29109229.291672513 ns/iter 30750818.095243845 ns/iter 0.95

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 6f28486 Previous: 98565db Ratio
E2E_Evaluator_adaptivecard 119265 ns 111980 ns 1.07
E2E_Evaluator_ansible-meta 537927 ns 530661 ns 1.01
E2E_Evaluator_aws-cdk 130261 ns 149249 ns 0.87
E2E_Evaluator_babelrc 310805 ns 455745 ns 0.68
E2E_Evaluator_cerebrum-criminal-case 2739985 ns 2529483 ns 1.08
E2E_Evaluator_clang-format 259752 ns 327090 ns 0.79
E2E_Evaluator_cmake-presets 19032515 ns 19365758 ns 0.98
E2E_Evaluator_code-climate 493001 ns 538689 ns 0.92
E2E_Evaluator_cql2 1261814 ns 1184045 ns 1.07
E2E_Evaluator_cspell 1655338 ns 1842484 ns 0.90
E2E_Evaluator_cypress 859876 ns 1064585 ns 0.81
E2E_Evaluator_deno 1134955 ns 1191325 ns 0.95
E2E_Evaluator_dependabot 1201324 ns 1230137 ns 0.98
E2E_Evaluator_draft-04 30430543 ns 24378097 ns 1.25
E2E_Evaluator_fabric-mod 2593241 ns 2413649 ns 1.07
E2E_Evaluator_geojson 21919752 ns 27096369 ns 0.81
E2E_Evaluator_gitpod-configuration 742747 ns 812538 ns 0.91
E2E_Evaluator_helm-chart-lock 1055460 ns 1042997 ns 1.01
E2E_Evaluator_importmap 267673 ns 326221 ns 0.82
E2E_Evaluator_jasmine 299872 ns 341748 ns 0.88
E2E_Evaluator_jsconfig 1429387 ns 1699359 ns 0.84
E2E_Evaluator_jshintrc 2980516 ns 3096484 ns 0.96
E2E_Evaluator_krakend 664971 ns 620434 ns 1.07
E2E_Evaluator_lazygit 459150 ns 508167 ns 0.90
E2E_Evaluator_lerna 449211 ns 493587 ns 0.91
E2E_Evaluator_nest-cli 608059 ns 742265 ns 0.82
E2E_Evaluator_omc 90858 ns 84821 ns 1.07
E2E_Evaluator_omnisharp 1482669 ns 1529789 ns 0.97
E2E_Evaluator_openapi 26619594 ns 23861010 ns 1.12
E2E_Evaluator_pre-commit-hooks 2084362 ns 2139431 ns 0.97
E2E_Evaluator_pulumi 2075114 ns 2187132 ns 0.95
E2E_Evaluator_semantic-release 234227 ns 295923 ns 0.79
E2E_Evaluator_stale 379848 ns 446373 ns 0.85
E2E_Evaluator_stylecop 1215835 ns 1273621 ns 0.95
E2E_Evaluator_tmuxinator 215923 ns 289625 ns 0.75
E2E_Evaluator_ui5 2367103 ns 2237584 ns 1.06
E2E_Evaluator_ui5-manifest 10946871 ns 11775197 ns 0.93
E2E_Evaluator_unreal-engine-uproject 1616031 ns 1738761 ns 0.93
E2E_Evaluator_users-array 2638809 ns 2619224 ns 1.01
E2E_Evaluator_vercel 1006920 ns 1232470 ns 0.82
E2E_Evaluator_yamllint 24158 ns 27625 ns 0.87

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 02a7ab7 into main May 29, 2026
14 checks passed
@jviotti jviotti deleted the 2020-12-format branch May 29, 2026 20:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant