Skip to content

Enable remaining Draft 3 format assertion tests#836

Merged
jviotti merged 1 commit into
mainfrom
draft3-tests
May 29, 2026
Merged

Enable remaining Draft 3 format assertion tests#836
jviotti merged 1 commit into
mainfrom
draft3-tests

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 29, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 29, 2026

🤖 Augment PR Summary

Summary: This PR enables the remaining Draft-03 official-suite format assertion tests by adding assertion-mode support for the time and color formats.

Changes:

  • Map Draft-03 format: "time" to ValueStringType::PartialTime in assertion mode instead of throwing a compiler error.
  • Map Draft-03 format: "color" to ValueStringType::Color in assertion mode instead of throwing a compiler error.
  • Add fast/exhaustive evaluator tests covering valid/invalid cases for time and color when format_assertion is enabled.
  • Update non-tweaked Draft-03 tests to confirm invalid time/color values still pass when format_assertion is disabled.
  • Replace the old “unsupported format throws” tests for time/color with non-string instance tests (format assertions are skipped for non-strings).
  • Enable the Draft-03 official-suite optional/format test group without excluding time and color.

Technical Notes: The trace descriptions now align with the existing evaluator descriptions for RFC 3339 partial-time (no fractional seconds) and CSS 2 colors.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 3 files

Re-trigger cubic

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
Schema_Iterator_ISO_Language 2688886.339222676 ns/iter 2236091.8000000343 ns/iter 1.20
Schema_Tracker_ISO_Language 5601076.943547916 ns/iter 4418460.109756014 ns/iter 1.27
Schema_Tracker_ISO_Language_To_JSON 16568578.243902445 ns/iter 15118310.199997926 ns/iter 1.10
Schema_Frame_WoT_References 5486853.708029343 ns/iter 4588517.228394603 ns/iter 1.20
Schema_Frame_OMC_References 25069239.931032576 ns/iter 22908154.166664947 ns/iter 1.09
Schema_Frame_OMC_Locations 23331486.100001562 ns/iter 20992032.531246707 ns/iter 1.11
Schema_Frame_ISO_Language_Locations 77366592.5555507 ns/iter 65009058.400005415 ns/iter 1.19
Schema_Frame_KrakenD_References 44325734.37500054 ns/iter 39097600.529417194 ns/iter 1.13
Schema_Frame_KrakenD_Reachable 403418770.5000818 ns/iter 311337417.0000043 ns/iter 1.30
Schema_Frame_ISO_Language_Locations_To_JSON 74455287.4999954 ns/iter 65572733.299995884 ns/iter 1.14
Schema_Frame_Many_Resources_References 276584764.00002503 ns/iter 242164278.0000184 ns/iter 1.14
Schema_Bundle_Meta_2020_12 1331117.0584904845 ns/iter 1180910.4713807963 ns/iter 1.13
Schema_Format_ISO_Language_To_JSON 75343680.44444919 ns/iter 67131370.69998538 ns/iter 1.12
E2E_Compiler_adaptivecard 60987211.53846152 ns/iter 55903648.85714345 ns/iter 1.09
E2E_Compiler_ansible_meta 31016921.87500286 ns/iter 24966626.499998968 ns/iter 1.24
E2E_Compiler_aws_cdk 324071.70693320397 ns/iter 251735.56042695427 ns/iter 1.29
E2E_Compiler_babelrc 2489734.8367347857 ns/iter 1938981.8650138082 ns/iter 1.28
E2E_Compiler_clang_format 15781777.785713574 ns/iter 13542612.980770102 ns/iter 1.17
E2E_Compiler_cmake_presets 25881861.11110931 ns/iter 22122633.064510968 ns/iter 1.17
E2E_Compiler_code_climate 2359115.249240123 ns/iter 2022976.512747583 ns/iter 1.17
E2E_Compiler_cql2 11825507.913791735 ns/iter 10574261.194030998 ns/iter 1.12
E2E_Compiler_cspell 20601478.571429003 ns/iter 17523767.725003835 ns/iter 1.18
E2E_Compiler_cypress 3832531.081081003 ns/iter 3220166.474178375 ns/iter 1.19
E2E_Compiler_deno 7465517.301887062 ns/iter 6007836.50847492 ns/iter 1.24
E2E_Compiler_dependabot 3926903.6458335905 ns/iter 3313539.4736839654 ns/iter 1.19
E2E_Compiler_draft_04 2337957.6480264207 ns/iter 1982841.200589845 ns/iter 1.18
E2E_Compiler_fabric_mod 3815710.8618786084 ns/iter 3366723.4848482828 ns/iter 1.13
E2E_Compiler_geojson 23293573.935483612 ns/iter 19236698.189191688 ns/iter 1.21
E2E_Compiler_gitpod_configuration 4513821.922618685 ns/iter 3690885.9684217535 ns/iter 1.22
E2E_Compiler_helm_chart_lock 613435.3342293979 ns/iter 465793.7656145053 ns/iter 1.32
E2E_Compiler_importmap 214001.7069813037 ns/iter 184266.38910918773 ns/iter 1.16
E2E_Compiler_jasmine 1097302.1449704785 ns/iter 950431.559345074 ns/iter 1.15
E2E_Compiler_jshintrc 3364697.916666686 ns/iter 2881502.722449132 ns/iter 1.17
E2E_Compiler_jsconfig 19526685.8108112 ns/iter 16537573.428568715 ns/iter 1.18
E2E_Compiler_krakend 135566166.600006 ns/iter 109638423.666676 ns/iter 1.24
E2E_Compiler_lazygit 34895011.36363577 ns/iter 28245453.359995738 ns/iter 1.24
E2E_Compiler_lerna 1615365.3725098365 ns/iter 1353215.6041275563 ns/iter 1.19
E2E_Compiler_nest_cli 6377829.307017404 ns/iter 5679991.94117492 ns/iter 1.12
E2E_Compiler_omc 164524489.49999622 ns/iter 150091341.60000032 ns/iter 1.10
E2E_Compiler_omnisharp 5965410.416666827 ns/iter 6088470.694916689 ns/iter 0.98
E2E_Compiler_openapi 23464643.68965512 ns/iter 19425386.363640096 ns/iter 1.21
E2E_Compiler_pre_commit_hooks 4486140.459119601 ns/iter 3696973.9052641387 ns/iter 1.21
E2E_Compiler_pulumi 3342830.741626914 ns/iter 2952554.5021097288 ns/iter 1.13
E2E_Compiler_semantic_release 1252588.1488615968 ns/iter 1107526.1078126174 ns/iter 1.13
E2E_Compiler_stale 1380816.4771784188 ns/iter 1104852.497645104 ns/iter 1.25
E2E_Compiler_stylecop 5590869.834710878 ns/iter 4844319.827585925 ns/iter 1.15
E2E_Compiler_tmuxinator 1548559.4855234534 ns/iter 1373602.316601972 ns/iter 1.13
E2E_Compiler_ui5 51862309.571431205 ns/iter 49528554.687498175 ns/iter 1.05
E2E_Compiler_ui5_manifest 342512520.5000086 ns/iter 251714791.66669998 ns/iter 1.36
E2E_Compiler_unreal_engine_uproject 3869779.6630437463 ns/iter 3319012.6201925697 ns/iter 1.17
E2E_Compiler_users_array 804387.4725876327 ns/iter 694344.0508473475 ns/iter 1.16
E2E_Compiler_vercel 12741562.152543446 ns/iter 10616162.184617048 ns/iter 1.20
E2E_Compiler_yamllint 270981.2034757261 ns/iter 224651.59592091362 ns/iter 1.21
E2E_Evaluator_adaptivecard 19443.455185411112 ns/iter 17326.137450199927 ns/iter 1.12
E2E_Evaluator_ansible_meta 165997.32910787995 ns/iter 150996.2591304113 ns/iter 1.10
E2E_Evaluator_aws_cdk 34789.783136170096 ns/iter 30902.09030856926 ns/iter 1.13
E2E_Evaluator_babelrc 82125.8622924797 ns/iter 74976.25343770918 ns/iter 1.10
E2E_Evaluator_cerebrum_criminal_case 703714.0898550962 ns/iter 625017.7524060135 ns/iter 1.13
E2E_Evaluator_clang_format 97424.15319562225 ns/iter 96869.71584631415 ns/iter 1.01
E2E_Evaluator_cmake_presets 3778346.09826608 ns/iter 2934820.1950204805 ns/iter 1.29
E2E_Evaluator_code_climate 130547.32209945138 ns/iter 116578.56186173562 ns/iter 1.12
E2E_Evaluator_cql2 148457.98385067325 ns/iter 133415.3852997727 ns/iter 1.11
E2E_Evaluator_cspell 398148.1511236064 ns/iter 344809.02916465764 ns/iter 1.15
E2E_Evaluator_cypress 145097.02519584427 ns/iter 130585.60165196085 ns/iter 1.11
E2E_Evaluator_deno 225301.4322916765 ns/iter 201019.16987180104 ns/iter 1.12
E2E_Evaluator_dependabot 233550.04536222023 ns/iter 214767.21330068458 ns/iter 1.09
E2E_Evaluator_draft_04 5381911.022555712 ns/iter 4785446.9178078845 ns/iter 1.12
E2E_Evaluator_fabric_mod 492145.14226523734 ns/iter 437211.9232704859 ns/iter 1.13
E2E_Evaluator_geojson 11019651.955883639 ns/iter 8974084.961038614 ns/iter 1.23
E2E_Evaluator_gitpod_configuration 166073.99416297735 ns/iter 148132.86712387495 ns/iter 1.12
E2E_Evaluator_helm_chart_lock 214753.5395506473 ns/iter 191045.53597320963 ns/iter 1.12
E2E_Evaluator_importmap 30237.972936339396 ns/iter 27351.40068411903 ns/iter 1.11
E2E_Evaluator_jasmine 89207.17677119577 ns/iter 75135.26809650734 ns/iter 1.19
E2E_Evaluator_jshintrc 1091500.9402391792 ns/iter 849056.8223845173 ns/iter 1.29
E2E_Evaluator_jsconfig 312309.57161922246 ns/iter 280792.4667999941 ns/iter 1.11
E2E_Evaluator_krakend 146193.8264462791 ns/iter 120746.02657632348 ns/iter 1.21
E2E_Evaluator_lazygit 99181.3487129029 ns/iter 89966.34817294547 ns/iter 1.10
E2E_Evaluator_lerna 126621.9167261108 ns/iter 105054.05896659556 ns/iter 1.21
E2E_Evaluator_nest_cli 151706.7987108547 ns/iter 132188.42318954977 ns/iter 1.15
E2E_Evaluator_omc 14375.39573332399 ns/iter 12839.587633935529 ns/iter 1.12
E2E_Evaluator_omnisharp 520289.1265907624 ns/iter 413899.10183538607 ns/iter 1.26
E2E_Evaluator_openapi 6480173.231482114 ns/iter 5054016.60869547 ns/iter 1.28
E2E_Evaluator_pre_commit_hooks 369841.6964014101 ns/iter 322610.183923736 ns/iter 1.15
E2E_Evaluator_pulumi 533106.9211103168 ns/iter 460886.96808510576 ns/iter 1.16
E2E_Evaluator_semantic_release 73086.76023222192 ns/iter 67898.16500957627 ns/iter 1.08
E2E_Evaluator_stale 116603.25998699637 ns/iter 109402.23931354716 ns/iter 1.07
E2E_Evaluator_stylecop 197095.7243030014 ns/iter 169754.47274047995 ns/iter 1.16
E2E_Evaluator_tmuxinator 71502.23875261052 ns/iter 66808.76761282643 ns/iter 1.07
E2E_Evaluator_ui5 358222.92390011204 ns/iter 314203.9935483947 ns/iter 1.14
E2E_Evaluator_ui5_manifest 2011970.8855420193 ns/iter 1436327.9491526631 ns/iter 1.40
E2E_Evaluator_unreal_engine_uproject 343168.3566433647 ns/iter 293206.8191311971 ns/iter 1.17
E2E_Evaluator_users_array 445218.80804953154 ns/iter 387288.4297521202 ns/iter 1.15
E2E_Evaluator_vercel 223376.0504148289 ns/iter 203142.56836996274 ns/iter 1.10
E2E_Evaluator_yamllint 6427.701857717896 ns/iter 5343.966467134973 ns/iter 1.20
Micro_Draft4_Meta_1_No_Callback 144.67401942639884 ns/iter 131.51655515936983 ns/iter 1.10
Micro_Draft4_Required_Properties 659.1330716677606 ns/iter 588.3068414113486 ns/iter 1.12
Micro_Draft4_Many_Optional_Properties_Minimal_Match 18.792253124725978 ns/iter 16.733279862126846 ns/iter 1.12
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.859957614246706 ns/iter 7.104534671215643 ns/iter 1.25
Micro_Draft4_Items_Schema 270.1561807944248 ns/iter 238.59623486161775 ns/iter 1.13
Micro_Draft4_Nested_Object 0.6924165459399806 ns/iter 0.6324793219604419 ns/iter 1.09
Micro_Draft4_Properties_Triad_Optional 219.04112105081705 ns/iter 197.29630009855924 ns/iter 1.11
Micro_Draft4_Properties_Triad_Closed 180.8616704774042 ns/iter 164.3602306288462 ns/iter 1.10
Micro_Draft4_Properties_Triad_Required 223.6840848573268 ns/iter 202.11930790256042 ns/iter 1.11
Micro_Draft4_Properties_Closed 41.806110423329955 ns/iter 37.604555009696 ns/iter 1.11
Micro_Draft4_Non_Recursive_Ref 9.916184406105948 ns/iter 9.076073631804636 ns/iter 1.09
Micro_Draft4_Pattern_Properties_True 152.4562656917627 ns/iter 140.80885262670654 ns/iter 1.08
Micro_Draft4_Ref_To_Single_Property 7.594978825510238 ns/iter 6.907801619434113 ns/iter 1.10
Micro_Draft4_Additional_Properties_Type 20.17948507786675 ns/iter 18.520428883522595 ns/iter 1.09
Micro_Draft4_Nested_Oneof 39.8836480540137 ns/iter 40.89636839602472 ns/iter 0.98
Micro_Draft4_Short_Enum 5.204590091522227 ns/iter 5.389951569677379 ns/iter 0.97
Micro_Draft4_Long_Enum 10.125631877812836 ns/iter 9.28202110421618 ns/iter 1.09
Micro_Draft4_Long_Enum_Short_Strings 6.581482713648661 ns/iter 6.131917905572426 ns/iter 1.07
Micro_Draft4_Type_Object 2.4025523192413933 ns/iter 2.1933697505495937 ns/iter 1.10
Micro_Draft4_Ref_Single_100 1767103.3950616927 ns/iter 1542761.3459821593 ns/iter 1.15
Micro_Draft4_Compile_Ref_Many_Nested 1296449.7875458912 ns/iter 1112449.786963287 ns/iter 1.17
Micro_Draft4_Compile_Wrap 2104528.4879520126 ns/iter 1838345.4099218182 ns/iter 1.14
Micro_Draft6_Property_Names 117.01134587454256 ns/iter 99.18537499736553 ns/iter 1.18
Micro_Draft6_Compile_FHIR 11888772792.000053 ns/iter 6922828167.000034 ns/iter 1.72
Micro_Draft7_If_Then_Else 18.08671821066487 ns/iter 17.30072232010628 ns/iter 1.05
Micro_2019_09_Unevaluated_Properties 26.29839664869447 ns/iter 23.885100695124226 ns/iter 1.10
Micro_2019_09_Compile_Wrap 319604687.500032 ns/iter 273067694.3333492 ns/iter 1.17
Micro_2020_12_Dynamic_Ref 213.72720640534376 ns/iter 185.2626498942858 ns/iter 1.15
Micro_2020_12_Dynamic_Ref_Single 2.410685039293828 ns/iter 2.174189130358641 ns/iter 1.11
Micro_2020_12_Simple_Output_Mask 808.8994430126246 ns/iter 735.8286465806289 ns/iter 1.10
Micro_2020_12_Simple_Output_Annotations 90943.7939454408 ns/iter 79726.80513510975 ns/iter 1.14
Micro_2020_12_Compile_NonCircular_Shared_Refs 892770.7055215635 ns/iter 737412.7383476377 ns/iter 1.21
Micro_2020_12_Exhaustive_Deep_Numeric 5184.781250000015 ns/iter 5058.756102378151 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 116573.32487222411 ns/iter 104189.73125283388 ns/iter 1.12
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 14500.546115667603 ns/iter 12608.22395624223 ns/iter 1.15
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 92.42126330852454 ns/iter 81.90991009008906 ns/iter 1.13
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4882.097830680415 ns/iter 4508.390613424595 ns/iter 1.08
Alterschema_Check_Readibility_ISO_Language_Set_3 231510805.6666683 ns/iter 215649610.99996555 ns/iter 1.07
Alterschema_Check_Readibility_OMC 65291984.9090846 ns/iter 51615407.71428008 ns/iter 1.26
Alterschema_Check_Readibility_KrakenD 755324000.0000869 ns/iter 541340083.0000228 ns/iter 1.40
Alterschema_Apply_Readibility_KrakenD 77967888750.00005 ns/iter 58320906415.99984 ns/iter 1.34
Alterschema_Check_Invalid_External_Refs 187346104.2500253 ns/iter 161688333.24996966 ns/iter 1.16

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
E2E_Evaluator_adaptivecard 92162 ns 92759 ns 0.99
E2E_Evaluator_ansible-meta 343033 ns 335424 ns 1.02
E2E_Evaluator_aws-cdk 114458 ns 115010 ns 1.00
E2E_Evaluator_babelrc 254587 ns 246482 ns 1.03
E2E_Evaluator_cerebrum-criminal-case 1581706 ns 1591097 ns 0.99
E2E_Evaluator_clang-format 178842 ns 175085 ns 1.02
E2E_Evaluator_cmake-presets 11885531 ns 11539489 ns 1.03
E2E_Evaluator_code-climate 364077 ns 377891 ns 0.96
E2E_Evaluator_cql2 1179275 ns 958495 ns 1.23
E2E_Evaluator_cspell 1321415 ns 1175996 ns 1.12
E2E_Evaluator_cypress 636222 ns 501573 ns 1.27
E2E_Evaluator_deno 743673 ns 629017 ns 1.18
E2E_Evaluator_dependabot 856668 ns 676045 ns 1.27
E2E_Evaluator_draft-04 18755576 ns 14997047 ns 1.25
E2E_Evaluator_fabric-mod 1733683 ns 1286204 ns 1.35
E2E_Evaluator_geojson 16282822 ns 13083832 ns 1.24
E2E_Evaluator_gitpod-configuration 512635 ns 477931 ns 1.07
E2E_Evaluator_helm-chart-lock 877658 ns 797298 ns 1.10
E2E_Evaluator_importmap 256097 ns 195883 ns 1.31
E2E_Evaluator_jasmine 254502 ns 198888 ns 1.28
E2E_Evaluator_jsconfig 1056572 ns 1139069 ns 0.93
E2E_Evaluator_jshintrc 2813199 ns 1843069 ns 1.53
E2E_Evaluator_krakend 511773 ns 395963 ns 1.29
E2E_Evaluator_lazygit 323271 ns 269565 ns 1.20
E2E_Evaluator_lerna 366195 ns 297653 ns 1.23
E2E_Evaluator_nest-cli 453226 ns 387899 ns 1.17
E2E_Evaluator_omc 82881 ns 64983 ns 1.28
E2E_Evaluator_omnisharp 1150540 ns 948866 ns 1.21
E2E_Evaluator_openapi 18057706 ns 14267187 ns 1.27
E2E_Evaluator_pre-commit-hooks 1458131 ns 1232973 ns 1.18
E2E_Evaluator_pulumi 1713758 ns 1364139 ns 1.26
E2E_Evaluator_semantic-release 180217 ns 165154 ns 1.09
E2E_Evaluator_stale 317769 ns 262470 ns 1.21
E2E_Evaluator_stylecop 1075736 ns 653822 ns 1.65
E2E_Evaluator_tmuxinator 186514 ns 164325 ns 1.14
E2E_Evaluator_ui5 1821495 ns 1438875 ns 1.27
E2E_Evaluator_ui5-manifest 8913264 ns 6903427 ns 1.29
E2E_Evaluator_unreal-engine-uproject 1403317 ns 1110649 ns 1.26
E2E_Evaluator_users-array 2188784 ns 1716473 ns 1.28
E2E_Evaluator_vercel 882071 ns 670766 ns 1.32
E2E_Evaluator_yamllint 26193 ns 22198 ns 1.18

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
Schema_Iterator_ISO_Language 3083465.1853450034 ns/iter 2964314.59071636 ns/iter 1.04
Schema_Tracker_ISO_Language 5242499.170000201 ns/iter 4790479.276596296 ns/iter 1.09
Schema_Tracker_ISO_Language_To_JSON 23390306.56666713 ns/iter 20860382.363638785 ns/iter 1.12
Schema_Frame_WoT_References 5370264.323077068 ns/iter 5339558.793894096 ns/iter 1.01
Schema_Frame_OMC_References 22358399.451615784 ns/iter 22455906.677424215 ns/iter 1.00
Schema_Frame_OMC_Locations 20463798.176472344 ns/iter 20472857.99999506 ns/iter 1.00
Schema_Frame_ISO_Language_Locations 103024130.16667819 ns/iter 106432194.33332737 ns/iter 0.97
Schema_Frame_KrakenD_References 41463102.82353357 ns/iter 42377705.58823767 ns/iter 0.98
Schema_Frame_KrakenD_Reachable 620115297.9999733 ns/iter 618204445.000174 ns/iter 1.00
Schema_Frame_ISO_Language_Locations_To_JSON 120889756.6666754 ns/iter 123400202.50000332 ns/iter 0.98
Schema_Frame_Many_Resources_References 357126106.99999917 ns/iter 389030818.9999132 ns/iter 0.92
Schema_Bundle_Meta_2020_12 1701771.5742084766 ns/iter 1749911.8746901676 ns/iter 0.97
Schema_Format_ISO_Language_To_JSON 105572506.8571454 ns/iter 115161627.66668004 ns/iter 0.92
E2E_Compiler_adaptivecard 61639239.5454568 ns/iter 66486878.18181481 ns/iter 0.93
E2E_Compiler_ansible_meta 29296946.083334774 ns/iter 30313121.869569484 ns/iter 0.97
E2E_Compiler_aws_cdk 366579.13082154165 ns/iter 392201.0607082641 ns/iter 0.93
E2E_Compiler_babelrc 2601912.0334572326 ns/iter 2683683.9042142057 ns/iter 0.97
E2E_Compiler_clang_format 18725725.918919716 ns/iter 19073394.594596647 ns/iter 0.98
E2E_Compiler_cmake_presets 26594712.538461898 ns/iter 27189556.384611864 ns/iter 0.98
E2E_Compiler_code_climate 2633520.917293009 ns/iter 2692975.82625466 ns/iter 0.98
E2E_Compiler_cql2 13137370.45283027 ns/iter 13490160.673077647 ns/iter 0.97
E2E_Compiler_cspell 23437878.66666768 ns/iter 24035642.206901435 ns/iter 0.98
E2E_Compiler_cypress 4050776.052023175 ns/iter 4170099.928571636 ns/iter 0.97
E2E_Compiler_deno 7829948.20224814 ns/iter 8140311.430232687 ns/iter 0.96
E2E_Compiler_dependabot 4053371.5284089507 ns/iter 4078808.226743837 ns/iter 0.99
E2E_Compiler_draft_04 2712597.441860777 ns/iter 2867455.3790324354 ns/iter 0.95
E2E_Compiler_fabric_mod 4844220.020833253 ns/iter 4954914.510637136 ns/iter 0.98
E2E_Compiler_geojson 22571884.06451493 ns/iter 22809814.12902674 ns/iter 0.99
E2E_Compiler_gitpod_configuration 4960935.9214287 ns/iter 5119066.430656824 ns/iter 0.97
E2E_Compiler_helm_chart_lock 691171.5681592149 ns/iter 741718.6098901656 ns/iter 0.93
E2E_Compiler_importmap 275324.71569402004 ns/iter 297852.4074861227 ns/iter 0.92
E2E_Compiler_jasmine 1361322.5330739073 ns/iter 1429156.1832992733 ns/iter 0.95
E2E_Compiler_jshintrc 4415047.496855212 ns/iter 4571084.573332579 ns/iter 0.97
E2E_Compiler_jsconfig 22110265.156250365 ns/iter 22744728.419352654 ns/iter 0.97
E2E_Compiler_krakend 138660879.99999765 ns/iter 149449974.3999768 ns/iter 0.93
E2E_Compiler_lazygit 34288610.650003195 ns/iter 34471156.00000643 ns/iter 0.99
E2E_Compiler_lerna 1599367.9221966856 ns/iter 1684114.70503583 ns/iter 0.95
E2E_Compiler_nest_cli 7569258.22580582 ns/iter 7787943.344444809 ns/iter 0.97
E2E_Compiler_omc 158559482.75000742 ns/iter 172728844.00000522 ns/iter 0.92
E2E_Compiler_omnisharp 6791667.233009877 ns/iter 7108736.927833533 ns/iter 0.96
E2E_Compiler_openapi 25440834.607142698 ns/iter 26098236.00000204 ns/iter 0.97
E2E_Compiler_pre_commit_hooks 5371262.076335696 ns/iter 5512277.818897427 ns/iter 0.97
E2E_Compiler_pulumi 4069534.686046149 ns/iter 4196964.916167973 ns/iter 0.97
E2E_Compiler_semantic_release 1564649.5691965206 ns/iter 1630846.761123922 ns/iter 0.96
E2E_Compiler_stale 1559526.1808036196 ns/iter 1626748.7494202731 ns/iter 0.96
E2E_Compiler_stylecop 6188354.318583836 ns/iter 6470199.633027616 ns/iter 0.96
E2E_Compiler_tmuxinator 1933132.6033059382 ns/iter 2013288.4166667375 ns/iter 0.96
E2E_Compiler_ui5 48518037.0714277 ns/iter 48495648.142842844 ns/iter 1.00
E2E_Compiler_ui5_manifest 306486130.4999908 ns/iter 326590301.5000049 ns/iter 0.94
E2E_Compiler_unreal_engine_uproject 4646416.205297938 ns/iter 4788054.527396476 ns/iter 0.97
E2E_Compiler_users_array 771075.9955800554 ns/iter 837556.6358245879 ns/iter 0.92
E2E_Compiler_vercel 12548630.3571429 ns/iter 13027090.03703563 ns/iter 0.96
E2E_Compiler_yamllint 332574.7123222815 ns/iter 362742.0010346261 ns/iter 0.92
E2E_Evaluator_adaptivecard 24834.36148359571 ns/iter 26887.324697083288 ns/iter 0.92
E2E_Evaluator_ansible_meta 214700.34831834535 ns/iter 245216.26514367672 ns/iter 0.88
E2E_Evaluator_aws_cdk 42704.20424093745 ns/iter 51063.745831809305 ns/iter 0.84
E2E_Evaluator_babelrc 90851.41361867674 ns/iter 107884.19119457474 ns/iter 0.84
E2E_Evaluator_cerebrum_criminal_case 1068063.4203124484 ns/iter 1012589.8850572349 ns/iter 1.05
E2E_Evaluator_clang_format 118647.88052648905 ns/iter 117833.59503712956 ns/iter 1.01
E2E_Evaluator_cmake_presets 4399405.074534019 ns/iter 4455423.000000694 ns/iter 0.99
E2E_Evaluator_code_climate 158013.29873929446 ns/iter 180371.2410202876 ns/iter 0.88
E2E_Evaluator_cql2 190786.04856514267 ns/iter 219498.65150083415 ns/iter 0.87
E2E_Evaluator_cspell 583792.0317848027 ns/iter 580734.0242272395 ns/iter 1.01
E2E_Evaluator_cypress 173002.74157302917 ns/iter 191320.17669480544 ns/iter 0.90
E2E_Evaluator_deno 253046.58251367032 ns/iter 316236.038026221 ns/iter 0.80
E2E_Evaluator_dependabot 318914.6256756926 ns/iter 335006.32055062783 ns/iter 0.95
E2E_Evaluator_draft_04 7543817.797618484 ns/iter 10520423.632352263 ns/iter 0.72
E2E_Evaluator_fabric_mod 672918.0488974563 ns/iter 681584.3966861442 ns/iter 0.99
E2E_Evaluator_geojson 19490016.777777124 ns/iter 20006818.371426303 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 210569.78551954834 ns/iter 238675.84203390696 ns/iter 0.88
E2E_Evaluator_helm_chart_lock 208206.91626650374 ns/iter 319341.5332726216 ns/iter 0.65
E2E_Evaluator_importmap 56269.47309998514 ns/iter 47932.08769669154 ns/iter 1.17
E2E_Evaluator_jasmine 96823.83775605813 ns/iter 107418.99436321447 ns/iter 0.90
E2E_Evaluator_jshintrc 1176259.6915255247 ns/iter 1199642.3304792612 ns/iter 0.98
E2E_Evaluator_jsconfig 407865.02091815136 ns/iter 427186.7177615421 ns/iter 0.95
E2E_Evaluator_krakend 186332.6110962672 ns/iter 212774.20073216455 ns/iter 0.88
E2E_Evaluator_lazygit 125835.77113887356 ns/iter 149676.18414967766 ns/iter 0.84
E2E_Evaluator_lerna 110317.94580503125 ns/iter 136855.7452054666 ns/iter 0.81
E2E_Evaluator_nest_cli 176431.3646521589 ns/iter 185041.11321251423 ns/iter 0.95
E2E_Evaluator_omc 18177.068123088193 ns/iter 18779.789179208212 ns/iter 0.97
E2E_Evaluator_omnisharp 567130.2183156754 ns/iter 611675.4806678868 ns/iter 0.93
E2E_Evaluator_openapi 9931214.690141132 ns/iter 9640900.21739139 ns/iter 1.03
E2E_Evaluator_pre_commit_hooks 483721.3571929105 ns/iter 482867.89631174126 ns/iter 1.00
E2E_Evaluator_pulumi 668887.259652388 ns/iter 721623.4123606749 ns/iter 0.93
E2E_Evaluator_semantic_release 78852.31240062683 ns/iter 98857.58048917098 ns/iter 0.80
E2E_Evaluator_stale 145505.11053608882 ns/iter 149420.22340649445 ns/iter 0.97
E2E_Evaluator_stylecop 267829.21295238164 ns/iter 298218.82572266116 ns/iter 0.90
E2E_Evaluator_tmuxinator 84833.59157895287 ns/iter 98916.50688009254 ns/iter 0.86
E2E_Evaluator_ui5 481372.6174450164 ns/iter 505022.151852009 ns/iter 0.95
E2E_Evaluator_ui5_manifest 2353506.9696965045 ns/iter 2522240.066177099 ns/iter 0.93
E2E_Evaluator_unreal_engine_uproject 427358.3303249541 ns/iter 433942.36583850975 ns/iter 0.98
E2E_Evaluator_users_array 619540.1616608816 ns/iter 585197.7276524135 ns/iter 1.06
E2E_Evaluator_vercel 258238.9554806788 ns/iter 316529.6996834709 ns/iter 0.82
E2E_Evaluator_yamllint 8246.185703660902 ns/iter 8760.86864119542 ns/iter 0.94
Micro_Draft4_Meta_1_No_Callback 197.8735401258848 ns/iter 195.05393431804077 ns/iter 1.01
Micro_Draft4_Required_Properties 969.0091407292591 ns/iter 795.0790632500798 ns/iter 1.22
Micro_Draft4_Many_Optional_Properties_Minimal_Match 26.02282921327489 ns/iter 23.305025262357308 ns/iter 1.12
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.318011521574146 ns/iter 11.232370342034768 ns/iter 1.01
Micro_Draft4_Items_Schema 246.1154889021962 ns/iter 278.91439477590154 ns/iter 0.88
Micro_Draft4_Nested_Object 1.4106025909564213 ns/iter 1.8127772027140998 ns/iter 0.78
Micro_Draft4_Properties_Triad_Optional 327.2977151654996 ns/iter 323.0167052965114 ns/iter 1.01
Micro_Draft4_Properties_Triad_Closed 271.11870597028604 ns/iter 278.54130365935083 ns/iter 0.97
Micro_Draft4_Properties_Triad_Required 343.83333643925056 ns/iter 339.8665301685385 ns/iter 1.01
Micro_Draft4_Properties_Closed 62.237657627081084 ns/iter 57.307748061718314 ns/iter 1.09
Micro_Draft4_Non_Recursive_Ref 14.434919717045029 ns/iter 11.768331917512738 ns/iter 1.23
Micro_Draft4_Pattern_Properties_True 150.8385867303842 ns/iter 166.25668603175083 ns/iter 0.91
Micro_Draft4_Ref_To_Single_Property 11.341168656333775 ns/iter 11.275136887295247 ns/iter 1.01
Micro_Draft4_Additional_Properties_Type 30.253461779438574 ns/iter 21.421710270381777 ns/iter 1.41
Micro_Draft4_Nested_Oneof 55.230186221105654 ns/iter 58.84208876846387 ns/iter 0.94
Micro_Draft4_Short_Enum 10.925524382216597 ns/iter 9.97559116624312 ns/iter 1.10
Micro_Draft4_Long_Enum 14.435275258619448 ns/iter 15.273201979384867 ns/iter 0.95
Micro_Draft4_Long_Enum_Short_Strings 10.923756063945467 ns/iter 9.973296525376144 ns/iter 1.10
Micro_Draft4_Type_Object 3.51966447620757 ns/iter 3.7391583439929237 ns/iter 0.94
Micro_Draft4_Ref_Single_100 2385373.0374149457 ns/iter 2487445.4007087788 ns/iter 0.96
Micro_Draft4_Compile_Ref_Many_Nested 1740918.4110276424 ns/iter 1783097.210659896 ns/iter 0.98
Micro_Draft4_Compile_Wrap 2365672.550676104 ns/iter 2439567.763066112 ns/iter 0.97
Micro_Draft6_Property_Names 132.65620929633297 ns/iter 126.41166363883634 ns/iter 1.05
Micro_Draft6_Compile_FHIR 14713281035.000137 ns/iter 13736758973.000177 ns/iter 1.07
Micro_Draft7_If_Then_Else 25.24362658786836 ns/iter 24.300358449304976 ns/iter 1.04
Micro_2019_09_Unevaluated_Properties 24.367672920538627 ns/iter 26.49889772893547 ns/iter 0.92
Micro_2019_09_Compile_Wrap 291006464.5000148 ns/iter 301415120.4999962 ns/iter 0.97
Micro_2020_12_Dynamic_Ref 242.59287262632867 ns/iter 232.25250702541743 ns/iter 1.04
Micro_2020_12_Dynamic_Ref_Single 3.5219463031752194 ns/iter 3.4261843375204326 ns/iter 1.03
Micro_2020_12_Simple_Output_Mask 1047.5469640149638 ns/iter 1135.8524632347546 ns/iter 0.92
Micro_2020_12_Simple_Output_Annotations 101508.91880841812 ns/iter 104706.45112000548 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1085643.0417309597 ns/iter 1133227.89354844 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric 8331.831222778705 ns/iter 8124.835557982927 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 172869.32853957117 ns/iter 179738.94800208698 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22927.70324082743 ns/iter 22556.479648248245 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 145.22782433420488 ns/iter 140.5085187082911 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4098.740203277393 ns/iter 4290.5735751524335 ns/iter 0.96
Alterschema_Check_Readibility_ISO_Language_Set_3 345116361.99999887 ns/iter 372042994.50002056 ns/iter 0.93
Alterschema_Check_Readibility_OMC 87413240.12498808 ns/iter 84392518.74997921 ns/iter 1.04
Alterschema_Check_Readibility_KrakenD 1259217461.0001621 ns/iter 1179448998.0002253 ns/iter 1.07
Alterschema_Apply_Readibility_KrakenD 126038868894.99973 ns/iter 119560088640 ns/iter 1.05
Alterschema_Check_Invalid_External_Refs 270397059.33331484 ns/iter 307834275.99999416 ns/iter 0.88

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
E2E_Evaluator_adaptivecard 119197 ns 117753 ns 1.01
E2E_Evaluator_ansible-meta 536482 ns 530758 ns 1.01
E2E_Evaluator_aws-cdk 126644 ns 141623 ns 0.89
E2E_Evaluator_babelrc 330102 ns 332811 ns 0.99
E2E_Evaluator_cerebrum-criminal-case 2637861 ns 2735420 ns 0.96
E2E_Evaluator_clang-format 259001 ns 265569 ns 0.98
E2E_Evaluator_cmake-presets 17485973 ns 17918308 ns 0.98
E2E_Evaluator_code-climate 487152 ns 508549 ns 0.96
E2E_Evaluator_cql2 1251682 ns 1231806 ns 1.02
E2E_Evaluator_cspell 1624662 ns 1513832 ns 1.07
E2E_Evaluator_cypress 827357 ns 798850 ns 1.04
E2E_Evaluator_deno 1083130 ns 1078596 ns 1.00
E2E_Evaluator_dependabot 1125345 ns 1124251 ns 1.00
E2E_Evaluator_draft-04 23036704 ns 21181377 ns 1.09
E2E_Evaluator_fabric-mod 2399170 ns 2329111 ns 1.03
E2E_Evaluator_geojson 19349046 ns 20464029 ns 0.95
E2E_Evaluator_gitpod-configuration 721359 ns 718827 ns 1.00
E2E_Evaluator_helm-chart-lock 996707 ns 994157 ns 1.00
E2E_Evaluator_importmap 266314 ns 269517 ns 0.99
E2E_Evaluator_jasmine 283220 ns 303034 ns 0.93
E2E_Evaluator_jsconfig 1421244 ns 1261286 ns 1.13
E2E_Evaluator_jshintrc 2866679 ns 2773513 ns 1.03
E2E_Evaluator_krakend 635734 ns 681490 ns 0.93
E2E_Evaluator_lazygit 447035 ns 528607 ns 0.85
E2E_Evaluator_lerna 454281 ns 480618 ns 0.95
E2E_Evaluator_nest-cli 596051 ns 590459 ns 1.01
E2E_Evaluator_omc 93408 ns 92521 ns 1.01
E2E_Evaluator_omnisharp 1441030 ns 1418137 ns 1.02
E2E_Evaluator_openapi 23394425 ns 24579148 ns 0.95
E2E_Evaluator_pre-commit-hooks 2026130 ns 2052600 ns 0.99
E2E_Evaluator_pulumi 1989757 ns 1896072 ns 1.05
E2E_Evaluator_semantic-release 220169 ns 259347 ns 0.85
E2E_Evaluator_stale 374913 ns 409394 ns 0.92
E2E_Evaluator_stylecop 1213265 ns 1292968 ns 0.94
E2E_Evaluator_tmuxinator 213417 ns 233421 ns 0.91
E2E_Evaluator_ui5 2350603 ns 2330727 ns 1.01
E2E_Evaluator_ui5-manifest 9780320 ns 11046090 ns 0.89
E2E_Evaluator_unreal-engine-uproject 1594600 ns 1540019 ns 1.04
E2E_Evaluator_users-array 2674390 ns 2472396 ns 1.08
E2E_Evaluator_vercel 1031416 ns 994207 ns 1.04
E2E_Evaluator_yamllint 23823 ns 25847 ns 0.92

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 387275547.0000584 ns/iter 360312917.4999822 ns/iter 1.07
Alterschema_Check_Readibility_OMC 101539107.99999721 ns/iter 98676846.71426754 ns/iter 1.03
Alterschema_Check_Readibility_KrakenD 1341369076.0000918 ns/iter 1330258124.000011 ns/iter 1.01
Alterschema_Apply_Readibility_KrakenD 135276485731.00009 ns/iter 132766668210.00003 ns/iter 1.02
Alterschema_Check_Invalid_External_Refs 336612255.499972 ns/iter 294844722.9999829 ns/iter 1.14
Micro_2020_12_Dynamic_Ref 262.48755951938034 ns/iter 268.03513352912864 ns/iter 0.98
Micro_2020_12_Dynamic_Ref_Single 4.982800893400967 ns/iter 4.923992139852536 ns/iter 1.01
Micro_2020_12_Simple_Output_Mask 1163.830140375 ns/iter 1114.2350590758758 ns/iter 1.04
Micro_2020_12_Simple_Output_Annotations 119178.93892094157 ns/iter 99648.55123977692 ns/iter 1.20
Micro_2020_12_Compile_NonCircular_Shared_Refs 1279330.788990984 ns/iter 1249058.2415631409 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric 9084.356936436146 ns/iter 8694.876380195792 ns/iter 1.04
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 166325.6590210014 ns/iter 165595.30651250714 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 25322.124554902708 ns/iter 26870.445755439523 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 145.8743984738865 ns/iter 150.1872119159051 ns/iter 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4773.942482017047 ns/iter 4457.845174453846 ns/iter 1.07
Micro_2019_09_Unevaluated_Properties 28.67809205230876 ns/iter 28.16838662680367 ns/iter 1.02
Micro_2019_09_Compile_Wrap 353268177.5000128 ns/iter 329107548.5000192 ns/iter 1.07
Micro_Draft7_If_Then_Else 25.22815172432259 ns/iter 24.91941514917067 ns/iter 1.01
Micro_Draft6_Property_Names 142.88161522896715 ns/iter 142.61089087588073 ns/iter 1.00
Micro_Draft6_Compile_FHIR 21050349985.9999 ns/iter 14234695972.000053 ns/iter 1.48
Micro_Draft4_Meta_1_No_Callback 191.8226540880437 ns/iter 177.3681001390101 ns/iter 1.08
Micro_Draft4_Required_Properties 830.9202286468933 ns/iter 832.3366356856124 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.5138580820139 ns/iter 20.985098988355848 ns/iter 1.03
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.797366942516199 ns/iter 12.666727134458188 ns/iter 1.01
Micro_Draft4_Items_Schema 343.1606081878795 ns/iter 317.8344019546276 ns/iter 1.08
Micro_Draft4_Nested_Object 1.5584224576939434 ns/iter 1.759053921254187 ns/iter 0.89
Micro_Draft4_Properties_Triad_Optional 591.5275224104371 ns/iter 453.5973600877639 ns/iter 1.30
Micro_Draft4_Properties_Triad_Closed 449.17166885707695 ns/iter 342.7776715948788 ns/iter 1.31
Micro_Draft4_Properties_Triad_Required 596.7189022037174 ns/iter 446.5262298382683 ns/iter 1.34
Micro_Draft4_Properties_Closed 61.70632840566688 ns/iter 64.31883909430032 ns/iter 0.96
Micro_Draft4_Non_Recursive_Ref 9.96205207373463 ns/iter 9.502264223515342 ns/iter 1.05
Micro_Draft4_Pattern_Properties_True 202.48010354187946 ns/iter 190.34427596809536 ns/iter 1.06
Micro_Draft4_Ref_To_Single_Property 12.803636992983257 ns/iter 13.011977050935487 ns/iter 0.98
Micro_Draft4_Additional_Properties_Type 14.958473072493243 ns/iter 14.074486134095677 ns/iter 1.06
Micro_Draft4_Nested_Oneof 65.10138477671887 ns/iter 65.48824358929923 ns/iter 0.99
Micro_Draft4_Short_Enum 14.65926010263139 ns/iter 14.534488365012415 ns/iter 1.01
Micro_Draft4_Long_Enum 14.026113977968077 ns/iter 13.590640482878232 ns/iter 1.03
Micro_Draft4_Long_Enum_Short_Strings 14.66099400249809 ns/iter 14.455829284004418 ns/iter 1.01
Micro_Draft4_Type_Object 5.0253888641936575 ns/iter 4.9251976461871525 ns/iter 1.02
Micro_Draft4_Ref_Single_100 2634149.505576012 ns/iter 2607827.3432836565 ns/iter 1.01
Micro_Draft4_Compile_Ref_Many_Nested 1884190.4501349968 ns/iter 1899035.7452575152 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2673385.375479393 ns/iter 2675970.9693486425 ns/iter 1.00
E2E_Compiler_adaptivecard 72262974.09999916 ns/iter 67299151.50001489 ns/iter 1.07
E2E_Compiler_ansible_meta 33372723.95238177 ns/iter 33139866.047620326 ns/iter 1.01
E2E_Compiler_aws_cdk 453643.58381880925 ns/iter 423088.1119177359 ns/iter 1.07
E2E_Compiler_babelrc 2922000.105041745 ns/iter 2926140.391666839 ns/iter 1.00
E2E_Compiler_clang_format 20639213.323527336 ns/iter 20396131.61764464 ns/iter 1.01
E2E_Compiler_cmake_presets 28373502.541664187 ns/iter 28466157.72000405 ns/iter 1.00
E2E_Compiler_code_climate 2956667.789915803 ns/iter 2950100.3713082396 ns/iter 1.00
E2E_Compiler_cql2 14538394.458332011 ns/iter 14513749.749999268 ns/iter 1.00
E2E_Compiler_cspell 24936098.964287467 ns/iter 25097766.071423523 ns/iter 0.99
E2E_Compiler_cypress 4285970.099379777 ns/iter 4382042.168749934 ns/iter 0.98
E2E_Compiler_deno 8867897.936708478 ns/iter 8919834.493671939 ns/iter 0.99
E2E_Compiler_dependabot 4419262.3836480845 ns/iter 4435825.7215190865 ns/iter 1.00
E2E_Compiler_draft_04 3142071.5112108565 ns/iter 3075621.399123145 ns/iter 1.02
E2E_Compiler_fabric_mod 5424087.953488126 ns/iter 5372483.446154336 ns/iter 1.01
E2E_Compiler_geojson 25272990.25000015 ns/iter 25009350.074073896 ns/iter 1.01
E2E_Compiler_gitpod_configuration 5573492.370967503 ns/iter 5532344.238094849 ns/iter 1.01
E2E_Compiler_helm_chart_lock 799240.3936290857 ns/iter 760836.288190713 ns/iter 1.05
E2E_Compiler_importmap 337049.8751806429 ns/iter 314148.6887595761 ns/iter 1.07
E2E_Compiler_jasmine 1557675.251670461 ns/iter 1534414.688596766 ns/iter 1.02
E2E_Compiler_jshintrc 4948408.619718937 ns/iter 4822721.2206884045 ns/iter 1.03
E2E_Compiler_jsconfig 23921194.13792867 ns/iter 24634239.428564794 ns/iter 0.97
E2E_Compiler_krakend 155329044.59996644 ns/iter 146531924.9999993 ns/iter 1.06
E2E_Compiler_lazygit 37592665.26315897 ns/iter 37215339.05263641 ns/iter 1.01
E2E_Compiler_lerna 1852653.6526313687 ns/iter 1848313.8859416423 ns/iter 1.00
E2E_Compiler_nest_cli 8417830.361447368 ns/iter 8389495.240964102 ns/iter 1.00
E2E_Compiler_omc 184240737.24997926 ns/iter 175868694.99996284 ns/iter 1.05
E2E_Compiler_omnisharp 7661350.725274443 ns/iter 7532476.76344247 ns/iter 1.02
E2E_Compiler_openapi 29156738.83333625 ns/iter 28695495.250000626 ns/iter 1.02
E2E_Compiler_pre_commit_hooks 5989547.188034373 ns/iter 5936965.442479211 ns/iter 1.01
E2E_Compiler_pulumi 4581249.006537143 ns/iter 4561994.4350645915 ns/iter 1.00
E2E_Compiler_semantic_release 1805812.0052083144 ns/iter 1773918.5558377292 ns/iter 1.02
E2E_Compiler_stale 1790189.065491234 ns/iter 1742855.5211970666 ns/iter 1.03
E2E_Compiler_stylecop 6972377.603960471 ns/iter 7001373.818181923 ns/iter 1.00
E2E_Compiler_tmuxinator 2224062.831746345 ns/iter 2184881.1433027894 ns/iter 1.02
E2E_Compiler_ui5 51563740.2307815 ns/iter 51918482.46153523 ns/iter 0.99
E2E_Compiler_ui5_manifest 347126087.49998707 ns/iter 334010806.9999133 ns/iter 1.04
E2E_Compiler_unreal_engine_uproject 5175048.318517804 ns/iter 5180031.518518633 ns/iter 1.00
E2E_Compiler_users_array 922956.5190538834 ns/iter 912539.0614377954 ns/iter 1.01
E2E_Compiler_vercel 13752306.431373939 ns/iter 13829574.666666374 ns/iter 0.99
E2E_Compiler_yamllint 408487.17850851966 ns/iter 385568.8931932074 ns/iter 1.06
E2E_Evaluator_adaptivecard 23353.547656035877 ns/iter 23662.903471555426 ns/iter 0.99
E2E_Evaluator_ansible_meta 266233.6183061347 ns/iter 243799.6815641923 ns/iter 1.09
E2E_Evaluator_aws_cdk 56013.11101328626 ns/iter 47636.43122269521 ns/iter 1.18
E2E_Evaluator_babelrc 106453.3526724587 ns/iter 86676.19025839055 ns/iter 1.23
E2E_Evaluator_cerebrum_criminal_case 1127211.4787401748 ns/iter 1132528.5867765949 ns/iter 1.00
E2E_Evaluator_clang_format 111542.20163618265 ns/iter 101184.85982661565 ns/iter 1.10
E2E_Evaluator_cmake_presets 6289909.516392414 ns/iter 4715946.184931404 ns/iter 1.33
E2E_Evaluator_code_climate 199241.7209897831 ns/iter 170121.66561743498 ns/iter 1.17
E2E_Evaluator_cql2 223142.35791133242 ns/iter 209313.4881416913 ns/iter 1.07
E2E_Evaluator_cspell 567520.9934426049 ns/iter 530359.9550303738 ns/iter 1.07
E2E_Evaluator_cypress 178799.69030132814 ns/iter 150308.89040247016 ns/iter 1.19
E2E_Evaluator_deno 358595.6238341706 ns/iter 292731.6742138437 ns/iter 1.22
E2E_Evaluator_dependabot 380793.1961644699 ns/iter 358562.51204512833 ns/iter 1.06
E2E_Evaluator_draft_04 10527614.08695717 ns/iter 7971785.555554684 ns/iter 1.32
E2E_Evaluator_fabric_mod 791329.5743241782 ns/iter 726934.2219897417 ns/iter 1.09
E2E_Evaluator_geojson 19101836.555560365 ns/iter 19803394.285710443 ns/iter 0.96
E2E_Evaluator_gitpod_configuration 272473.3913732021 ns/iter 233935.18307947813 ns/iter 1.16
E2E_Evaluator_helm_chart_lock 317662.9972375946 ns/iter 235864.59293187008 ns/iter 1.35
E2E_Evaluator_importmap 50611.171315304586 ns/iter 41074.38729472585 ns/iter 1.23
E2E_Evaluator_jasmine 118094.9236820262 ns/iter 104537.88832637953 ns/iter 1.13
E2E_Evaluator_jshintrc 1088139.2480739707 ns/iter 1076943.7663691 ns/iter 1.01
E2E_Evaluator_jsconfig 428466.56540341163 ns/iter 378514.3214671506 ns/iter 1.13
E2E_Evaluator_krakend 218191.12214931217 ns/iter 189042.7847761901 ns/iter 1.15
E2E_Evaluator_lazygit 152990.67523260246 ns/iter 128038.22671154545 ns/iter 1.19
E2E_Evaluator_lerna 166662.20778913185 ns/iter 134292.96925160268 ns/iter 1.24
E2E_Evaluator_nest_cli 203147.2715516926 ns/iter 182711.8462143048 ns/iter 1.11
E2E_Evaluator_omc 18863.227392881116 ns/iter 18979.452032255514 ns/iter 0.99
E2E_Evaluator_omnisharp 562680.3549959693 ns/iter 521574.4186221389 ns/iter 1.08
E2E_Evaluator_openapi 12087180.00000038 ns/iter 9799530.441174444 ns/iter 1.23
E2E_Evaluator_pre_commit_hooks 539194.604776725 ns/iter 481771.19548872334 ns/iter 1.12
E2E_Evaluator_pulumi 786513.7750281917 ns/iter 752509.8017150156 ns/iter 1.05
E2E_Evaluator_semantic_release 105483.76714005016 ns/iter 89150.97619644534 ns/iter 1.18
E2E_Evaluator_stale 165023.45197073487 ns/iter 157916.8577566682 ns/iter 1.05
E2E_Evaluator_stylecop 317149.10702947876 ns/iter 294375.0350803212 ns/iter 1.08
E2E_Evaluator_tmuxinator 101421.02432741107 ns/iter 91902.96224980976 ns/iter 1.10
E2E_Evaluator_ui5 569974.3100650095 ns/iter 519899.97686561436 ns/iter 1.10
E2E_Evaluator_ui5_manifest 3665858.605768991 ns/iter 2642106.1245289235 ns/iter 1.39
E2E_Evaluator_unreal_engine_uproject 487221.7887130961 ns/iter 442943.7691822604 ns/iter 1.10
E2E_Evaluator_users_array 685073.5504949535 ns/iter 681189.0845624577 ns/iter 1.01
E2E_Evaluator_vercel 340695.78564492345 ns/iter 282980.26085177535 ns/iter 1.20
E2E_Evaluator_yamllint 10959.488556067336 ns/iter 9199.47652272324 ns/iter 1.19
Schema_Format_ISO_Language_To_JSON 129147084.16671298 ns/iter 115995046.33337195 ns/iter 1.11
Schema_Bundle_Meta_2020_12 2111464.639610504 ns/iter 2008729.902860458 ns/iter 1.05
Schema_Frame_WoT_References 6148170.376067527 ns/iter 6050204.32174016 ns/iter 1.02
Schema_Frame_OMC_References 26532886.192302823 ns/iter 24968495.60714054 ns/iter 1.06
Schema_Frame_OMC_Locations 23215752.266666338 ns/iter 22969605.38709784 ns/iter 1.01
Schema_Frame_ISO_Language_Locations 111116190.16666435 ns/iter 106759532.57142672 ns/iter 1.04
Schema_Frame_KrakenD_References 45037782.87499926 ns/iter 46565174.56250242 ns/iter 0.97
Schema_Frame_KrakenD_Reachable 592576445.000077 ns/iter 591180633.0000218 ns/iter 1.00
Schema_Frame_ISO_Language_Locations_To_JSON 196226452.99995157 ns/iter 186022097.00003412 ns/iter 1.05
Schema_Frame_Many_Resources_References 408667140.0000341 ns/iter 396209666.99999374 ns/iter 1.03
Schema_Iterator_ISO_Language 3854004.2692310247 ns/iter 3688192.8148150546 ns/iter 1.04
Schema_Tracker_ISO_Language 5653145.854839089 ns/iter 5547348.231999422 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 29310555.416666757 ns/iter 27928357.59999434 ns/iter 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 3682b21 Previous: c0c7d98 Ratio
E2E_Evaluator_adaptivecard 130753 ns 121148 ns 1.08
E2E_Evaluator_ansible-meta 538597 ns 547996 ns 0.98
E2E_Evaluator_aws-cdk 150316 ns 129352 ns 1.16
E2E_Evaluator_babelrc 337403 ns 314813 ns 1.07
E2E_Evaluator_cerebrum-criminal-case 2550105 ns 2628395 ns 0.97
E2E_Evaluator_clang-format 275134 ns 274174 ns 1.00
E2E_Evaluator_cmake-presets 19341199 ns 18050571 ns 1.07
E2E_Evaluator_code-climate 511191 ns 493050 ns 1.04
E2E_Evaluator_cql2 1252864 ns 1279275 ns 0.98
E2E_Evaluator_cspell 1580925 ns 1608402 ns 0.98
E2E_Evaluator_cypress 816696 ns 847074 ns 0.96
E2E_Evaluator_deno 1088988 ns 1065887 ns 1.02
E2E_Evaluator_dependabot 1287140 ns 1089276 ns 1.18
E2E_Evaluator_draft-04 27961236 ns 25098435 ns 1.11
E2E_Evaluator_fabric-mod 2461277 ns 2522435 ns 0.98
E2E_Evaluator_geojson 21389154 ns 21986822 ns 0.97
E2E_Evaluator_gitpod-configuration 732331 ns 722291 ns 1.01
E2E_Evaluator_helm-chart-lock 1008648 ns 1062880 ns 0.95
E2E_Evaluator_importmap 276774 ns 265484 ns 1.04
E2E_Evaluator_jasmine 297749 ns 281549 ns 1.06
E2E_Evaluator_jsconfig 1317078 ns 1402318 ns 0.94
E2E_Evaluator_jshintrc 2835023 ns 2896706 ns 0.98
E2E_Evaluator_krakend 687344 ns 619861 ns 1.11
E2E_Evaluator_lazygit 524876 ns 464420 ns 1.13
E2E_Evaluator_lerna 449763 ns 443760 ns 1.01
E2E_Evaluator_nest-cli 617678 ns 595770 ns 1.04
E2E_Evaluator_omc 93735 ns 93114 ns 1.01
E2E_Evaluator_omnisharp 1463950 ns 1448980 ns 1.01
E2E_Evaluator_openapi 29127142 ns 24091745 ns 1.21
E2E_Evaluator_pre-commit-hooks 2692082 ns 2162031 ns 1.25
E2E_Evaluator_pulumi 2509311 ns 1968523 ns 1.27
E2E_Evaluator_semantic-release 276740 ns 225411 ns 1.23
E2E_Evaluator_stale 418369 ns 380801 ns 1.10
E2E_Evaluator_stylecop 1259829 ns 1211747 ns 1.04
E2E_Evaluator_tmuxinator 253891 ns 222176 ns 1.14
E2E_Evaluator_ui5 2626578 ns 2301476 ns 1.14
E2E_Evaluator_ui5-manifest 16313067 ns 9884491 ns 1.65
E2E_Evaluator_unreal-engine-uproject 1660306 ns 1646886 ns 1.01
E2E_Evaluator_users-array 4151368 ns 2562996 ns 1.62
E2E_Evaluator_vercel 1071328 ns 998050 ns 1.07
E2E_Evaluator_yamllint 26635 ns 23862 ns 1.12

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit a774160 into main May 29, 2026
14 checks passed
@jviotti jviotti deleted the draft3-tests branch May 29, 2026 16:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant