Skip to content

Conversation

@jviotti
Copy link
Member

@jviotti jviotti commented Jan 19, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bindings (linux/nodejs)

Details
Benchmark suite Current: 9b97361 Previous: 234d368 Ratio
E2E_Parse_BlazeJSON_ui5_manifest 112 ops/sec (±0.46%) 110 ops/sec (±0.51%) 0.98
E2E_Parse_JSON_ui5_manifest 795 ops/sec (±0.41%) 780 ops/sec (±0.40%) 0.98
E2E_Evaluator_adaptivecard 20357 ops/sec (±0.11%) 13463 ops/sec (±0.26%) 0.66
E2E_Evaluator_ansible_meta 1851 ops/sec (±0.23%) 1746 ops/sec (±0.70%) 0.94
E2E_Evaluator_aws_cdk 2717 ops/sec (±0.14%) 2661 ops/sec (±0.49%) 0.98
E2E_Evaluator_babelrc 1548 ops/sec (±0.43%) 1465 ops/sec (±0.74%) 0.95
E2E_Evaluator_clang_format 5067 ops/sec (±1.10%) 4899 ops/sec (±0.84%) 0.97
E2E_Evaluator_cmake_presets 147 ops/sec (±1.05%) 158 ops/sec (±0.59%) 1.07
E2E_Evaluator_code_climate 554 ops/sec (±0.15%) 545 ops/sec (±0.75%) 0.98
E2E_Evaluator_cql2 2495 ops/sec (±0.34%) 2697 ops/sec (±0.38%) 1.08
E2E_Evaluator_cspell 755 ops/sec (±0.22%) 769 ops/sec (±0.53%) 1.02
E2E_Evaluator_cypress 1228 ops/sec (±0.91%) 1211 ops/sec (±1.24%) 0.99
E2E_Evaluator_deno 958 ops/sec (±0.13%) 945 ops/sec (±0.37%) 0.99
E2E_Evaluator_dependabot 836 ops/sec (±0.18%) 832 ops/sec (±0.38%) 1.00
E2E_Evaluator_draft_04 103 ops/sec (±1.06%) 103 ops/sec (±2.26%) 1
E2E_Evaluator_fabric_mod 603 ops/sec (±0.17%) 583 ops/sec (±0.29%) 0.97
E2E_Evaluator_geojson 37.07 ops/sec (±0.19%) 25.59 ops/sec (±6.30%) 0.69
E2E_Evaluator_gitpod_configuration 1069 ops/sec (±0.19%) 989 ops/sec (±1.13%) 0.93
E2E_Evaluator_helm_chart_lock 351 ops/sec (±0.49%) 341 ops/sec (±0.66%) 0.97
E2E_Evaluator_importmap 1535 ops/sec (±0.12%) 1497 ops/sec (±1.00%) 0.98
E2E_Evaluator_jasmine 1292 ops/sec (±0.15%) 1224 ops/sec (±0.75%) 0.95
E2E_Evaluator_jsconfig 857 ops/sec (±0.96%) 841 ops/sec (±0.30%) 0.98
E2E_Evaluator_jshintrc 603 ops/sec (±0.31%) 579 ops/sec (±0.20%) 0.96
E2E_Evaluator_krakend 3468 ops/sec (±0.19%) 3453 ops/sec (±0.25%) 1.00
E2E_Evaluator_lazygit 2720 ops/sec (±0.18%) 2585 ops/sec (±0.78%) 0.95
E2E_Evaluator_lerna 1268 ops/sec (±0.11%) 1246 ops/sec (±0.43%) 0.98
E2E_Evaluator_nest_cli 1100 ops/sec (±0.10%) 1079 ops/sec (±0.59%) 0.98
E2E_Evaluator_omc 23665 ops/sec (±0.10%) 21491 ops/sec (±0.33%) 0.91
E2E_Evaluator_omnisharp 817 ops/sec (±0.16%) 797 ops/sec (±0.30%) 0.98
E2E_Evaluator_openapi 66.75 ops/sec (±1.29%)
E2E_Evaluator_pre_commit_hooks 778 ops/sec (±0.53%) 787 ops/sec (±0.35%) 1.01
E2E_Evaluator_pulumi 295 ops/sec (±0.44%) 289 ops/sec (±0.71%) 0.98
E2E_Evaluator_semantic_release 1539 ops/sec (±0.23%) 1517 ops/sec (±0.48%) 0.99
E2E_Evaluator_stale 1269 ops/sec (±0.14%) 1237 ops/sec (±0.36%) 0.97
E2E_Evaluator_stylecop 985 ops/sec (±0.15%) 963 ops/sec (±0.46%) 0.98
E2E_Evaluator_tmuxinator 2657 ops/sec (±0.12%) 2601 ops/sec (±0.54%) 0.98
E2E_Evaluator_ui5 731 ops/sec (±0.28%) 709 ops/sec (±0.42%) 0.97
E2E_Evaluator_ui5_manifest 242 ops/sec (±1.00%) 349 ops/sec (±0.25%) 1.44
E2E_Evaluator_unreal_engine_uproject 805 ops/sec (±0.15%) 790 ops/sec (±0.33%) 0.98
E2E_Evaluator_vercel 1232 ops/sec (±0.17%) 1214 ops/sec (±0.32%) 0.99
E2E_Evaluator_yamllint 1672 ops/sec (±0.10%) 1687 ops/sec (±0.18%) 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 9b97361 Previous: 234d368 Ratio
E2E_Compiler_adaptivecard 64060635.000004135 ns/iter 946779814.0000241 ns/iter 0.06766159782109857
E2E_Compiler_ansible_meta 26872033.80769286 ns/iter 28894819.624999475 ns/iter 0.93
E2E_Compiler_aws_cdk 506171.7962154141 ns/iter 508825.9039301423 ns/iter 0.99
E2E_Compiler_babelrc 2674969.11538453 ns/iter 3017988.2294372013 ns/iter 0.89
E2E_Compiler_clang_format 17935468.41025627 ns/iter 18321005.10526402 ns/iter 0.98
E2E_Compiler_cmake_presets 25813327.29629661 ns/iter 57066899.25000319 ns/iter 0.45
E2E_Compiler_code_climate 2626553.4606740614 ns/iter 2696075.9500000747 ns/iter 0.97
E2E_Compiler_cql2 12813224.272726776 ns/iter 154369120.8000041 ns/iter 0.0830038041696642
E2E_Compiler_cspell 22335309.45161346 ns/iter 29969747.434783448 ns/iter 0.75
E2E_Compiler_cypress 4044962.5780346165 ns/iter 4723851.648648363 ns/iter 0.86
E2E_Compiler_deno 8222144.223529594 ns/iter 8436822.506024487 ns/iter 0.97
E2E_Compiler_dependabot 4211647.035928142 ns/iter 4267978.184049105 ns/iter 0.99
E2E_Compiler_draft_04 2735176.0859375405 ns/iter 14514491.020834206 ns/iter 0.19
E2E_Compiler_fabric_mod 4839275.368055556 ns/iter 5069233.521738951 ns/iter 0.95
E2E_Compiler_geojson 24123574.27586138 ns/iter 25467367.000000454 ns/iter 0.95
E2E_Compiler_gitpod_configuration 4989342.574468127 ns/iter 5273654.616541306 ns/iter 0.95
E2E_Compiler_helm_chart_lock 841286.517448892 ns/iter 843238.8118214626 ns/iter 1.00
E2E_Compiler_importmap 417561.3019093152 ns/iter 412265.4860943202 ns/iter 1.01
E2E_Compiler_jasmine 1467942.5536842484 ns/iter 1544840.569536475 ns/iter 0.95
E2E_Compiler_jshintrc 4734544.972973023 ns/iter 4828456.753424711 ns/iter 0.98
E2E_Compiler_jsconfig 21232660.363637026 ns/iter 22271608.838709213 ns/iter 0.95
E2E_Compiler_krakend 135183967.00000042 ns/iter 186729919.2500127 ns/iter 0.72
E2E_Compiler_lazygit 33402028.38095203 ns/iter 34954211.90000059 ns/iter 0.96
E2E_Compiler_lerna 1807328.6201550544 ns/iter 1847693.5370369488 ns/iter 0.98
E2E_Compiler_nest_cli 7500657.351063739 ns/iter 8572214.65853663 ns/iter 0.87
E2E_Compiler_omc 150185318.19999906 ns/iter 593485168.9999619 ns/iter 0.25
E2E_Compiler_omnisharp 7098631.612245058 ns/iter 7324125.284210487 ns/iter 0.97
E2E_Compiler_openapi 24508235.896552507 ns/iter 390331693.9999968 ns/iter 0.06278822927597755
E2E_Compiler_pre_commit_hooks 5243549.142857117 ns/iter 5282080.651514923 ns/iter 0.99
E2E_Compiler_pulumi 4101620.817647245 ns/iter 4553929.441558408 ns/iter 0.90
E2E_Compiler_semantic_release 1643921.3341177225 ns/iter 1705628.1508516062 ns/iter 0.96
E2E_Compiler_stale 1666665.7183770542 ns/iter 1743755.485074586 ns/iter 0.96
E2E_Compiler_stylecop 6318430.163636631 ns/iter 6604792.813084153 ns/iter 0.96
E2E_Compiler_tmuxinator 2148639.8435582765 ns/iter 2194591.773584857 ns/iter 0.98
E2E_Compiler_ui5 49685807.499997735 ns/iter 91546911.12500046 ns/iter 0.54
E2E_Compiler_ui5_manifest 320686552.00001216 ns/iter 1786922930.9999924 ns/iter 0.18
E2E_Compiler_unreal_engine_uproject 4672099.69999999 ns/iter 4927151.070922374 ns/iter 0.95
E2E_Compiler_vercel 13958370.839999361 ns/iter 14440196.775510406 ns/iter 0.97
E2E_Compiler_yamllint 455007.4249512667 ns/iter 452579.94556058594 ns/iter 1.01
E2E_Evaluator_adaptivecard 39063.81160454404 ns/iter 57394.23181448695 ns/iter 0.68
E2E_Evaluator_ansible_meta 315371.3698384094 ns/iter 324723.94736840413 ns/iter 0.97
E2E_Evaluator_aws_cdk 76538.23250372117 ns/iter 70722.25497324257 ns/iter 1.08
E2E_Evaluator_babelrc 153578.80514892546 ns/iter 166550.60014104279 ns/iter 0.92
E2E_Evaluator_clang_format 138582.0845573638 ns/iter 142170.35595652915 ns/iter 0.97
E2E_Evaluator_cmake_presets 5709830.105691095 ns/iter 5542779.639999935 ns/iter 1.03
E2E_Evaluator_code_climate 284256.92027519573 ns/iter 280996.3876582335 ns/iter 1.01
E2E_Evaluator_cql2 317098.59499329276 ns/iter 277817.1904950534 ns/iter 1.14
E2E_Evaluator_cspell 750995.1995684699 ns/iter 714756.1323828769 ns/iter 1.05
E2E_Evaluator_cypress 233177.02013422904 ns/iter 243218.20236439313 ns/iter 0.96
E2E_Evaluator_deno 419092.62333138613 ns/iter 411629.6291079712 ns/iter 1.02
E2E_Evaluator_dependabot 593217.745114688 ns/iter 576768.6763005608 ns/iter 1.03
E2E_Evaluator_draft_04 9661513.633802833 ns/iter 9255732.849314975 ns/iter 1.04
E2E_Evaluator_fabric_mod 943579.6554053904 ns/iter 982704.7503505934 ns/iter 0.96
E2E_Evaluator_geojson 30683337.9130442 ns/iter 30414811.826087475 ns/iter 1.01
E2E_Evaluator_gitpod_configuration 318363.5915943304 ns/iter 329540.9884670664 ns/iter 0.97
E2E_Evaluator_helm_chart_lock 461773.7403024064 ns/iter 463941.1826604555 ns/iter 1.00
E2E_Evaluator_importmap 70623.64557353454 ns/iter 72511.8321399332 ns/iter 0.97
E2E_Evaluator_jasmine 176181.48470410163 ns/iter 174053.0776892371 ns/iter 1.01
E2E_Evaluator_jshintrc 1308054.5102803693 ns/iter 1383067.0217822164 ns/iter 0.95
E2E_Evaluator_jsconfig 533851.9666666753 ns/iter 534831.0217066157 ns/iter 1.00
E2E_Evaluator_krakend 279893.7466403241 ns/iter 282511.4304823673 ns/iter 0.99
E2E_Evaluator_lazygit 192147.48147146005 ns/iter 191453.78134513026 ns/iter 1.00
E2E_Evaluator_lerna 208613.08705952135 ns/iter 207471.1907018158 ns/iter 1.01
E2E_Evaluator_nest_cli 264387.61821704824 ns/iter 265591.2323384996 ns/iter 1.00
E2E_Evaluator_omc 29321.961960855388 ns/iter 30983.631381216517 ns/iter 0.95
E2E_Evaluator_omnisharp 724131.640495843 ns/iter 753916.2152034602 ns/iter 0.96
E2E_Evaluator_openapi 15989230.707317548 ns/iter 13591204.07692361 ns/iter 1.18
E2E_Evaluator_pre_commit_hooks 595968.4112628291 ns/iter 634074.758558525 ns/iter 0.94
E2E_Evaluator_pulumi 899784.6969310015 ns/iter 902234.699354839 ns/iter 1.00
E2E_Evaluator_semantic_release 139913.54148207753 ns/iter 141589.37794175808 ns/iter 0.99
E2E_Evaluator_stale 203573.69504373538 ns/iter 223423.69844296115 ns/iter 0.91
E2E_Evaluator_stylecop 373028.15583727637 ns/iter 382068.610225382 ns/iter 0.98
E2E_Evaluator_tmuxinator 137262.197526012 ns/iter 140707.70062036882 ns/iter 0.98
E2E_Evaluator_ui5 727736.2747934121 ns/iter 794424.2992700483 ns/iter 0.92
E2E_Evaluator_ui5_manifest 3399176.1707317517 ns/iter 2315956.1683500325 ns/iter 1.47
E2E_Evaluator_unreal_engine_uproject 535271.878122661 ns/iter 574839.756157675 ns/iter 0.93
E2E_Evaluator_vercel 406270.2883720968 ns/iter 400724.6981776655 ns/iter 1.01
E2E_Evaluator_yamllint 17456.96728456731 ns/iter 18022.901346169012 ns/iter 0.97
Micro_Draft4_Meta_1_No_Callback 256.525298244312 ns/iter 293.5715624046715 ns/iter 0.87
Micro_Draft4_Required_Properties 1144.2928167533194 ns/iter 690.1030664580378 ns/iter 1.66
Micro_Draft4_Many_Optional_Properties_Minimal_Match 31.434825197987447 ns/iter 35.57491409565837 ns/iter 0.88
Micro_Draft4_Few_Optional_Properties_Minimal_Match 19.614132162168026 ns/iter 15.906813004555827 ns/iter 1.23
Micro_Draft4_Items_Schema 632.3747592732489 ns/iter 621.8674889814775 ns/iter 1.02
Micro_Draft4_Nested_Object 3.111921625750828 ns/iter 6.847310912801489 ns/iter 0.45
Micro_Draft4_Properties_Triad_Optional 398.0533746870461 ns/iter 405.1852724097372 ns/iter 0.98
Micro_Draft4_Properties_Triad_Closed 326.8447368507627 ns/iter 326.8220817037828 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 435.3155566001323 ns/iter 394.56821665730325 ns/iter 1.10
Micro_Draft4_Properties_Closed 79.51262137560339 ns/iter 87.11501102116462 ns/iter 0.91
Micro_Draft4_Non_Recursive_Ref 34.61257521020375 ns/iter 35.146064942811066 ns/iter 0.98
Micro_Draft4_Pattern_Properties_True 256.4881552389623 ns/iter 263.28013716200684 ns/iter 0.97
Micro_Draft4_Ref_To_Single_Property 19.60314934789653 ns/iter 15.873641829707736 ns/iter 1.23
Micro_Draft4_Additional_Properties_Type 66.99552225248297 ns/iter 62.79614775068686 ns/iter 1.07
Micro_Draft4_Nested_Oneof 89.27831362752791 ns/iter 89.30056524410615 ns/iter 1.00
Micro_Draft4_Short_Enum 15.013905021963877 ns/iter 17.116544875082404 ns/iter 0.88
Micro_Draft4_Long_Enum 19.299082879519364 ns/iter 22.0085760569684 ns/iter 0.88
Micro_Draft4_Long_Enum_Short_Strings 15.02933823517239 ns/iter 17.43645048696296 ns/iter 0.86
Micro_Draft4_Type_Object 9.025161618527445 ns/iter 12.150758470676616 ns/iter 0.74
Micro_Draft4_Ref_Single_100 2422820.1041665506 ns/iter 2654232.0563909644 ns/iter 0.91
Micro_Draft4_Compile_Ref_Many_Nested 1749084.3583960156 ns/iter
Micro_Draft6_Property_Names 133.62084139669582 ns/iter 148.31202872322368 ns/iter 0.90
Micro_Draft7_If_Then_Else 40.48035031593396 ns/iter 41.541096364083934 ns/iter 0.97
Micro_2019_09_Unevaluated_Properties 52.93202204159865 ns/iter 57.36800958372516 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 377.7514930167447 ns/iter 538.2030644505252 ns/iter 0.70
Micro_2020_12_Dynamic_Ref_Single 8.718931250230247 ns/iter 12.451151628443169 ns/iter 0.70
Micro_2020_12_Simple_Output_Mask 141372.66183479017 ns/iter 140530.2961407803 ns/iter 1.01
Micro_2020_12_Simple_Output_Annotations 164489.43998098475 ns/iter 170003.7752475183 ns/iter 0.97
Micro_2020_12_Compile_NonCircular_Shared_Refs 1090810.6329704444 ns/iter 7903735.80898925 ns/iter 0.14

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 9b97361 Previous: 234d368 Ratio
E2E_Compiler_adaptivecard 103054258.39999315 ns/iter 902734916.0000994 ns/iter 0.11
E2E_Compiler_ansible_meta 45088368.61538594 ns/iter 33448425.00000027 ns/iter 1.35
E2E_Compiler_aws_cdk 615858.6248982665 ns/iter 484169.51006126375 ns/iter 1.27
E2E_Compiler_babelrc 3802033.532544621 ns/iter 3183578.4438768243 ns/iter 1.19
E2E_Compiler_clang_format 28782478.407404397 ns/iter 18748112.418607403 ns/iter 1.54
E2E_Compiler_cmake_presets 51701641.699992254 ns/iter 64136184.00000587 ns/iter 0.81
E2E_Compiler_code_climate 4055521.0747130727 ns/iter 2702858.6956525347 ns/iter 1.50
E2E_Compiler_cql2 23858478.483871736 ns/iter 125182972.33331548 ns/iter 0.19
E2E_Compiler_cspell 37754583.2941183 ns/iter 33050210.227274463 ns/iter 1.14
E2E_Compiler_cypress 7425631.8061220925 ns/iter 5129116.670000258 ns/iter 1.45
E2E_Compiler_deno 13524951.923078386 ns/iter 9473941.119564267 ns/iter 1.43
E2E_Compiler_dependabot 6619872.04424788 ns/iter 4601636.090909212 ns/iter 1.44
E2E_Compiler_draft_04 3711220.9112427123 ns/iter 10775311.475411354 ns/iter 0.34
E2E_Compiler_fabric_mod 6380146.861385925 ns/iter 4225970.274390187 ns/iter 1.51
E2E_Compiler_geojson 42383544.64285976 ns/iter 26853410.714281946 ns/iter 1.58
E2E_Compiler_gitpod_configuration 8444737.65432162 ns/iter 5365784.580001218 ns/iter 1.57
E2E_Compiler_helm_chart_lock 1033276.4793057372 ns/iter 728642.3857912638 ns/iter 1.42
E2E_Compiler_importmap 607778.2920000346 ns/iter 392358.4671018779 ns/iter 1.55
E2E_Compiler_jasmine 2565595.8101604963 ns/iter 1593311.4088051035 ns/iter 1.61
E2E_Compiler_jshintrc 6217013.0784314405 ns/iter 4488381.141026109 ns/iter 1.39
E2E_Compiler_jsconfig 36681813.63157505 ns/iter 22433535.48148527 ns/iter 1.64
E2E_Compiler_krakend 225643027.66666818 ns/iter 227910111.00002834 ns/iter 0.99
E2E_Compiler_lazygit 55201254.20000567 ns/iter 46512423.99999694 ns/iter 1.19
E2E_Compiler_lerna 2874491.6666667564 ns/iter 1894811.153846464 ns/iter 1.52
E2E_Compiler_nest_cli 9868661.056179661 ns/iter 9580556.734938482 ns/iter 1.03
E2E_Compiler_omc 289830020.5000055 ns/iter 720599917.0000724 ns/iter 0.40
E2E_Compiler_omnisharp 13047970.48611148 ns/iter 7165697.012346248 ns/iter 1.82
E2E_Compiler_openapi 44879265.62499922 ns/iter 380057624.99994946 ns/iter 0.12
E2E_Compiler_pre_commit_hooks 7837380.251968657 ns/iter 5116830.437499529 ns/iter 1.53
E2E_Compiler_pulumi 6623800.272727524 ns/iter 4744778.606667144 ns/iter 1.40
E2E_Compiler_semantic_release 2855347.169884226 ns/iter 1778620.2689241504 ns/iter 1.61
E2E_Compiler_stale 2610278.181818186 ns/iter 1793540.535802521 ns/iter 1.46
E2E_Compiler_stylecop 11618359.090909343 ns/iter 7724234.273584169 ns/iter 1.50
E2E_Compiler_tmuxinator 3477356.1946900752 ns/iter 2396267.6399999815 ns/iter 1.45
E2E_Compiler_ui5 110079722.16666909 ns/iter 105694187.4999969 ns/iter 1.04
E2E_Compiler_ui5_manifest 646744832.999957 ns/iter 1802411208.9999561 ns/iter 0.36
E2E_Compiler_unreal_engine_uproject 9676382.933333203 ns/iter 5028024.509803853 ns/iter 1.92
E2E_Compiler_vercel 28122466.666665483 ns/iter 19681781.57575852 ns/iter 1.43
E2E_Compiler_yamllint 665879.7562231718 ns/iter 426224.9785296556 ns/iter 1.56
E2E_Evaluator_adaptivecard 47389.266417950355 ns/iter 52089.85419999408 ns/iter 0.91
E2E_Evaluator_ansible_meta 390729.4131028209 ns/iter 221410.50436102267 ns/iter 1.76
E2E_Evaluator_aws_cdk 78685.95820292487 ns/iter 51021.70429948997 ns/iter 1.54
E2E_Evaluator_babelrc 190993.24737230365 ns/iter 114379.43185121458 ns/iter 1.67
E2E_Evaluator_clang_format 173631.2906417849 ns/iter 107008.04115855112 ns/iter 1.62
E2E_Evaluator_cmake_presets 6435831.807339378 ns/iter 4603239.896969723 ns/iter 1.40
E2E_Evaluator_code_climate 285711.386839474 ns/iter 220238.79837396953 ns/iter 1.30
E2E_Evaluator_cql2 398701.93813956494 ns/iter 261252.79888714539 ns/iter 1.53
E2E_Evaluator_cspell 956979.9781590622 ns/iter 563852.8330000554 ns/iter 1.70
E2E_Evaluator_cypress 308201.8312088022 ns/iter 160767.477628636 ns/iter 1.92
E2E_Evaluator_deno 612501.9449113577 ns/iter 311100.1124592166 ns/iter 1.97
E2E_Evaluator_dependabot 766731.8273381984 ns/iter 480891.63758859347 ns/iter 1.59
E2E_Evaluator_draft_04 12637935.194444733 ns/iter 7682741.138296478 ns/iter 1.64
E2E_Evaluator_fabric_mod 1235611.3937499912 ns/iter 748689.1466207957 ns/iter 1.65
E2E_Evaluator_geojson 46810811.06665867 ns/iter 16541451.736842597 ns/iter 2.83
E2E_Evaluator_gitpod_configuration 391228.486748233 ns/iter 212436.6521871665 ns/iter 1.84
E2E_Evaluator_helm_chart_lock 684803.2079999484 ns/iter 343708.04625983443 ns/iter 1.99
E2E_Evaluator_importmap 85016.17017775522 ns/iter 47040.92767243893 ns/iter 1.81
E2E_Evaluator_jasmine 217002.95275584515 ns/iter 124293.09570839863 ns/iter 1.75
E2E_Evaluator_jshintrc 1715865.7289005683 ns/iter 1044506.3476702517 ns/iter 1.64
E2E_Evaluator_jsconfig 606748.0143720881 ns/iter 399449.7972222967 ns/iter 1.52
E2E_Evaluator_krakend 290489.0732553084 ns/iter 183799.3542499703 ns/iter 1.58
E2E_Evaluator_lazygit 216573.67411608648 ns/iter 127566.6533226429 ns/iter 1.70
E2E_Evaluator_lerna 278911.1132147019 ns/iter 160202.41739452086 ns/iter 1.74
E2E_Evaluator_nest_cli 311339.1434263654 ns/iter 214834.2038997315 ns/iter 1.45
E2E_Evaluator_omc 37255.09308211199 ns/iter 24800.065341975005 ns/iter 1.50
E2E_Evaluator_omnisharp 921726.4412416952 ns/iter 554349.6471024646 ns/iter 1.66
E2E_Evaluator_openapi 20494130.94285098 ns/iter 8939108.02469017 ns/iter 2.29
E2E_Evaluator_pre_commit_hooks 672427.0830000023 ns/iter 422159.8808038461 ns/iter 1.59
E2E_Evaluator_pulumi 1187676.793103547 ns/iter 708449.2616033021 ns/iter 1.68
E2E_Evaluator_semantic_release 178818.585920187 ns/iter 110672.06259274694 ns/iter 1.62
E2E_Evaluator_stale 200005.93770672518 ns/iter 157658.47472488432 ns/iter 1.27
E2E_Evaluator_stylecop 339390.12158065743 ns/iter 278974.7398091192 ns/iter 1.22
E2E_Evaluator_tmuxinator 122386.47912045794 ns/iter 108582.37515308616 ns/iter 1.13
E2E_Evaluator_ui5 662643.7936170852 ns/iter 533434.3596022091 ns/iter 1.24
E2E_Evaluator_ui5_manifest 4309057.565217299 ns/iter 1634472.0109405995 ns/iter 2.64
E2E_Evaluator_unreal_engine_uproject 639762.8289473606 ns/iter 427762.88914685824 ns/iter 1.50
E2E_Evaluator_vercel 478219.9314324584 ns/iter 319474.1018560612 ns/iter 1.50
E2E_Evaluator_yamllint 22642.00403900143 ns/iter 13233.113145976657 ns/iter 1.71
Micro_Draft4_Meta_1_No_Callback 338.3142689263431 ns/iter 237.5547888630174 ns/iter 1.42
Micro_Draft4_Required_Properties 1323.4382822419682 ns/iter 546.9812079998064 ns/iter 2.42
Micro_Draft4_Many_Optional_Properties_Minimal_Match 45.01215287346563 ns/iter 25.781727762687346 ns/iter 1.75
Micro_Draft4_Few_Optional_Properties_Minimal_Match 23.072181216336585 ns/iter 9.13971865611754 ns/iter 2.52
Micro_Draft4_Items_Schema 838.4939070441778 ns/iter 522.2013750538653 ns/iter 1.61
Micro_Draft4_Nested_Object 5.439957490957165 ns/iter 3.3418869086310465 ns/iter 1.63
Micro_Draft4_Properties_Triad_Optional 712.6012061470125 ns/iter 377.4894001274488 ns/iter 1.89
Micro_Draft4_Properties_Triad_Closed 497.5028010703491 ns/iter 293.77100507284524 ns/iter 1.69
Micro_Draft4_Properties_Triad_Required 620.4290355466354 ns/iter 349.68162396104964 ns/iter 1.77
Micro_Draft4_Properties_Closed 124.66100284170625 ns/iter 59.78170880899059 ns/iter 2.09
Micro_Draft4_Non_Recursive_Ref 44.58753294464807 ns/iter 25.55518549519981 ns/iter 1.74
Micro_Draft4_Pattern_Properties_True 266.6121982078606 ns/iter 181.89017258956326 ns/iter 1.47
Micro_Draft4_Ref_To_Single_Property 20.181455452054255 ns/iter 8.238935163341552 ns/iter 2.45
Micro_Draft4_Additional_Properties_Type 69.8468589253091 ns/iter 48.895833665857296 ns/iter 1.43
Micro_Draft4_Nested_Oneof 106.13180581059076 ns/iter 65.4181614775272 ns/iter 1.62
Micro_Draft4_Short_Enum 16.66749365988686 ns/iter 9.986835635300613 ns/iter 1.67
Micro_Draft4_Long_Enum 24.832478818184065 ns/iter 29.81839448304117 ns/iter 0.83
Micro_Draft4_Long_Enum_Short_Strings 17.162087048909815 ns/iter 11.441861675419412 ns/iter 1.50
Micro_Draft4_Type_Object 10.293642830721414 ns/iter 8.223952053791065 ns/iter 1.25
Micro_Draft4_Ref_Single_100 3422341.071428664 ns/iter 2612013.3848487306 ns/iter 1.31
Micro_Draft4_Compile_Ref_Many_Nested 2402836.514056069 ns/iter
Micro_Draft6_Property_Names 167.1980708827181 ns/iter 132.59359143685987 ns/iter 1.26
Micro_Draft7_If_Then_Else 51.03476723041256 ns/iter 34.54641053515365 ns/iter 1.48
Micro_2019_09_Unevaluated_Properties 68.4212338466053 ns/iter 43.83982932947567 ns/iter 1.56
Micro_2020_12_Dynamic_Ref 415.40304484419187 ns/iter 464.97988345147115 ns/iter 0.89
Micro_2020_12_Dynamic_Ref_Single 12.32902816351347 ns/iter 7.405867290638406 ns/iter 1.66
Micro_2020_12_Simple_Output_Mask 283594.6573511372 ns/iter 178057.1609430898 ns/iter 1.59
Micro_2020_12_Simple_Output_Annotations 308256.5078091716 ns/iter 194906.24764205792 ns/iter 1.58
Micro_2020_12_Compile_NonCircular_Shared_Refs 1772002.1593087283 ns/iter 9238788.427185161 ns/iter 0.19

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 9b97361 Previous: 234d368 Ratio
Micro_2020_12_Dynamic_Ref 453.8852971750968 ns/iter 619.3615617370721 ns/iter 0.73
Micro_2020_12_Dynamic_Ref_Single 9.19983406123048 ns/iter 11.248274190683574 ns/iter 0.82
Micro_2020_12_Simple_Output_Mask 137576.0463654115 ns/iter 137580.0614139129 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 170036.0313725357 ns/iter 170583.48244348282 ns/iter 1.00
Micro_2020_12_Compile_NonCircular_Shared_Refs 1235904.125663754 ns/iter 8673588.2195124 ns/iter 0.14
Micro_2019_09_Unevaluated_Properties 46.87147697024192 ns/iter 48.98330903484442 ns/iter 0.96
Micro_Draft7_If_Then_Else 44.7321511273921 ns/iter 46.946773555662936 ns/iter 0.95
Micro_Draft6_Property_Names 170.95194670109336 ns/iter 167.3575746599364 ns/iter 1.02
Micro_Draft4_Meta_1_No_Callback 228.3985880378886 ns/iter 256.6568774632705 ns/iter 0.89
Micro_Draft4_Required_Properties 841.7057186321954 ns/iter 550.8304637685752 ns/iter 1.53
Micro_Draft4_Many_Optional_Properties_Minimal_Match 29.54317316356813 ns/iter 31.162937253934786 ns/iter 0.95
Micro_Draft4_Few_Optional_Properties_Minimal_Match 18.58623142804658 ns/iter 13.51690242931094 ns/iter 1.38
Micro_Draft4_Items_Schema 529.0700288823894 ns/iter 540.0113911983201 ns/iter 0.98
Micro_Draft4_Nested_Object 3.3171807575316854 ns/iter 6.031318833083948 ns/iter 0.55
Micro_Draft4_Properties_Triad_Optional 494.25531538684135 ns/iter 471.9100958742053 ns/iter 1.05
Micro_Draft4_Properties_Triad_Closed 416.64474155505667 ns/iter 396.5335423949242 ns/iter 1.05
Micro_Draft4_Properties_Triad_Required 529.0829819999772 ns/iter 471.18238778200424 ns/iter 1.12
Micro_Draft4_Properties_Closed 83.11392376188404 ns/iter 78.37824563310397 ns/iter 1.06
Micro_Draft4_Non_Recursive_Ref 14.400024173676472 ns/iter 15.995686474129535 ns/iter 0.90
Micro_Draft4_Pattern_Properties_True 251.05815054397348 ns/iter 252.0861835657374 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 18.126330199292823 ns/iter 13.510613193889602 ns/iter 1.34
Micro_Draft4_Additional_Properties_Type 19.070024451392626 ns/iter 20.96686628037873 ns/iter 0.91
Micro_Draft4_Nested_Oneof 109.85480113903527 ns/iter 115.0747984095178 ns/iter 0.95
Micro_Draft4_Short_Enum 17.841537876128864 ns/iter 18.699217483563817 ns/iter 0.95
Micro_Draft4_Long_Enum 19.148848287600178 ns/iter 21.64884968601779 ns/iter 0.88
Micro_Draft4_Long_Enum_Short_Strings 17.76553321034988 ns/iter 18.822721250656993 ns/iter 0.94
Micro_Draft4_Type_Object 9.196015599110583 ns/iter 11.347076783641036 ns/iter 0.81
Micro_Draft4_Ref_Single_100 2578317.4154412337 ns/iter 2794553.2319999984 ns/iter 0.92
Micro_Draft4_Compile_Ref_Many_Nested 1865292.7984085446 ns/iter
E2E_Compiler_adaptivecard 71067178.77777809 ns/iter 957096619.0000263 ns/iter 0.0742528783060889
E2E_Compiler_ansible_meta 30716720.39130669 ns/iter 32203505.454545353 ns/iter 0.95
E2E_Compiler_aws_cdk 550330.511885923 ns/iter 565216.0608765451 ns/iter 0.97
E2E_Compiler_babelrc 2989774.516949264 ns/iter 3372636.3923441954 ns/iter 0.89
E2E_Compiler_clang_format 20216110.14285684 ns/iter 20651513.14705899 ns/iter 0.98
E2E_Compiler_cmake_presets 28420213.375000004 ns/iter 59769013.91666919 ns/iter 0.48
E2E_Compiler_code_climate 3008421.771551576 ns/iter 3030249.5086206803 ns/iter 0.99
E2E_Compiler_cql2 14348113.499998761 ns/iter 163245406.49998197 ns/iter 0.08789290803107741
E2E_Compiler_cspell 24613746.892855816 ns/iter 31816960.954544853 ns/iter 0.77
E2E_Compiler_cypress 4416460.301886561 ns/iter 5017940.913668956 ns/iter 0.88
E2E_Compiler_deno 9154977.092105366 ns/iter 9318378.680000024 ns/iter 0.98
E2E_Compiler_dependabot 4672165.5733328285 ns/iter 4763407.863013165 ns/iter 0.98
E2E_Compiler_draft_04 3070638.407079848 ns/iter 15940574.068180652 ns/iter 0.19
E2E_Compiler_fabric_mod 5463384.457364329 ns/iter 5718609.243902437 ns/iter 0.96
E2E_Compiler_geojson 27085121.730766997 ns/iter 28555507.959999885 ns/iter 0.95
E2E_Compiler_gitpod_configuration 5570034.825396645 ns/iter 5915272.94958047 ns/iter 0.94
E2E_Compiler_helm_chart_lock 911600.3368282947 ns/iter 927028.5740740593 ns/iter 0.98
E2E_Compiler_importmap 450334.32838709495 ns/iter 456376.13820078026 ns/iter 0.99
E2E_Compiler_jasmine 1622239.1805555958 ns/iter 1730410.210395837 ns/iter 0.94
E2E_Compiler_jshintrc 5291408.796992948 ns/iter 5374185.572518503 ns/iter 0.98
E2E_Compiler_jsconfig 24048435.931035783 ns/iter 24470204.275860004 ns/iter 0.98
E2E_Compiler_krakend 156978212.25001007 ns/iter 196563674.25000098 ns/iter 0.80
E2E_Compiler_lazygit 38333108.22222479 ns/iter 38813394.388891235 ns/iter 0.99
E2E_Compiler_lerna 2046113.0116279551 ns/iter 2084947.5969229247 ns/iter 0.98
E2E_Compiler_nest_cli 8442153.674698338 ns/iter 9542318.851351188 ns/iter 0.88
E2E_Compiler_omc 181177001.5000036 ns/iter 641628834.0000165 ns/iter 0.28
E2E_Compiler_omnisharp 7962083.784090882 ns/iter 8239123.141176124 ns/iter 0.97
E2E_Compiler_openapi 27897940.20000045 ns/iter 404231223.5000054 ns/iter 0.06901480780838315
E2E_Compiler_pre_commit_hooks 5856662.433333782 ns/iter 5919282.94915271 ns/iter 0.99
E2E_Compiler_pulumi 4580275.411764852 ns/iter 5131138.779411933 ns/iter 0.89
E2E_Compiler_semantic_release 1846668.9107612628 ns/iter 1909441.1593408159 ns/iter 0.97
E2E_Compiler_stale 1839373.8162730166 ns/iter 1963626.2359550742 ns/iter 0.94
E2E_Compiler_stylecop 7018873.019802359 ns/iter 7165792.255101891 ns/iter 0.98
E2E_Compiler_tmuxinator 2416568.065517164 ns/iter 2498020.44680872 ns/iter 0.97
E2E_Compiler_ui5 53679159.3846234 ns/iter 95697098.71428652 ns/iter 0.56
E2E_Compiler_ui5_manifest 348503338.0000004 ns/iter 1881095016.9998932 ns/iter 0.19
E2E_Compiler_unreal_engine_uproject 5199297.725926044 ns/iter 5538326.611111456 ns/iter 0.94
E2E_Compiler_vercel 15064659.956522062 ns/iter 15421164.95555648 ns/iter 0.98
E2E_Compiler_yamllint 499491.9971264332 ns/iter 496231.00070970383 ns/iter 1.01
E2E_Evaluator_adaptivecard 34929.12578490018 ns/iter 57271.26733568791 ns/iter 0.61
E2E_Evaluator_ansible_meta 306159.6545454263 ns/iter 303060.2883540738 ns/iter 1.01
E2E_Evaluator_aws_cdk 59816.413897017366 ns/iter 58115.78034300852 ns/iter 1.03
E2E_Evaluator_babelrc 139606.50128079095 ns/iter 138096.79097479506 ns/iter 1.01
E2E_Evaluator_clang_format 114730.10896164275 ns/iter 102780.19738988264 ns/iter 1.12
E2E_Evaluator_cmake_presets 6870970.518867957 ns/iter 5278534.9747895105 ns/iter 1.30
E2E_Evaluator_code_climate 237791.65627120627 ns/iter 228848.2050946776 ns/iter 1.04
E2E_Evaluator_cql2 311654.56472710025 ns/iter 270034.0295489538 ns/iter 1.15
E2E_Evaluator_cspell 647299.4028037315 ns/iter 576603.4299753886 ns/iter 1.12
E2E_Evaluator_cypress 187567.0544621233 ns/iter 172994.71170500742 ns/iter 1.08
E2E_Evaluator_deno 363922.90846563247 ns/iter 357494.5512690333 ns/iter 1.02
E2E_Evaluator_dependabot 515243.3722467205 ns/iter 480618.36232871626 ns/iter 1.07
E2E_Evaluator_draft_04 9866357.123286597 ns/iter 8650997.05063303 ns/iter 1.14
E2E_Evaluator_fabric_mod 959936.2942779405 ns/iter 948167.7540761925 ns/iter 1.01
E2E_Evaluator_geojson 26803176.00000028 ns/iter 26248076.24999903 ns/iter 1.02
E2E_Evaluator_gitpod_configuration 324974.6778087329 ns/iter 284380.4168361007 ns/iter 1.14
E2E_Evaluator_helm_chart_lock 362020.62762153393 ns/iter 368242.6645435264 ns/iter 0.98
E2E_Evaluator_importmap 61044.75769094483 ns/iter 60685.126455617465 ns/iter 1.01
E2E_Evaluator_jasmine 146181.9305002969 ns/iter 149290.20281209145 ns/iter 0.98
E2E_Evaluator_jshintrc 1054252.494752476 ns/iter 985570.1436388715 ns/iter 1.07
E2E_Evaluator_jsconfig 481577.498616902 ns/iter 467076.2046358077 ns/iter 1.03
E2E_Evaluator_krakend 240924.24966082175 ns/iter 227208.89182929887 ns/iter 1.06
E2E_Evaluator_lazygit 166063.18398053147 ns/iter 164271.52648774924 ns/iter 1.01
E2E_Evaluator_lerna 159074.10152396502 ns/iter 151085.42159327524 ns/iter 1.05
E2E_Evaluator_nest_cli 277501.0683060779 ns/iter 231804.54623231315 ns/iter 1.20
E2E_Evaluator_omc 27326.810609910608 ns/iter 29743.63098579657 ns/iter 0.92
E2E_Evaluator_omnisharp 609439.8567708166 ns/iter 556089.4058776397 ns/iter 1.10
E2E_Evaluator_openapi 16102947.395348713 ns/iter 12994276.148148216 ns/iter 1.24
E2E_Evaluator_pre_commit_hooks 568378.4841333758 ns/iter 534804.5718701219 ns/iter 1.06
E2E_Evaluator_pulumi 834681.8215567601 ns/iter 839047.4086956138 ns/iter 0.99
E2E_Evaluator_semantic_release 138791.8085106157 ns/iter 140115.7735924831 ns/iter 0.99
E2E_Evaluator_stale 176455.69897698076 ns/iter 171896.01233046976 ns/iter 1.03
E2E_Evaluator_stylecop 361046.15176289575 ns/iter 348175.15009941935 ns/iter 1.04
E2E_Evaluator_tmuxinator 129707.63349426906 ns/iter 127450.17722213558 ns/iter 1.02
E2E_Evaluator_ui5 681281.4005876085 ns/iter 688909.4518663897 ns/iter 0.99
E2E_Evaluator_ui5_manifest 3347311.536231795 ns/iter 2201753.946372491 ns/iter 1.52
E2E_Evaluator_unreal_engine_uproject 613804.1996450233 ns/iter 510381.0705271213 ns/iter 1.20
E2E_Evaluator_vercel 360712.4581005435 ns/iter 358019.7473417649 ns/iter 1.01
E2E_Evaluator_yamllint 13616.868551579648 ns/iter 14031.762328263465 ns/iter 0.97

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti force-pushed the template-targets branch 17 times, most recently from e830c7a to 6287be6 Compare January 19, 2026 20:51
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti marked this pull request as ready for review January 21, 2026 13:46
@jviotti jviotti changed the title [WIP] Target-based jump and compilation strategy Target-based jump and compilation strategy Jan 21, 2026
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link

augmentcode bot commented Jan 21, 2026

🤖 Augment PR Summary

Summary: This PR introduces a target-indexed compilation/execution model for JSON Schema references, enabling jump-based evaluation and centralized FastValidation postprocessing.

Changes:

  • Compiler now precomputes reference targets (keyed by reference type + destination + propertyNames-context) and emits `ControlJump` with target indices.
  • Removed `ControlLabel`/`ControlMark` label registration; dynamic anchor resolution now uses a `labels` → target-index table.
  • Added postprocess.h to inline small targets, drop empty container instructions, and apply FastValidation-specific rewrites (e.g., property-type loop rewrites).
  • Template JSON format changed from a single instruction list to targets + labels, and deserialization updated accordingly.
  • Evaluator entry points now execute targets[0] as the root program and resolve `$dynamicRef` via the compiled labels map.
  • Updated contrib tooling, benchmarks, and extensive evaluator trace tests to reflect the new execution strategy.

🤖 Was this summary useful? React with 👍 or 👎

Copy link

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 3 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

@jviotti jviotti merged commit 18ee1fc into main Jan 21, 2026
16 checks passed
@jviotti jviotti deleted the template-targets branch January 21, 2026 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants