YJIT Benchmarks

Details for Benchmarks at 2025-05-14 03:51:03 UTC

YJIT metrics from the yjit-bench suite using Ruby 86f5cec782.

Using the geomean of the headline benchmarks for x86 YJIT 3.5.0dev is
  • 89.0% faster than CRuby 3.5.0dev
  • 5.9% faster than YJIT 3.3.6
On railsbench it is
  • 98.2% faster than CRuby 3.5.0dev
  • 5.0% faster than YJIT 3.3.6
x86_64 runtime: 4 hours, 25 minutes
aarch64 runtime: 3 hours, 44 minutes

Performance on Headline Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Headline Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on Other Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Other Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on MicroBenchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on MicroBenchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench CRuby 3.3.6 warmups CRuby 3.3.6 iters CRuby 3.5.0dev warmups CRuby 3.5.0dev iters YJIT 3.3.6 warmups YJIT 3.3.6 iters YJIT 3.5.0dev warmups YJIT 3.5.0dev iters
activerecord 5 82 5 82 50 158 50 163
chunky-png 5 31 5 32 50 15 50 22
erubi-rails 5 16 5 15 50 10 50 10
hexapdf 5 10 5 10 50 10 50 10
liquid-c 5 420 5 422 50 562 50 626
liquid-compile 5 408 5 464 50 540 50 680
liquid-render 5 172 5 165 50 407 50 442
lobsters 5 19 5 19 50 10 50 10
mail 5 189 5 177 50 237 50 214
psych-load 5 10 5 10 50 10 50 10
railsbench 5 10 5 10 50 10 50 10
rubocop 5 157 5 155 50 253 50 259
ruby-lsp 5 145 5 159 50 243 50 265
sequel 5 435 5 427 50 574 50 580
binarytrees 5 84 5 84 50 149 50 137
blurhash 5 82 5 87 50 127 50 145
erubi 5 124 5 144 50 90 50 142
etanni 5 90 5 99 50 55 50 67
fannkuchredux 5 52 5 58 50 99 50 108
fluentd 5 64 5 65 50 25 50 33
graphql 5 85 5 85 50 57 50 57
graphql-native 5 48 5 54 50 10 50 17
lee 5 23 5 24 50 10 50 10
matmul 5 51 5 51 50 85 50 97
nbody 5 247 5 249 50 575 50 704
nqueens 5 120 5 127 50 75 50 553
optcarrot 5 10 5 10 50 10 50 10
protoboeuf 5 175 5 191 50 620 50 745
protoboeuf-encode 5 180 5 208 50 327 50 778
rack 5 577 5 632 50 949 50 1067
ruby-json 5 84 5 84 50 50 50 49
rubyboy 5 10 5 10 50 10 50 10
rubykon 5 20 5 21 50 10 50 10
sudoku 5 48 5 51 50 162 50 168
tinygql 5 36 5 38 50 22 50 33
30k_ifelse 5 28 5 28 50 216 50 186
30k_methods 5 38 5 38 50 482 50 474
cfunc_itself 5 346 5 348 50 1147 50 1258
fib 5 127 5 134 50 910 50 933
getivar 5 207 5 293 50 2241 50 2390
keyword_args 5 107 5 107 50 1042 50 1243
loops-times 5 24 5 27 50 48 50 62
object-new 5 322 5 349 50 404 50 535
respond_to 5 134 5 123 50 3257 50 3908
ruby-xor 5 240 5 257 50 801 50 1314
setivar 5 358 5 601 50 3192 50 5093
setivar_object 5 355 5 474 50 665 50 798
setivar_young 5 365 5 474 50 685 50 818
str_concat 5 401 5 458 50 963 50 1159
throw 5 1260 5 1243 50 1728 50 1629

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT warms up fairly quickly, while some JITs may start slower as they do more advanced compilation.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps Compile Time MS
activerecord (click) 1522771 1292639 206 2590 0 0% 0 0 70.141057
chunky-png (click) 311107 289384 74 1322 1 0% 0 0 35.77028
erubi-rails (click) 1949533 1694286 263 3588 21 0% 0 0 91.588418
hexapdf (click) 1515306 1332550 593 15619 40 0% 0 0 422.751596
liquid-c (click) 506823 456429 114 2217 5 0% 0 0 57.676858
liquid-compile (click) 430615 407750 146 2710 2 0% 0 0 76.025076
liquid-render (click) 611317 568559 131 2933 8 0% 0 0 76.301793
lobsters (click) 8534463 7210934 3172 63837 119 0% 0 0 2026.270592
mail (click) 819457 801957 342 7227 40 0% 0 0 191.562901
psych-load (click) 293328 218792 61 825 3 0% 0 0 23.375224
railsbench (click) 3406055 3057905 1653 20259 56 0% 0 0 542.674205
rubocop (click) 5894544 5105009 2885 61739 113 0% 4 0 1680.142456
ruby-lsp (click) 892056 828298 305 5956 29 0% 0 0 152.463404
sequel (click) 481562 422999 11 114 0 0% 0 0 3.793774
binarytrees (click) 7273 6911 6 64 0 0% 0 0 2.41616
blurhash (click) 52289 51444 27 603 0 0% 0 0 17.007352
erubi (click) 245661 205922 5 125 0 0% 0 0 3.658462
etanni (click) 30806 32125 8 108 0 0% 0 0 3.308127
fannkuchredux (click) 24746 40953 3 399 0 0% 0 0 10.333799
fluentd (click) 420928 352984 7 115 0 0% 0 0 3.680787
graphql (click) 458985 389036 66 1035 0 0% 0 0 26.831549
graphql-native (click) 413332 379893 37 399 0 0% 0 0 10.38421
lee (click) 320240 270175 45 1012 0 0% 0 0 28.143029
matmul (click) 11125 4603 8 132 0 0% 0 0 4.014504
nbody (click) 13890 20235 6 238 0 0% 0 0 5.441698
nqueens (click) 22652 36960 5 387 0 0% 0 0 9.656315
optcarrot (click) 325946 290644 188 4740 34 0% 0 0 106.724709
protoboeuf (click) 170142 177773 12 2836 0 0% 0 0 70.270517
protoboeuf-encode (click) 243031 283791 14 1815 0 0% 0 0 42.722228
rack (click) 251665 191243 31 496 0 0% 0 0 12.243501
ruby-json (click) 24634 22156 8 204 0 0% 0 0 5.413066
rubyboy (click) 702072 642160 177 6963 40 0% 0 0 165.250329
rubykon (click) 146417 162602 137 2076 3 0% 0 0 53.909606
sudoku (click) 52157 66291 7 871 0 0% 0 0 22.41987
tinygql (click) 291990 262805 58 971 5 0% 0 0 25.136271
30k_ifelse (click) 6219958 5057296 9259 75432 0 0% 0 0 1864.992381
30k_methods (click) 2234566 1592952 5778 19357 0 0% 0 0 459.927743
cfunc_itself (click) 5127 4155 4 53 0 0% 0 0 1.39789
fib (click) 2659 2995 3 30 0 0% 0 0 0.997073
getivar (click) 3812 6802 3 78 0 0% 0 0 1.77711
keyword_args (click) 6332 4965 5 56 0 0% 0 0 1.666245
loops-times (click) 6972 8013 5 93 0 0% 0 0 2.60689
object-new (click) 2406 2818 2 36 0 0% 0 0 1.073416
respond_to (click) 6451 6819 4 80 0 0% 0 0 1.940001
ruby-xor (click) 5876 8690 4 100 0 0% 0 0 2.585505
setivar (click) 2783 3726 3 46 0 0% 0 0 1.20586
setivar_object (click) 3402 3956 3 49 0 0% 0 0 1.335985
setivar_young (click) 4297 4867 4 63 0 0% 0 0 1.5699
str_concat (click) 5799 6969 6 82 0 0% 0 0 2.323806
throw (click) 5953 4624 5 53 0 0% 0 0 1.71478

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.