YJIT Benchmarks

Details for Benchmarks at 2023-01-24 06:08:05

Overall YJIT is 37.4% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 40.3% faster than CRuby!
The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters YJIT warmups YJIT iters
activerecord 30 178 30 178
hexapdf 30 15 30 15
liquid-c 30 323 30 323
liquid-render 30 181 30 181
mail 30 141 30 141
psych-load 30 15 30 15
railsbench 30 15 30 15
ruby-lsp 30 283 30 283
sequel 30 133 30 133
binarytrees 30 85 30 85
chunky_png 30 32 30 32
erubi 30 79 30 79
erubi_rails 30 1137 30 1137
etanni 30 48 30 48
fannkuchredux 30 22 30 22
lee 30 21 30 21
nbody 30 278 30 278
optcarrot 30 15 30 15
rubykon 30 15 30 15
30k_ifelse 30 50 30 50
30k_methods 30 21 30 21
cfunc_itself 30 497 30 497
fib 30 325 30 325
getivar 30 436 30 436
keyword_args 30 382 30 382
respond_to 30 706 30 706
setivar 30 1359 30 1359
setivar_object 30 421 30 421
str_concat 30 451 30 451

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 2289695 2287822 33 485 8 1% 0 0 0
hexapdf (click) 1716869 1714878 819 10415 217 2% 0 0 0
liquid-c (click) 1155479 1155010 126 1507 34 2% 0 0 0
liquid-render (click) 1149622 1148256 148 1807 36 1% 0 0 0
mail (click) 1245694 1245172 373 4646 176 3% 0 0 0
psych-load (click) 783236 781418 70 651 19 2% 0 0 0
railsbench (click) 5548113 5546298 1779 14467 483 3% 0 0 0
ruby-lsp (click) 5395733 5395142 6428 41828 1536 3% 15654 0 0
sequel (click) 1455006 1453034 17 428 5 1% 0 0 0
binarytrees (click) 96452 94102 16 140 3 2% 0 0 0
chunky_png (click) 807408 805604 89 1226 31 2% 0 0 0
erubi (click) 741285 739852 13 149 4 2% 0 0 0
erubi_rails (click) 4667752 4667060 329 2831 111 3% 0 0 0
etanni (click) 144147 142294 13 108 3 2% 0 0 0
fannkuchredux (click) 104435 101936 14 241 3 1% 0 0 0
lee (click) 806926 805408 79 820 24 2% 0 0 0
nbody (click) 109125 108094 15 245 5 2% 0 0 0
optcarrot (click) 520808 518938 203 4449 92 2% 0 0 0
rubykon (click) 235940 233548 147 1645 30 1% 0 0 0
30k_ifelse (click) 5245189 5242908 9268 57200 3 0% 0 0 0
30k_methods (click) 1993463 1991910 5787 19427 3 0% 0 0 0
cfunc_itself (click) 93744 92254 13 123 3 2% 0 0 0
fib (click) 92325 91458 13 112 3 2% 0 0 0
getivar (click) 94088 92590 13 139 3 2% 0 0 0
keyword_args (click) 94528 92982 14 125 3 2% 0 0 0
respond_to (click) 94250 92738 13 139 4 2% 0 0 0
setivar (click) 93125 91870 13 119 3 2% 0 0 0
setivar_object (click) 93457 92018 13 119 3 2% 0 0 0
str_concat (click) 93983 92570 15 138 5 3% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.