YJIT Benchmarks

Details for Benchmarks at 2022-09-07 20:12:19

Overall YJIT is 35.7% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 33.9% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters MJIT warmups MJIT iters YJIT warmups YJIT iters
activerecord 5 195 75 195 20 195
hexapdf 5 15 20 15
liquid-render 5 160 75 160 20 160
mail 5 127 75 127 20 127
psych-load 5 15 75 15 20 15
railsbench 5 15 75 15 20 15
binarytrees 5 65 75 65 20 65
chunky_png 5 30 75 30 20 30
erubi 5 60 75 60 20 60
erubi_rails 5 1037 75 1037 20 1037
fannkuchredux 5 15 56 15 20 15
lee 5 21 75 21 20 21
nbody 5 263 75 263 20 263
optcarrot 5 15 75 15 20 15
rubykon 5 15 32 15 20 15
30k_ifelse 5 53 68 53 20 53
30k_methods 5 25 23 25 20 25
cfunc_itself 5 448 75 448 20 448
fib 5 309 75 309 20 309
getivar 5 465 75 465 20 465
keyword_args 5 384 75 384 20 384
respond_to 5 102 75 102 20 102
setivar 5 379 75 379 20 379
str_concat 5 421 75 421 20 421

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 1075575 780247 131 1269 0 0% 0 0 0
hexapdf (click) 1195319 924642 682 8026 9 0% 0 0 0
liquid-render (click) 535223 402251 150 1674 2 0% 0 0 0
mail (click) 938743 653358 374 5379 17 0% 0 0 0
psych-load (click) 360375 263223 68 482 1 0% 0 0 0
railsbench (click) 2760311 1968808 1436 10015 16 0% 0 0 0
binarytrees (click) 177271 127864 13 58 0 0% 0 0 0
chunky_png (click) 406391 292901 88 1036 0 0% 0 0 0
erubi (click) 344759 252885 10 79 0 0% 0 0 0
erubi_rails (click) 2045943 1432396 300 2030 4 0% 0 0 0
fannkuchredux (click) 190007 136816 10 196 0 0% 0 0 0
lee (click) 400247 290941 58 634 0 0% 0 0 0
nbody (click) 188471 136946 12 171 0 0% 0 0 0
optcarrot (click) 534839 441644 207 3588 20 0% 0 0 0
rubykon (click) 333495 257623 144 1586 1 0% 0 0 0
30k_ifelse (click) 5705271 4348219 9265 57804 0 0% 0 0 0
30k_methods (click) 2208887 1656306 5784 19361 0 0% 0 0 0
cfunc_itself (click) 174775 126199 10 49 0 0% 0 0 0
fib (click) 174071 126132 10 38 0 0% 0 0 0
getivar (click) 174903 127894 10 65 0 0% 0 0 0
keyword_args (click) 175479 126840 11 51 0 0% 0 0 0
respond_to (click) 178039 127978 10 64 0 0% 0 0 0
setivar (click) 174839 126714 10 38 0 0% 0 0 0
str_concat (click) 175735 127321 12 62 0 0% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.