YJIT Benchmarks

Details for Benchmarks at 2022-10-25 20:11:06

Overall YJIT is 33.6% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 31.4% faster than CRuby!
The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters YJIT warmups YJIT iters
activerecord 5 202 5 202
hexapdf 5 15 5 15
liquid-render 5 174 5 174
mail 5 129 5 129
psych-load 5 15 5 15
railsbench 5 15 5 15
ruby-lsp 15 15 15 15
binarytrees 5 78 5 78
chunky_png 5 32 5 32
erubi 5 69 5 69
erubi_rails 5 1072 5 1072
etanni 5 42 5 42
fannkuchredux 5 15 5 15
lee 5 20 5 20
nbody 5 249 5 249
optcarrot 5 15 5 15
rubykon 5 15 5 15
30k_ifelse 5 50 5 50
30k_methods 5 20 5 20
cfunc_itself 5 476 5 476
fib 5 326 5 326
getivar 5 426 5 426
keyword_args 5 385 5 385
respond_to 5 716 5 716
setivar 5 425 5 425
str_concat 5 464 5 464

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 2284029 2283987 23 292 6 2% 0 0 0
hexapdf (click) 1745073 1744575 818 9948 189 1% 0 0 0
liquid-render (click) 549870 549366 154 1765 34 1% 0 0 0
mail (click) 1340666 1338621 371 5117 176 3% 0 0 0
psych-load (click) 802867 802557 68 568 19 3% 0 0 0
railsbench (click) 5454341 5453364 1777 13357 483 3% 0 0 0
ruby-lsp (click) 5556242 5554284 6423 41272 1520 3% 1504 0 0
binarytrees (click) 128174 126296 14 79 4 5% 0 0 0
chunky_png (click) 812226 811808 87 1056 31 2% 0 0 0
erubi (click) 746913 746320 11 87 4 4% 0 0 0
erubi_rails (click) 4566654 4564266 327 2614 111 4% 0 0 0
etanni (click) 128985 126212 11 47 4 8% 0 0 0
fannkuchredux (click) 140830 140262 11 209 4 1% 0 0 0
lee (click) 828072 827525 77 755 25 3% 0 0 0
nbody (click) 142897 141521 13 188 6 3% 0 0 0
optcarrot (click) 563712 561805 201 4014 93 2% 0 0 0
rubykon (click) 279156 278653 143 1589 32 2% 0 0 0
30k_ifelse (click) 5419702 5419436 9266 57136 4 0% 0 0 0
30k_methods (click) 2080996 2080437 5785 19365 4 0% 0 0 0
cfunc_itself (click) 126083 124827 11 62 4 6% 0 0 0
fib (click) 124624 124081 11 51 4 7% 0 0 0
getivar (click) 119394 118009 11 78 4 5% 0 0 0
keyword_args (click) 126880 125317 12 64 4 6% 0 0 0
respond_to (click) 126611 125194 11 78 5 6% 0 0 0
setivar (click) 126876 125420 11 51 4 7% 0 0 0
str_concat (click) 126326 124993 13 77 6 7% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.