YJIT Benchmarks

Details for Benchmarks at 2022-10-29 04:19:08

Overall YJIT is 35.5% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 36.0% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters YJIT warmups YJIT iters
activerecord 5 203 5 203
hexapdf 5 15 5 15
liquid-render 5 172 5 172
mail 5 120 5 120
psych-load 5 15 5 15
railsbench 5 15 5 15
ruby-lsp 5 246 5 246
binarytrees 5 87 5 87
chunky_png 5 32 5 32
erubi 5 65 5 65
erubi_rails 5 1082 5 1082
etanni 5 41 5 41
fannkuchredux 5 15 5 15
lee 5 20 5 20
nbody 5 245 5 245
optcarrot 5 15 5 15
rubykon 5 15 5 15
30k_ifelse 5 50 5 50
30k_methods 5 20 5 20
cfunc_itself 5 494 5 494
fib 5 327 5 327
getivar 5 427 5 427
keyword_args 5 386 5 386
respond_to 5 691 5 691
setivar 5 413 5 413
str_concat 5 459 5 459

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 2315579 2313290 23 361 6 1% 0 0 0
hexapdf (click) 1774866 1773396 817 10046 189 1% 0 0 0
liquid-render (click) 591306 590683 154 1770 34 1% 0 0 0
mail (click) 1345139 1344300 371 5122 176 3% 0 0 0
psych-load (click) 795476 794999 68 573 19 3% 0 0 0
railsbench (click) 5538359 5537032 1777 13687 483 3% 0 0 0
ruby-lsp (click) 5602185 5601246 6423 41515 1519 3% 12554 0 0
binarytrees (click) 121356 119042 14 79 4 5% 0 0 0
chunky_png (click) 822053 820815 87 1063 31 2% 0 0 0
erubi (click) 749969 748549 11 87 4 4% 0 0 0
erubi_rails (click) 4621640 4620268 327 2620 111 4% 0 0 0
etanni (click) 129355 126501 11 47 4 8% 0 0 0
fannkuchredux (click) 140491 139998 11 209 4 1% 0 0 0
lee (click) 828146 827718 77 758 25 3% 0 0 0
nbody (click) 135678 134253 13 188 6 3% 0 0 0
optcarrot (click) 562979 561263 201 4014 93 2% 0 0 0
rubykon (click) 279122 278653 143 1588 32 2% 0 0 0
30k_ifelse (click) 5420144 5419577 9266 57136 4 0% 0 0 0
30k_methods (click) 2088352 2087875 5785 19365 4 0% 0 0 0
cfunc_itself (click) 126387 125081 11 62 4 6% 0 0 0
fib (click) 124929 124149 11 51 4 7% 0 0 0
getivar (click) 127011 125607 11 78 4 5% 0 0 0
keyword_args (click) 127178 125485 12 64 4 6% 0 0 0
respond_to (click) 126914 125448 11 78 5 6% 0 0 0
setivar (click) 120073 117975 11 51 4 7% 0 0 0
str_concat (click) 126635 125338 13 77 6 7% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.