YJIT Benchmarks

Details for Benchmarks at 2021-11-30 19:10:50

Overall YJIT is 28.2% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 19.8% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters MJIT3.0 warmups MJIT3.0 iters MJIT warmups MJIT iters YJIT warmups YJIT iters
activerecord 5 186 20 186 75 186 20 186
hexapdf 5 15 20 15 20 15
liquid-render 5 172 20 172 75 172 20 172
mail 5 140 20 140 75 140 20 140
psych-load 5 15 20 15 75 15 20 15
railsbench 5 15 20 15 75 15 20 15
binarytrees 5 88 20 88 75 88 20 88
erubi 5 51 20 51 75 51 20 51
erubi_rails 5 558 20 558 75 558 20 558
fannkuchredux 5 15 20 15 54 15 20 15
jekyll 5 15 20 15 36 15 20 15
lee 5 26 20 26 75 26 20 26
nbody 5 342 20 342 75 342 20 342
optcarrot 5 15 20 15 75 15 20 15
rubykon 5 15 20 15 42 15 20 15
30k_ifelse 5 62 20 62 74 62 20 62
30k_methods 5 26 20 26 44 26 20 26
cfunc_itself 5 492 20 492 75 492 20 492
fib 5 383 20 383 75 383 20 383
getivar 5 563 20 563 75 563 20 563
keyword_args 5 429 20 429 75 429 20 429
respond_to 5 126 20 126 75 126 20 126
setivar 5 511 20 511 75 511 20 511

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 972010 730551 185 1194 0 0% 0 0 0
hexapdf (click) 1076074 857247 595 7993 616 7% 0 0 321
liquid-render (click) 472119 366383 143 1459 96 6% 0 0 1
mail (click) 848810 625981 325 5206 124 2% 0 0 39
psych-load (click) 291361 226160 57 423 1 0% 0 0 0
railsbench (click) 2577058 1922778 1293 9740 263 2% 0 0 26
binarytrees (click) 112293 85408 9 48 0 0% 0 0 0
erubi (click) 269537 209076 8 35 0 0% 0 0 0
erubi_rails (click) 2437090 1742413 260 1995 17 0% 0 0 3
fannkuchredux (click) 128869 97767 6 202 0 0% 0 0 0
jekyll (click) 1884906 1497990 336 3925 179 4% 0 0 0
lee (click) 330218 256770 44 562 67 11% 0 0 12
nbody (click) 121701 92379 8 148 0 0% 0 0 0
optcarrot (click) 451109 392134 196 3566 20 0% 0 0 0
rubykon (click) 254181 204277 138 1526 1 0% 0 0 0
30k_ifelse (click) 5502053 4306081 9261 57794 0 0% 0 0 0
30k_methods (click) 2116581 1614194 5780 19351 0 0% 0 0 0
cfunc_itself (click) 111461 84386 6 39 0 0% 0 0 0
fib (click) 109349 83645 6 28 0 0% 0 0 0
getivar (click) 111653 86505 6 55 0 0% 0 0 0
keyword_args (click) 111717 84678 7 41 0 0% 0 0 0
respond_to (click) 113317 85819 6 54 0 0% 0 0 0
setivar (click) 111013 84680 6 28 0 0% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.