YJIT Benchmarks

Details for Benchmarks at 2022-04-06 19:13:13

Overall YJIT is 31.9% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 31.1% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters MJIT warmups MJIT iters YJIT warmups YJIT iters
activerecord 5 182 75 182 20 182
hexapdf 5 15 20 15
liquid-render 5 155 75 155 20 155
mail 5 124 75 124 20 124
psych-load 5 15 75 15 20 15
railsbench 5 15 75 15 20 15
binarytrees 5 62 75 62 20 62
chunky_png 5 30 75 30 20 30
discourse 5 40 75 40 20 40
erubi 5 47 75 47 20 47
erubi_rails 5 978 75 978 20 978
fannkuchredux 5 15 75 15 20 15
lee 5 21 75 21 20 21
nbody 5 274 75 274 20 274
optcarrot 5 15 75 15 20 15
rubykon 5 15 27 15 20 15
30k_ifelse 5 55 75 55 20 55
30k_methods 5 22 29 22 20 22
cfunc_itself 5 448 75 448 20 448
fib 5 320 75 320 20 320
getivar 5 775 75 775 20 775
keyword_args 5 360 75 360 20 360
respond_to 5 104 75 104 20 104
setivar 5 1899 75 1899 20 1899

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 992529 813927 185 1185 0 0% 0 0 0
hexapdf (click) 1098833 922374 599 7894 428 5% 0 0 321
liquid-render (click) 499729 421966 143 1501 92 6% 0 0 5
mail (click) 845841 656574 324 4977 96 1% 0 0 111
psych-load (click) 341329 286443 59 434 1 0% 0 0 0
railsbench (click) 2599953 2104946 1297 9396 224 2% 0 0 26
binarytrees (click) 168913 138452 11 58 0 0% 0 0 0
chunky_png (click) 375505 308946 85 865 0 0% 0 0 0
discourse (click) 6190865 5563563 3088 26406 3101 11% 2 0 140
erubi (click) 329169 276912 10 79 0 0% 0 0 0
erubi_rails (click) 1958033 1597835 262 1893 12 0% 0 0 3
fannkuchredux (click) 181969 148399 8 189 0 0% 0 0 0
lee (click) 378577 315339 45 582 68 11% 0 0 13
nbody (click) 177681 145324 10 158 0 0% 0 0 0
optcarrot (click) 504721 450532 198 3576 20 0% 0 0 0
rubykon (click) 308689 257396 140 1526 1 0% 0 0 0
30k_ifelse (click) 5557457 4358098 9263 57807 0 0% 0 0 0
30k_methods (click) 2173713 1667190 5782 19362 0 0% 0 0 0
cfunc_itself (click) 166673 136330 8 50 0 0% 0 0 0
fib (click) 165265 135938 8 39 0 0% 0 0 0
getivar (click) 168465 139574 8 65 0 0% 0 0 0
keyword_args (click) 169041 138096 9 51 0 0% 0 0 0
respond_to (click) 169041 138206 8 64 0 0% 0 0 0
setivar (click) 167185 137395 8 38 0 0% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.