YJIT Benchmarks

Details for Benchmarks at 2022-09-04 20:12:02

Overall YJIT is 35.1% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 28.2% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters MJIT warmups MJIT iters YJIT warmups YJIT iters
activerecord 5 194 75 194 20 194
hexapdf 5 15 20 15
liquid-render 5 155 75 155 20 155
mail 5 127 75 127 20 127
psych-load 5 15 75 15 20 15
railsbench 5 15 75 15 20 15
binarytrees 5 64 75 64 20 64
chunky_png 5 30 75 30 20 30
erubi 5 63 75 63 20 63
erubi_rails 5 1040 75 1040 20 1040
fannkuchredux 5 15 75 15 20 15
lee 5 21 75 21 20 21
nbody 5 262 75 262 20 262
optcarrot 5 15 75 15 20 15
rubykon 5 15 38 15 20 15
30k_ifelse 5 54 68 54 20 54
30k_methods 5 24 22 24 20 24
cfunc_itself 5 444 75 444 20 444
fib 5 308 75 308 20 308
getivar 5 612 75 612 20 612
keyword_args 5 377 75 377 20 377
respond_to 5 102 75 102 20 102
setivar 5 967 75 967 20 967
str_concat 5 483 75 483 20 483

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 1074359 779326 131 1258 0 0% 0 0 0
hexapdf (click) 1192055 922231 682 8013 10 0% 0 0 0
liquid-render (click) 536567 403124 150 1678 2 0% 0 0 0
mail (click) 955703 664854 375 5551 17 0% 0 0 0
psych-load (click) 359415 262455 68 482 1 0% 0 0 0
railsbench (click) 2761335 1968400 1436 10050 16 0% 0 0 0
binarytrees (click) 177143 127751 13 58 0 0% 0 0 0
chunky_png (click) 403895 291262 88 1027 0 0% 0 0 0
erubi (click) 344439 252507 10 79 0 0% 0 0 0
erubi_rails (click) 2046135 1432859 300 2024 4 0% 0 0 0
fannkuchredux (click) 191287 137519 10 196 0 0% 0 0 0
lee (click) 399863 290563 58 634 0 0% 0 0 0
nbody (click) 186935 135468 12 171 0 0% 0 0 0
optcarrot (click) 536119 442347 207 3588 20 0% 0 0 0
rubykon (click) 332279 256393 144 1574 1 0% 0 0 0
30k_ifelse (click) 5705271 4348219 9265 57804 0 0% 0 0 0
30k_methods (click) 2209847 1656681 5784 19361 0 0% 0 0 0
cfunc_itself (click) 175735 126524 10 49 0 0% 0 0 0
fib (click) 174071 126082 10 38 0 0% 0 0 0
getivar (click) 175863 128169 10 65 0 0% 0 0 0
keyword_args (click) 176439 127165 11 51 0 0% 0 0 0
respond_to (click) 177975 127910 10 64 0 0% 0 0 0
setivar (click) 175799 127039 10 38 0 0% 0 0 0
str_concat (click) 175735 127371 12 62 0 0% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.