YJIT Benchmarks

Details for Benchmarks at 2022-12-12 20:09:59 UTC

YJIT metrics from the yjit-bench suite using Ruby 3de7ff8eb9.

Overall YJIT is 41.4% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 37.0% faster than CRuby!

Performance on Headline Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Headline Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on Other Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Other Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on MicroBenchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on MicroBenchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters YJIT warmups YJIT iters
activerecord 5 200 5 200
hexapdf 5 15 5 15
liquid-render 5 154 5 154
mail 5 140 5 140
psych-load 5 15 5 15
railsbench 5 15 5 15
ruby-lsp 5 245 5 245
binarytrees 5 87 5 87
chunky_png 5 32 5 32
erubi 5 68 5 68
erubi_rails 5 1128 5 1128
etanni 5 42 5 42
fannkuchredux 5 21 5 21
lee 5 22 5 22
nbody 5 278 5 278
optcarrot 5 15 5 15
rubykon 5 15 5 15
30k_ifelse 5 50 5 50
30k_methods 5 20 5 20
cfunc_itself 5 481 5 481
fib 5 324 5 324
getivar 5 438 5 438
keyword_args 5 383 5 383
respond_to 5 673 5 673
setivar 5 1359 5 1359
setivar_object 5 436 5 436
str_concat 5 500 5 500

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 2276381 2276190 25 374 5 1% 0 0 0
hexapdf (click) 1722389 1721328 819 10428 217 2% 0 0 0
liquid-render (click) 561612 560005 156 1852 32 1% 0 0 0
mail (click) 1247880 1246826 373 4683 176 3% 0 0 0
psych-load (click) 779396 778996 70 651 19 2% 0 0 0
railsbench (click) 5524354 5522600 1779 14282 482 3% 0 0 0
ruby-lsp (click) 5400782 5399176 6428 41787 1537 3% 13554 0 0
binarytrees (click) 96267 94377 16 140 3 2% 0 0 0
chunky_png (click) 797000 796142 89 1185 31 2% 0 0 0
erubi (click) 739411 738614 13 149 4 2% 0 0 0
erubi_rails (click) 4665034 4663163 329 2824 111 3% 0 0 0
etanni (click) 144321 142697 13 108 3 2% 0 0 0
fannkuchredux (click) 108481 107857 14 273 3 1% 0 0 0
lee (click) 794312 794203 79 813 24 2% 0 0 0
nbody (click) 109148 108249 15 245 5 2% 0 0 0
optcarrot (click) 528108 526866 203 4439 92 2% 0 0 0
rubykon (click) 235243 233446 146 1631 30 1% 0 0 0
30k_ifelse (click) 5245212 5243303 9268 57200 3 0% 0 0 0
30k_methods (click) 1993486 1992185 5787 19427 3 0% 0 0 0
cfunc_itself (click) 90316 90207 13 91 3 3% 0 0 0
fib (click) 92325 91583 13 112 3 2% 0 0 0
getivar (click) 94099 92845 13 139 3 2% 0 0 0
keyword_args (click) 94538 93277 14 125 3 2% 0 0 0
respond_to (click) 94263 93008 13 139 4 2% 0 0 0
setivar (click) 93138 92045 13 119 3 2% 0 0 0
setivar_object (click) 93480 92213 13 119 3 2% 0 0 0
str_concat (click) 86795 85302 15 138 5 3% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.