YJIT Benchmarks

Details for Benchmarks at 2022-09-14 05:39:45

Overall YJIT is 33.9% faster than interpreted CRuby!
On Railsbench specifically, YJIT is 34.2% faster than CRuby!

The basic "faster" measurement is the geomean of all "headlining" x86 benchmarks on this page.

Headlining Benchmarks

These are "headlining" because the "overall" speedup above is based on these benchmarks specifically.

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Other Benchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

MicroBenchmarks

Speed of each Ruby implementation (iterations/second) relative to the CRuby interpreter. Higher is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench No JIT warmups No JIT iters MJIT warmups MJIT iters YJIT warmups YJIT iters
activerecord 5 195 75 195 20 195
hexapdf 5 15 20 15
liquid-render 5 163 75 163 20 163
mail 5 127 75 127 20 127
psych-load 5 15 75 15 20 15
railsbench 5 15 75 15 20 15
binarytrees 5 66 75 66 20 66
chunky_png 5 30 75 30 20 30
erubi 5 69 75 69 20 69
erubi_rails 5 1052 75 1052 20 1052
fannkuchredux 5 15 57 15 20 15
lee 5 21 75 21 20 21
nbody 5 266 75 266 20 266
optcarrot 5 15 75 15 20 15
rubykon 5 15 33 15 20 15
30k_ifelse 5 55 72 55 20 55
30k_methods 5 25 23 25 20 25
cfunc_itself 5 441 75 441 20 441
fib 5 318 75 318 20 318
getivar 5 720 75 720 20 720
keyword_args 5 381 75 381 20 381
respond_to 5 105 75 105 20 105
setivar 5 436 75 436 20 436
str_concat 5 432 75 432 20 432

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps
activerecord (click) 1073783 778885 131 1284 0 0% 0 0 0
hexapdf (click) 1184823 919635 682 8024 10 0% 0 0 0
liquid-render (click) 534647 401687 150 1709 2 0% 0 0 0
mail (click) 958967 665971 374 5604 17 0% 0 0 0
psych-load (click) 358455 262048 68 482 1 0% 0 0 0
railsbench (click) 2754999 1966417 1436 10030 16 0% 0 0 0
binarytrees (click) 176759 127226 13 58 0 0% 0 0 0
chunky_png (click) 399159 287991 88 1003 0 0% 0 0 0
erubi (click) 343159 251257 10 79 0 0% 0 0 0
erubi_rails (click) 2039735 1428588 300 2030 4 0% 0 0 0
fannkuchredux (click) 190839 137094 10 196 0 0% 0 0 0
lee (click) 397175 288467 58 634 0 0% 0 0 0
nbody (click) 187191 136147 12 171 0 0% 0 0 0
optcarrot (click) 531575 441019 207 3591 20 0% 0 0 0
rubykon (click) 330103 255375 144 1573 2 0% 0 0 0
30k_ifelse (click) 5663927 4347091 9265 57804 0 0% 0 0 0
30k_methods (click) 2208695 1655882 5784 19361 0 0% 0 0 0
cfunc_itself (click) 174583 125725 10 49 0 0% 0 0 0
fib (click) 172407 125004 10 38 0 0% 0 0 0
getivar (click) 174199 127091 10 65 0 0% 0 0 0
keyword_args (click) 174775 126037 11 51 0 0% 0 0 0
respond_to (click) 176375 126850 10 64 0 0% 0 0 0
setivar (click) 175415 126614 10 38 0 0% 0 0 0
str_concat (click) 175351 126946 12 62 0 0% 0 0 0

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.