YJIT Benchmarks

Details for Benchmarks at 2024-07-16 06:08:29 UTC

YJIT metrics from the yjit-bench suite using Ruby e048a073a3

Using the geomean of the headline benchmarks for x86 YJIT 3.4.0dev is
  • 76.5% faster than CRuby 3.4.0dev
  • the same speed as YJIT 3.3.3
On railsbench it is
  • 78.4% faster than CRuby 3.4.0dev
  • 1.9% slower than YJIT 3.3.3

Performance on Headline Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Headline Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on Other Benchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on Other Benchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Performance on MicroBenchmarks

Speed of each Ruby implementation relative to the baseline CRuby measurement. Higher is better.

Memory Usage on MicroBenchmarks

Memory usage of each Ruby implementation relative to the baseline CRuby measurement. Lower is better.

Want Raw Graphs and CSV?

Benchmarks Speed Details

Benchmark Memory Usage Details

Number of Iterations and Warmups Tested

bench CRuby 3.3.3 warmups CRuby 3.3.3 iters CRuby 3.4.0dev warmups CRuby 3.4.0dev iters YJIT 3.3.3 warmups YJIT 3.3.3 iters YJIT 3.4.0dev warmups YJIT 3.4.0dev iters
activerecord 10 51 10 46 10 116 10 113
chunky-png 10 18 10 14 10 36 10 43
erubi-rails 10 10 10 10 10 21 10 18
hexapdf 10 10 10 10 10 10 10 10
liquid-c 10 352 10 327 10 502 10 475
liquid-compile 10 340 10 325 10 491 10 476
liquid-render 10 137 10 131 10 353 10 358
lobsters 10 14 10 12 10 24 10 22
mail 10 162 10 146 10 237 10 217
psych-load 10 10 10 10 10 10 10 10
railsbench 10 10 10 10 10 10 10 10
rubocop 10 136 10 126 10 228 10 232
ruby-lsp 10 127 10 123 10 209 10 211
sequel 10 325 10 304 10 437 10 404
binarytrees 10 51 10 46 10 117 10 109
blurhash 10 62 10 54 10 118 10 144
erubi 10 83 10 80 10 103 10 108
etanni 10 59 10 55 10 68 10 67
fannkuchredux 10 10 10 10 10 18 10 16
fluentd 10 10 10 10 10 10 10 10
graphql 10 10 10 10 10 10 10 10
graphql-native 10 34 10 33 10 39 10 36
lee 10 11 10 10 10 19 10 19
matmul 10 10 10 10 10 15 10 17
nbody 10 210 10 187 10 385 10 495
nqueens 10 115 10 101 10 115 10 451
optcarrot 10 10 10 10 10 10 10 10
protoboeuf 10 189 10 162 10 681 10 626
protoboeuf-encode 10 111 10 117 10 235 10 293
rack 10 460 10 459 10 808 10 852
ruby-json 10 10 10 10 10 10 10 10
rubykon 10 10 10 10 10 10 10 10
sudoku 10 10 10 10 10 31 10 31
tinygql 10 25 10 22 10 51 10 50
30k_ifelse 10 10 10 10 10 70 10 69
30k_methods 10 10 10 10 10 26 10 26
cfunc_itself 10 257 10 219 10 1105 10 1211
fib 10 104 10 92 10 616 10 618
getivar 10 253 10 193 10 1281 10 1695
keyword_args 10 90 10 82 10 726 10 946
respond_to 10 89 10 82 10 1781 10 2090
ruby-xor 10 31 10 23 10 100 10 131
setivar 10 414 10 360 10 2357 10 4823
setivar_object 10 262 10 225 10 653 10 572
setivar_young 10 262 10 225 10 650 10 555
str_concat 10 326 10 272 10 593 10 535
throw 10 976 10 798 10 1275 10 967

Different Ruby configurations want different amounts of warmup. With no JIT, CRuby needs hardly any. YJIT and MJIT 3.0 both warm up quite quickly, while MJIT in 3.1 often slows down for a time as it compiles, after an unpredictable delay.

Benchmark YJIT Stats

Hover your cursor over the benchmark names for descriptions of each benchmark.

bench Exit Report Inline Outlined Comp iSeqs Comp Blocks Inval Inval Ratio Bind Alloc Bind Set Const Bumps Compile Time MS
activerecord (click) 1416328 1214944 214 2225 0 0% 0 0 85.122986
chunky-png (click) 331819 296083 84 1093 1 0% 0 0 38.681392
erubi-rails (click) 1712917 1472498 288 3117 17 0% 0 0 111.887873
hexapdf (click) 1301594 1116826 506 11849 41 0% 0 0 419.603633
liquid-c (click) 521423 448078 120 1769 5 0% 0 0 58.242243
liquid-compile (click) 443631 375567 151 2076 2 0% 0 0 75.594307
liquid-render (click) 619055 521739 137 2332 8 0% 0 0 78.426825
lobsters (click) 7628975 6305984 3076 50081 86 0% 0 0 2280.610254
mail (click) 778386 680421 347 5643 14 0% 0 0 199.168656
psych-load (click) 288205 247990 61 594 3 0% 0 0 21.749513
railsbench (click) 2981187 2578595 1650 16287 71 0% 0 0 610.815266
rubocop (click) 5515485 4848249 2891 51106 110 0% 4 0 1974.641046
ruby-lsp (click) 840581 727511 310 4691 24 0% 0 0 162.558293
sequel (click) 486222 393183 16 118 0 0% 0 0 5.219353
binarytrees (click) 8765 7825 10 70 0 0% 0 0 3.243904
blurhash (click) 50455 44132 31 457 0 0% 0 0 18.450005
erubi (click) 269376 198279 10 120 0 0% 0 0 5.06152
etanni (click) 34400 25222 12 104 0 0% 0 0 4.062006
fannkuchredux (click) 24067 31522 5 256 0 0% 0 0 10.078118
fluentd (click) 377391 312726 4 28 0 0% 0 0 1.299848
graphql (click) 438868 397696 66 650 0 0% 0 0 23.793595
graphql-native (click) 410103 348538 41 273 0 0% 0 0 11.248522
lee (click) 293048 248074 34 557 0 0% 0 0 21.049504
matmul (click) 8318 9199 8 86 0 0% 0 0 3.338702
nbody (click) 15375 19248 11 195 0 0% 0 0 6.418873
nqueens (click) 24183 24054 10 283 0 0% 0 0 10.915522
optcarrot (click) 309371 266843 188 4402 34 0% 0 0 120.019099
protoboeuf (click) 140401 146963 17 1368 0 0% 0 0 51.243729
protoboeuf-encode (click) 220188 217119 19 1177 0 0% 0 0 38.150245
rack (click) 272251 234685 37 413 0 0% 0 0 13.832148
ruby-json (click) 30520 28961 8 167 0 0% 0 0 5.547323
rubykon (click) 132662 103297 138 1522 3 0% 0 0 50.925148
sudoku (click) 45653 24997 8 520 0 0% 0 0 19.821511
tinygql (click) 304362 273316 58 735 5 0% 0 0 24.967896
30k_ifelse (click) 5134674 4729436 9259 50778 0 0% 0 0 1990.654844
30k_methods (click) 2016920 1591842 5778 19339 0 0% 0 0 555.846172
cfunc_itself (click) 7533 6248 9 70 0 0% 0 0 2.512714
fib (click) 4970 5023 8 49 0 0% 0 0 2.009323
getivar (click) 5936 6875 8 74 0 0% 0 0 2.528321
keyword_args (click) 8408 6980 10 72 0 0% 0 0 2.828795
respond_to (click) 8276 8394 9 85 0 0% 0 0 3.049108
ruby-xor (click) 5580 6003 5 62 0 0% 0 0 2.075703
setivar (click) 5087 5551 8 54 0 0% 0 0 2.056615
setivar_object (click) 5470 5459 8 54 0 0% 0 0 2.127569
setivar_young (click) 6180 6181 9 62 0 0% 0 0 2.367225
str_concat (click) 7776 8178 11 85 0 0% 0 0 3.268158
throw (click) 7899 6453 10 69 0 0% 0 0 2.815952

YJIT stats correspond to the YJIT stats exit report.

Note: currently, all stats are collected on x86_64, not ARM.

Raw JSON data files

All graphs and table data in this page comes from processing these data files, which come from benchmark runs.