Stream: git-wasmtime

Topic: wasmtime / issue #5060 Upadate format of benchmark results


view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2022 at 23:17):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2022 at 23:24):

jlb6740 commented on issue #5060:

Shows pct_change on x64 for the patch if merged compared to current head for main.

Hi .. Pct_change is based on clocktick event cycles where the benchmarks are run with Sightglass.
A negative pct_change means clockticks are expected to be reduced for the benchmark,
for that phase, and by that factor, if the patch were merged (i.e. negative is good).

wasm arch phase pct_change
benchmarks/blake3-scalar x86_64 Compilation -0.050192
benchmarks/blake3-scalar x86_64 Execution -0.077807
benchmarks/blake3-scalar x86_64 Instantiation -0.010935
benchmarks/blake3-simd x86_64 Compilation -0.015642
benchmarks/blake3-simd x86_64 Execution -0.013008
benchmarks/blake3-simd x86_64 Instantiation -0.112058
benchmarks/bz2 x86_64 Compilation 0.047539
benchmarks/bz2 x86_64 Execution 0.017599
benchmarks/bz2 x86_64 Instantiation 0.031295
benchmarks/intgemm-simd x86_64 Compilation 0.000530
benchmarks/intgemm-simd x86_64 Execution 0.001857
benchmarks/intgemm-simd x86_64 Instantiation -0.001350
benchmarks/meshoptimizer x86_64 Compilation -0.015015
benchmarks/meshoptimizer x86_64 Execution -0.000462
benchmarks/meshoptimizer x86_64 Instantiation -0.026642
benchmarks/noop x86_64 Compilation 0.016306
benchmarks/noop x86_64 Execution 0.560142
benchmarks/noop x86_64 Instantiation 0.077786
benchmarks/pulldown-cmark x86_64 Compilation -0.018827
benchmarks/pulldown-cmark x86_64 Execution -0.032975
benchmarks/pulldown-cmark x86_64 Instantiation -0.061880
benchmarks/shootout-ackermann x86_64 Compilation -0.015801
benchmarks/shootout-ackermann x86_64 Execution 0.253876
benchmarks/shootout-ackermann x86_64 Instantiation 0.029229
benchmarks/shootout-base64 x86_64 Compilation 0.072468
benchmarks/shootout-base64 x86_64 Execution 0.000160
benchmarks/shootout-base64 x86_64 Instantiation -0.028566
benchmarks/shootout-ctype x86_64 Compilation 0.011471
benchmarks/shootout-ctype x86_64 Execution -0.000079
benchmarks/shootout-ctype x86_64 Instantiation 0.007039
benchmarks/shootout-ed25519 x86_64 Compilation 0.014212
benchmarks/shootout-ed25519 x86_64 Execution -0.000338
benchmarks/shootout-ed25519 x86_64 Instantiation 0.045068
benchmarks/shootout-fib2 x86_64 Compilation -0.019863
benchmarks/shootout-fib2 x86_64 Execution 0.000087
benchmarks/shootout-fib2 x86_64 Instantiation 0.033255
benchmarks/shootout-gimli x86_64 Compilation 0.031095
benchmarks/shootout-gimli x86_64 Execution 0.012047
benchmarks/shootout-gimli x86_64 Instantiation 0.143404
benchmarks/shootout-heapsort x86_64 Compilation 0.016651
benchmarks/shootout-heapsort x86_64 Execution -0.000087
benchmarks/shootout-heapsort x86_64 Instantiation -0.158032
benchmarks/shootout-keccak x86_64 Compilation -0.000802
benchmarks/shootout-keccak x86_64 Execution 0.001600
benchmarks/shootout-keccak x86_64 Instantiation -0.029113
benchmarks/shootout-matrix x86_64 Compilation -0.036196
benchmarks/shootout-matrix x86_64 Execution 0.000788
benchmarks/shootout-matrix x86_64 Instantiation 0.007406
benchmarks/shootout-memmove x86_64 Compilation -0.138983
benchmarks/shootout-memmove x86_64 Execution 0.000900
benchmarks/shootout-memmove x86_64 Instantiation -0.041495
benchmarks/shootout-minicsv x86_64 Compilation -0.046978
benchmarks/shootout-minicsv x86_64 Execution 0.000761
benchmarks/shootout-minicsv x86_64 Instantiation 0.039889
benchmarks/shootout-nestedloop x86_64 Compilation 0.011639
benchmarks/shootout-nestedloop x86_64 Execution -0.003988
benchmarks/shootout-nestedloop x86_64 Instantiation 0.015794
benchmarks/shootout-random x86_64 Compilation 0.027558
benchmarks/shootout-random x86_64 Execution 0.000611
benchmarks/shootout-random x86_64 Instantiation -0.040762
benchmarks/shootout-ratelimit x86_64 Compilation -0.009918
benchmarks/shootout-ratelimit x86_64 Execution 0.023033
benchmarks/shootout-ratelimit x86_64 Instantiation 0.086613
benchmarks/shootout-seqhash x86_64 Compilation -0.110301
benchmarks/shootout-seqhash x86_64 Execution -0.000080
benchmarks/shootout-seqhash x86_64 Instantiation 0.039469
benchmarks/shootout-sieve x86_64 Compilation 0.039958
benchmarks/shootout-sieve x86_64 Execution 0.001072
benchmarks/shootout-sieve x86_64 Instantiation 0.017271
benchmarks/shootout-switch x86_64 Compilation 0.034087
benchmarks/shootout-switch x86_64 Execution 0.000888
benchmarks/shootout-switch x86_64 Instantiation 0.011962
benchmarks/shootout-xblabla20 x86_64 Compilation -0.006581
benchmarks/shootout-xblabla20 x86_64 Execution 0.020334
benchmarks/shootout-xblabla20 x86_64 Instantiation -0.056945
benchmarks/shootout-xchacha20 x86_64 Compilation -0.039488
benchmarks/shootout-xchacha20 x86_64 Execution -0.000684
benchmarks/shootout-xchacha20 x86_64 Instantiation -0.090442
benchmarks/spidermonkey x86_64 Compilation 0.006616
benchmarks/spidermonkey x86_64 Execution -0.005827
benchmarks/spidermonkey x86_64 Instantiation -0.020950

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 02:44):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 02:51):

jlb6740 commented on issue #5060:

Shows pct_change on x64 for the patch if merged compared to current head for main.

Hi .. Pct_change is based on clocktick event cycles where the benchmarks are run with Sightglass.
A negative pct_change means clockticks are expected to be reduced for the benchmark,
for that phase, and by that factor, if the patch were merged (i.e. negative is good).

wasm arch phase pct_change
benchmarks/blake3-scalar x86_64 Compilation -0.016673
benchmarks/blake3-scalar x86_64 Execution 0.015206
benchmarks/blake3-scalar x86_64 Instantiation 0.042582
benchmarks/blake3-simd x86_64 Compilation -0.103264
benchmarks/blake3-simd x86_64 Execution -0.013309
benchmarks/blake3-simd x86_64 Instantiation -0.047856
benchmarks/bz2 x86_64 Compilation -0.065630
benchmarks/bz2 x86_64 Execution -0.038392
benchmarks/bz2 x86_64 Instantiation 0.104766
benchmarks/intgemm-simd x86_64 Compilation 0.004482
benchmarks/intgemm-simd x86_64 Execution -0.000084
benchmarks/intgemm-simd x86_64 Instantiation 0.009399
benchmarks/meshoptimizer x86_64 Compilation 0.011008
benchmarks/meshoptimizer x86_64 Execution -0.003755
benchmarks/meshoptimizer x86_64 Instantiation 0.074026
benchmarks/noop x86_64 Compilation -0.023854
benchmarks/noop x86_64 Execution -0.223529
benchmarks/noop x86_64 Instantiation -0.037909
benchmarks/pulldown-cmark x86_64 Compilation -0.016603
benchmarks/pulldown-cmark x86_64 Execution -0.007214
benchmarks/pulldown-cmark x86_64 Instantiation -0.005431
benchmarks/shootout-ackermann x86_64 Compilation -0.047876
benchmarks/shootout-ackermann x86_64 Execution 0.013962
benchmarks/shootout-ackermann x86_64 Instantiation 0.034680
benchmarks/shootout-base64 x86_64 Compilation -0.023650
benchmarks/shootout-base64 x86_64 Execution 0.001237
benchmarks/shootout-base64 x86_64 Instantiation 0.052683
benchmarks/shootout-ctype x86_64 Compilation 0.026490
benchmarks/shootout-ctype x86_64 Execution 0.000262
benchmarks/shootout-ctype x86_64 Instantiation 0.016364
benchmarks/shootout-ed25519 x86_64 Compilation 0.030841
benchmarks/shootout-ed25519 x86_64 Execution -0.003552
benchmarks/shootout-ed25519 x86_64 Instantiation 0.059243
benchmarks/shootout-fib2 x86_64 Compilation -0.024481
benchmarks/shootout-fib2 x86_64 Execution -0.000072
benchmarks/shootout-fib2 x86_64 Instantiation -0.008940
benchmarks/shootout-gimli x86_64 Compilation 0.019612
benchmarks/shootout-gimli x86_64 Execution -0.001584
benchmarks/shootout-gimli x86_64 Instantiation 0.082201
benchmarks/shootout-heapsort x86_64 Compilation -0.009361
benchmarks/shootout-heapsort x86_64 Execution -0.001727
benchmarks/shootout-heapsort x86_64 Instantiation -0.000774
benchmarks/shootout-keccak x86_64 Compilation -0.000508
benchmarks/shootout-keccak x86_64 Execution 0.006049
benchmarks/shootout-keccak x86_64 Instantiation 0.076634
benchmarks/shootout-matrix x86_64 Compilation 0.089116
benchmarks/shootout-matrix x86_64 Execution -0.000565
benchmarks/shootout-matrix x86_64 Instantiation 0.035916
benchmarks/shootout-memmove x86_64 Compilation -0.128039
benchmarks/shootout-memmove x86_64 Execution -0.002948
benchmarks/shootout-memmove x86_64 Instantiation -0.076299
benchmarks/shootout-minicsv x86_64 Compilation 0.062446
benchmarks/shootout-minicsv x86_64 Execution -0.000011
benchmarks/shootout-minicsv x86_64 Instantiation 0.032456
benchmarks/shootout-nestedloop x86_64 Compilation 0.018903
benchmarks/shootout-nestedloop x86_64 Execution 0.003843
benchmarks/shootout-nestedloop x86_64 Instantiation 0.050515
benchmarks/shootout-random x86_64 Compilation 0.024180
benchmarks/shootout-random x86_64 Execution 0.000165
benchmarks/shootout-random x86_64 Instantiation -0.043014
benchmarks/shootout-ratelimit x86_64 Compilation 0.031334
benchmarks/shootout-ratelimit x86_64 Execution 0.000159
benchmarks/shootout-ratelimit x86_64 Instantiation -0.081111
benchmarks/shootout-seqhash x86_64 Compilation 0.045201
benchmarks/shootout-seqhash x86_64 Execution -0.000857
benchmarks/shootout-seqhash x86_64 Instantiation -0.041038
benchmarks/shootout-sieve x86_64 Compilation 0.019440
benchmarks/shootout-sieve x86_64 Execution 0.001493
benchmarks/shootout-sieve x86_64 Instantiation 0.045501
benchmarks/shootout-switch x86_64 Compilation -0.091198
benchmarks/shootout-switch x86_64 Execution -0.001740
benchmarks/shootout-switch x86_64 Instantiation 0.051443
benchmarks/shootout-xblabla20 x86_64 Compilation -0.049690
benchmarks/shootout-xblabla20 x86_64 Execution 0.014771
benchmarks/shootout-xblabla20 x86_64 Instantiation 0.079765
benchmarks/shootout-xchacha20 x86_64 Compilation -0.064121
benchmarks/shootout-xchacha20 x86_64 Execution -0.030658
benchmarks/shootout-xchacha20 x86_64 Instantiation 0.369637
benchmarks/spidermonkey x86_64 Compilation 0.013221
benchmarks/spidermonkey x86_64 Execution 0.000563
benchmarks/spidermonkey x86_64 Instantiation 0.010729

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 05:30):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 05:41):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 05:53):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:07):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:14):

jlb6740 commented on issue #5060:

Change factor shows patch effect on x64 if merged compared to current head for main.

Results are based on clocktick event cycles.
A negative change factor means clockticks are expected to be reduced.

wasm,arch,phase,change_factor
benchmarks/blake3-scalar,x86_64,Compilation,-0.018020484435345097
benchmarks/blake3-simd,x86_64,Compilation,0.07125329573991457
benchmarks/bz2,x86_64,Compilation,0.05663455448270427
benchmarks/intgemm-simd,x86_64,Compilation,-0.013531855296949113
benchmarks/meshoptimizer,x86_64,Compilation,-0.00971237906343736
benchmarks/noop,x86_64,Compilation,0.029134824870321596
benchmarks/pulldown-cmark,x86_64,Compilation,0.013228006570848327
benchmarks/shootout-ackermann,x86_64,Compilation,0.020002081773226932
benchmarks/shootout-base64,x86_64,Compilation,-0.007003736627465562
benchmarks/shootout-ctype,x86_64,Compilation,-0.004608752229133928
benchmarks/shootout-ed25519,x86_64,Compilation,-0.008277265715443072
benchmarks/shootout-fib2,x86_64,Compilation,0.011220106614727277
benchmarks/shootout-gimli,x86_64,Compilation,0.014832410864674905
benchmarks/shootout-heapsort,x86_64,Compilation,-0.017634457779194368
benchmarks/shootout-keccak,x86_64,Compilation,0.0008661978001676118
benchmarks/shootout-matrix,x86_64,Compilation,0.023007335358968373
benchmarks/shootout-memmove,x86_64,Compilation,0.06472674765091657
benchmarks/shootout-minicsv,x86_64,Compilation,0.04885790067539486
benchmarks/shootout-nestedloop,x86_64,Compilation,-0.005068418090198201
benchmarks/shootout-random,x86_64,Compilation,0.016706885835964025
benchmarks/shootout-ratelimit,x86_64,Compilation,0.07955751122453081
benchmarks/shootout-seqhash,x86_64,Compilation,-0.11467834513027975
benchmarks/shootout-sieve,x86_64,Compilation,-0.007751763857428817
benchmarks/shootout-switch,x86_64,Compilation,-0.009151471234979724
benchmarks/shootout-xblabla20,x86_64,Compilation,0.022487753788641207
benchmarks/shootout-xchacha20,x86_64,Compilation,-0.0009132185261474524
benchmarks/spidermonkey,x86_64,Compilation,-0.023810309986815992

wasm,arch,phase,change_factor
benchmarks/blake3-scalar,x86_64,Instantiation,0.08154909323320281
benchmarks/blake3-simd,x86_64,Instantiation,-0.09435186486866431
benchmarks/bz2,x86_64,Instantiation,0.11957405581218317
benchmarks/intgemm-simd,x86_64,Instantiation,0.4747130822742083
benchmarks/meshoptimizer,x86_64,Instantiation,0.05548355858101073
benchmarks/noop,x86_64,Instantiation,0.17304086063955793
benchmarks/pulldown-cmark,x86_64,Instantiation,0.27660061848585493
benchmarks/shootout-ackermann,x86_64,Instantiation,-0.11412628925811696
benchmarks/shootout-base64,x86_64,Instantiation,0.10533374373406024
benchmarks/shootout-ctype,x86_64,Instantiation,-0.08610943958331274
benchmarks/shootout-ed25519,x86_64,Instantiation,0.011161434628267575
benchmarks/shootout-fib2,x86_64,Instantiation,0.02740152576677568
benchmarks/shootout-gimli,x86_64,Instantiation,0.05344418052256539
benchmarks/shootout-heapsort,x86_64,Instantiation,0.028390272819825535
benchmarks/shootout-keccak,x86_64,Instantiation,0.150034180758168
benchmarks/shootout-matrix,x86_64,Instantiation,-0.004677493388122622
benchmarks/shootout-memmove,x86_64,Instantiation,0.04072790294627393
benchmarks/shootout-minicsv,x86_64,Instantiation,0.10937690525545674
benchmarks/shootout-nestedloop,x86_64,Instantiation,0.019406581075283036
benchmarks/shootout-random,x86_64,Instantiation,-0.435801452421951
benchmarks/shootout-ratelimit,x86_64,Instantiation,0.027382681285544885
benchmarks/shootout-seqhash,x86_64,Instantiation,0.01843876843876835
benchmarks/shootout-sieve,x86_64,Instantiation,0.0858841589149062
benchmarks/shootout-switch,x86_64,Instantiation,-0.007686075517557511
benchmarks/shootout-xblabla20,x86_64,Instantiation,0.03505049314314901
benchmarks/shootout-xchacha20,x86_64,Instantiation,0.011538815365812027
benchmarks/spidermonkey,x86_64,Instantiation,0.029164479200131543

wasm,arch,phase,change_factor
benchmarks/blake3-scalar,x86_64,Execution,0.02391215030067606
benchmarks/blake3-simd,x86_64,Execution,-0.02889447530509881
benchmarks/bz2,x86_64,Execution,0.0020508170840825013
benchmarks/intgemm-simd,x86_64,Execution,0.00045994772965185504
benchmarks/meshoptimizer,x86_64,Execution,-0.0010003236316716846
benchmarks/noop,x86_64,Execution,-0.3480209111277073
benchmarks/pulldown-cmark,x86_64,Execution,-0.00206622418118807
benchmarks/shootout-ackermann,x86_64,Execution,0.06372045220966083
benchmarks/shootout-base64,x86_64,Execution,0.0042822672464284395
benchmarks/shootout-ctype,x86_64,Execution,0.0018272451989089777
benchmarks/shootout-ed25519,x86_64,Execution,-0.0013595588275698844
benchmarks/shootout-fib2,x86_64,Execution,0.001143417208171682
benchmarks/shootout-gimli,x86_64,Execution,0.005878084269548056
benchmarks/shootout-heapsort,x86_64,Execution,0.001104436110415108
benchmarks/shootout-keccak,x86_64,Execution,-0.009104548361943854
benchmarks/shootout-matrix,x86_64,Execution,0.0008669202313014157
benchmarks/shootout-memmove,x86_64,Execution,0.00207352742992839
benchmarks/shootout-minicsv,x86_64,Execution,0.002640286519395074
benchmarks/shootout-nestedloop,x86_64,Execution,-0.002400709949495039
benchmarks/shootout-random,x86_64,Execution,3.1917472615550224e-05
benchmarks/shootout-ratelimit,x86_64,Execution,0.0007861819136574244
benchmarks/shootout-seqhash,x86_64,Execution,0.0024118983474439304
benchmarks/shootout-sieve,x86_64,Execution,0.0018030860493345457
benchmarks/shootout-switch,x86_64,Execution,-0.00013305292489473874
benchmarks/shootout-xblabla20,x86_64,Execution,-0.0007567545061339942
benchmarks/shootout-xchacha20,x86_64,Execution,-0.012226764288853276
benchmarks/spidermonkey,x86_64,Execution,-0.0003628088639525684

phase,change_factor
Compilation,0.008605672417710477
Execution,-0.010790129505455161
Instantiation,0.04410906584604744

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:17):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:23):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:45):

jlb6740 commented on issue #5060:

Change factor shows patch effect on x64 if merged compared to current head for main.

Results are based on clocktick event cycles.
A negative change factor means clockticks are expected to be reduced.

wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Compilation -0.016877654557140742
benchmarks/blake3-simd x86_64 Compilation 0.08194057253790343
benchmarks/bz2 x86_64 Compilation -0.001293326919474369
benchmarks/intgemm-simd x86_64 Compilation -0.009588495143642461
benchmarks/meshoptimizer x86_64 Compilation -0.02159965580199552
benchmarks/noop x86_64 Compilation -0.2894639024518858
benchmarks/pulldown-cmark x86_64 Compilation -0.019353210340762872
benchmarks/shootout-ackermann x86_64 Compilation -0.055594086802220444
benchmarks/shootout-base64 x86_64 Compilation -0.03164354098077404
benchmarks/shootout-ctype x86_64 Compilation 0.1448569375874056
benchmarks/shootout-ed25519 x86_64 Compilation 0.00821986028470656
benchmarks/shootout-fib2 x86_64 Compilation 0.024443312098547887
benchmarks/shootout-gimli x86_64 Compilation 0.04459579472671149
benchmarks/shootout-heapsort x86_64 Compilation -0.025441690622511226
benchmarks/shootout-keccak x86_64 Compilation 0.009996809844224908
benchmarks/shootout-matrix x86_64 Compilation -0.018055091266589107
benchmarks/shootout-memmove x86_64 Compilation 0.24762007898001004
benchmarks/shootout-minicsv x86_64 Compilation -0.019298656956791227
benchmarks/shootout-nestedloop x86_64 Compilation -0.009667534546466183
benchmarks/shootout-random x86_64 Compilation 0.009769891503341954
benchmarks/shootout-ratelimit x86_64 Compilation -0.03739931195454593
benchmarks/shootout-seqhash x86_64 Compilation -0.023954709017668163
benchmarks/shootout-sieve x86_64 Compilation 0.01650291242777513
benchmarks/shootout-switch x86_64 Compilation -0.016781829762500866
benchmarks/shootout-xblabla20 x86_64 Compilation -0.08599663509325017
benchmarks/shootout-xchacha20 x86_64 Compilation 0.0548657356490041
benchmarks/spidermonkey x86_64 Compilation -0.0026511900732628657
wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Instantiation 0.023697381397878248
benchmarks/blake3-simd x86_64 Instantiation -0.08575630607753515
benchmarks/bz2 x86_64 Instantiation 0.06238980295693608
benchmarks/intgemm-simd x86_64 Instantiation 0.5018498592338192
benchmarks/meshoptimizer x86_64 Instantiation 0.018559982363194116
benchmarks/noop x86_64 Instantiation -0.03731717318995764
benchmarks/pulldown-cmark x86_64 Instantiation -0.04042404473438954
benchmarks/shootout-ackermann x86_64 Instantiation 0.15718007662835243
benchmarks/shootout-base64 x86_64 Instantiation 0.005158011002327045
benchmarks/shootout-ctype x86_64 Instantiation -0.10890781902290425
benchmarks/shootout-ed25519 x86_64 Instantiation 0.017641275445221538
benchmarks/shootout-fib2 x86_64 Instantiation -0.06584443587954036
benchmarks/shootout-gimli x86_64 Instantiation 0.03424390876942551
benchmarks/shootout-heapsort x86_64 Instantiation -0.01295926366096034
benchmarks/shootout-keccak x86_64 Instantiation 0.025646595942406814
benchmarks/shootout-matrix x86_64 Instantiation -0.034629559029101586
benchmarks/shootout-memmove x86_64 Instantiation -0.011718319517063147
benchmarks/shootout-minicsv x86_64 Instantiation -0.08778494207961118
benchmarks/shootout-nestedloop x86_64 Instantiation -0.06191657927253469
benchmarks/shootout-random x86_64 Instantiation -0.053122494341652504
benchmarks/shootout-ratelimit x86_64 Instantiation -0.005403269725671955
benchmarks/shootout-seqhash x86_64 Instantiation -0.04719274461222012
benchmarks/shootout-sieve x86_64 Instantiation -0.048550838987954315
benchmarks/shootout-switch x86_64 Instantiation -0.0467495907039891
benchmarks/shootout-xblabla20 x86_64 Instantiation -0.09164158938770495
benchmarks/shootout-xchacha20 x86_64 Instantiation -0.08062254807383107
benchmarks/spidermonkey x86_64 Instantiation 0.04728436497448674
wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Execution 0.009471334534076226
benchmarks/blake3-simd x86_64 Execution 0.01493971250286652
benchmarks/bz2 x86_64 Execution 0.019355660681109832
benchmarks/intgemm-simd x86_64 Execution 0.0016319015908159429
benchmarks/meshoptimizer x86_64 Execution -0.0005476686187887436
benchmarks/noop x86_64 Execution -0.0782800441014333
benchmarks/pulldown-cmark x86_64 Execution -0.010808958889479636
benchmarks/shootout-ackermann x86_64 Execution 0.15227070347284055
benchmarks/shootout-base64 x86_64 Execution 0.0006517844295184094
benchmarks/shootout-ctype x86_64 Execution 0.0044594885781508165
benchmarks/shootout-ed25519 x86_64 Execution 0.0010811335206950545
benchmarks/shootout-fib2 x86_64 Execution 0.0006661573249961972
benchmarks/shootout-gimli x86_64 Execution -0.004347453643022026
benchmarks/shootout-heapsort x86_64 Execution -0.00014424544596935984
benchmarks/shootout-keccak x86_64 Execution -0.00022426698237898446
benchmarks/shootout-matrix x86_64 Execution -0.00037431306349999804
benchmarks/shootout-memmove x86_64 Execution 0.002773553260052797
benchmarks/shootout-minicsv x86_64 Execution 0.0008652599489882284
benchmarks/shootout-nestedloop x86_64 Execution -0.002653378316691657
benchmarks/shootout-random x86_64 Execution 0.0018884376792083213
benchmarks/shootout-ratelimit x86_64 Execution 0.0007157019639774109
benchmarks/shootout-seqhash x86_64 Execution -0.0015390904276129103
benchmarks/shootout-sieve x86_64 Execution -0.000671673737887124
benchmarks/shootout-switch x86_64 Execution 0.0009044594915410542
benchmarks/shootout-xblabla20 x86_64 Execution 0.0015918002288561883
benchmarks/shootout-xchacha20 x86_64 Execution -0.010004292011202343
benchmarks/spidermonkey x86_64 Execution -0.00022767708333448766
phase change_factor
Compilation -0.0015499487648833671
Execution 0.003831260255051592
Instantiation -0.00099593554009534

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 06:53):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 07:15):

jlb6740 commented on issue #5060:

Change factor shows patch effect on x64 if merged compared to current head for main.

Results are based on clocktick event cycles.
A negative change factor means clockticks are expected to be reduced.

wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Compilation -0.011370409887845323
benchmarks/blake3-simd x86_64 Compilation 0.03533098839455051
benchmarks/bz2 x86_64 Compilation 0.10592979261276358
benchmarks/intgemm-simd x86_64 Compilation 0.0076870822743826395
benchmarks/meshoptimizer x86_64 Compilation -0.0025180247389582355
benchmarks/noop x86_64 Compilation -0.01860976836495387
benchmarks/pulldown-cmark x86_64 Compilation 0.008369279516189154
benchmarks/shootout-ackermann x86_64 Compilation 0.044865430814119645
benchmarks/shootout-base64 x86_64 Compilation 0.042373294175259035
benchmarks/shootout-ctype x86_64 Compilation -0.031157146395578983
benchmarks/shootout-ed25519 x86_64 Compilation 0.002628724559716522
benchmarks/shootout-fib2 x86_64 Compilation 0.017862302639828354
benchmarks/shootout-gimli x86_64 Compilation 0.04394570872223258
benchmarks/shootout-heapsort x86_64 Compilation -0.007364347443149288
benchmarks/shootout-keccak x86_64 Compilation 0.07912842965739486
benchmarks/shootout-matrix x86_64 Compilation -0.05770538147200033
benchmarks/shootout-memmove x86_64 Compilation 0.04738441300871532
benchmarks/shootout-minicsv x86_64 Compilation 0.07935607888039065
benchmarks/shootout-nestedloop x86_64 Compilation -0.030468235875386607
benchmarks/shootout-random x86_64 Compilation -0.008788593495076769
benchmarks/shootout-ratelimit x86_64 Compilation -0.03840552491086813
benchmarks/shootout-seqhash x86_64 Compilation -0.08796585034354742
benchmarks/shootout-sieve x86_64 Compilation 0.005542906993256658
benchmarks/shootout-switch x86_64 Compilation 0.06221173680363923
benchmarks/shootout-xblabla20 x86_64 Compilation 0.02714806209918219
benchmarks/shootout-xchacha20 x86_64 Compilation 0.021130828520589784
benchmarks/spidermonkey x86_64 Compilation 0.002898530534388266
wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Instantiation -0.005793472881306605
benchmarks/blake3-simd x86_64 Instantiation -0.020426153828308924
benchmarks/bz2 x86_64 Instantiation 0.07429545201537979
benchmarks/intgemm-simd x86_64 Instantiation 0.04688562567724097
benchmarks/meshoptimizer x86_64 Instantiation -0.003593091702273843
benchmarks/noop x86_64 Instantiation 0.13164984467045637
benchmarks/pulldown-cmark x86_64 Instantiation 0.022367136061493875
benchmarks/shootout-ackermann x86_64 Instantiation 0.05896575781033486
benchmarks/shootout-base64 x86_64 Instantiation -0.0034800499026024223
benchmarks/shootout-ctype x86_64 Instantiation 0.44235204974204123
benchmarks/shootout-ed25519 x86_64 Instantiation 0.017240820909218524
benchmarks/shootout-fib2 x86_64 Instantiation 0.013348033653743263
benchmarks/shootout-gimli x86_64 Instantiation 0.2158229108219154
benchmarks/shootout-heapsort x86_64 Instantiation -0.036380513981256635
benchmarks/shootout-keccak x86_64 Instantiation 0.5447192049919112
benchmarks/shootout-matrix x86_64 Instantiation 0.002815271456708235
benchmarks/shootout-memmove x86_64 Instantiation 0.004221820968810519
benchmarks/shootout-minicsv x86_64 Instantiation -0.01912871405870531
benchmarks/shootout-nestedloop x86_64 Instantiation -0.0034548335974643463
benchmarks/shootout-random x86_64 Instantiation 0.07646950855779377
benchmarks/shootout-ratelimit x86_64 Instantiation 0.007354113308607024
benchmarks/shootout-seqhash x86_64 Instantiation -0.22329499970712852
benchmarks/shootout-sieve x86_64 Instantiation 0.022520485701366555
benchmarks/shootout-switch x86_64 Instantiation 0.034247085750785056
benchmarks/shootout-xblabla20 x86_64 Instantiation 0.024809403605395408
benchmarks/shootout-xchacha20 x86_64 Instantiation 0.05298845140811781
benchmarks/spidermonkey x86_64 Instantiation 0.04137354466370269
wasm arch phase change_factor
benchmarks/blake3-scalar x86_64 Execution -0.012441687259663214
benchmarks/blake3-simd x86_64 Execution -0.015347664795966942
benchmarks/bz2 x86_64 Execution -0.0073246895490997055
benchmarks/intgemm-simd x86_64 Execution -0.0011562976266117353
benchmarks/meshoptimizer x86_64 Execution -0.0049511514723130645
benchmarks/noop x86_64 Execution -0.42807505211952745
benchmarks/pulldown-cmark x86_64 Execution -0.004745607069370328
benchmarks/shootout-ackermann x86_64 Execution -0.18536251709986318
benchmarks/shootout-base64 x86_64 Execution -0.002964385181596807
benchmarks/shootout-ctype x86_64 Execution -0.0010776623458368384
benchmarks/shootout-ed25519 x86_64 Execution 0.001474859031769249
benchmarks/shootout-fib2 x86_64 Execution 0.00020381461093399444
benchmarks/shootout-gimli x86_64 Execution 0.004033363651319233
benchmarks/shootout-heapsort x86_64 Execution -0.00031291754610829337
benchmarks/shootout-keccak x86_64 Execution 0.001070864729466825
benchmarks/shootout-matrix x86_64 Execution 0.0010417024146387455
benchmarks/shootout-memmove x86_64 Execution 8.067331186700777e-05
benchmarks/shootout-minicsv x86_64 Execution 0.000281866583810908
benchmarks/shootout-nestedloop x86_64 Execution 0.007122287188371157
benchmarks/shootout-random x86_64 Execution 0.0020532744384276214
benchmarks/shootout-ratelimit x86_64 Execution -0.013445832080646758
benchmarks/shootout-seqhash x86_64 Execution -0.0016334605768543176
benchmarks/shootout-sieve x86_64 Execution 6.623481759393535e-05
benchmarks/shootout-switch x86_64 Execution 0.003914333184921626
benchmarks/shootout-xblabla20 x86_64 Execution -0.04419130212920164
benchmarks/shootout-xchacha20 x86_64 Execution 0.006499351564510425
benchmarks/spidermonkey x86_64 Execution -0.00021399195248172909

Averages
|phase|change_factor|
|-|-|
|Compilation|0.012571863232564222|
|Execution|-0.02575561456583375|
|Instantiation|0.05625535896725837|

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 17:32):

jlb6740 commented on issue #5060:

Will provide one more update to clarify the factor change and round the result

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 17:45):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 17:57):

jlb6740 commented on issue #5060:

/bench_x64

view this post on Zulip Wasmtime GitHub notifications bot (Oct 17 2022 at 18:17):

jlb6740 commented on issue #5060:

/bench_x64


Last updated: Dec 23 2024 at 12:05 UTC