Stream: git-wasmtime

Topic: wasmtime / issue #3948 Wasi-NN ci example failed

view this post on Zulip Wasmtime GitHub notifications bot (Mar 21 2022 at 07:26):

gusye1234 labeled issue #3948:

Thanks for filing a bug report! Please fill out the TODOs below.

Note: if you want to report a security issue, please read our security policy!

Test Case

Steps to Reproduce

Expected Results

A success inference should happen for this test, outputting the classification results for the mobilenet.

Actual Results

A panic happened at the step of 

        wasi_nn::compute(context).unwrap();

It reported the error as :

Host error: BackendError(BackendAccess(parameter mismatch))
thread 'main' panicked at 'not implemented', crates/wasi-nn/src/witx.rs:17:45
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Versions and Environment

Wasmtime version or commit: commit head at e8ae3c0afdc7347d3de80c554353257efda2bbaa

Operating system: Ubuntu 20.04

Architecture: x86_64

OpenVINO version: 2021.4.582

Extra Info

My OpenVINO installed dir is on /opt/intel/openvino_2021, so I have to change one line in the ci/run-wasi-nn-example.sh to

source /opt/intel/openvino_2021/bin/setupvars.sh

but I don't think that's the problem.

view this post on Zulip Wasmtime GitHub notifications bot (Mar 21 2022 at 07:26):

gusye1234 opened issue #3948:

Thanks for filing a bug report! Please fill out the TODOs below.

Note: if you want to report a security issue, please read our security policy!

Test Case

Steps to Reproduce

Expected Results

A success inference should happen for this test, outputting the classification results for the mobilenet.

Actual Results

A panic happened at the step of 

        wasi_nn::compute(context).unwrap();

It reported the error as :

Host error: BackendError(BackendAccess(parameter mismatch))
thread 'main' panicked at 'not implemented', crates/wasi-nn/src/witx.rs:17:45
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Versions and Environment

Wasmtime version or commit: commit head at e8ae3c0afdc7347d3de80c554353257efda2bbaa

Operating system: Ubuntu 20.04

Architecture: x86_64

OpenVINO version: 2021.4.582

Extra Info

My OpenVINO installed dir is on /opt/intel/openvino_2021, so I have to change one line in the ci/run-wasi-nn-example.sh to

source /opt/intel/openvino_2021/bin/setupvars.sh

but I don't think that's the problem.

view this post on Zulip Wasmtime GitHub notifications bot (Mar 21 2022 at 07:36):

gusye1234 commented on issue #3948:

Full backtrace is here

[setupvars.sh] OpenVINO environment initialized
    Finished dev [unoptimized + debuginfo] target(s) in 5.36s
~/wasmtime/crates/wasi-nn/examples/classification-example ~/wasmtime
    Finished release [optimized] target(s) in 0.14s
~/wasmtime
    Finished dev [unoptimized + debuginfo] target(s) in 6.19s
     Running `target/debug/wasmtime run --mapdir 'fixture::/root/openvino_fixtures' /root/openvino_fixtures/wasi-nn-example.wasm --wasi-modules=experimental-wasi-nn`
Read graph XML, first 50 characters: <?xml version="1.0" ?>
<net name="mobilenet_v2_1.0
Read graph weights, size in bytes: 13956476
Loaded graph into wasi-nn with ID: 0
Created wasi-nn execution context with ID: 0
Read input tensor, size in bytes: 602112
Host error: BackendError(BackendAccess(parameter mismatch))
thread 'main' panicked at 'not implemented', crates/wasi-nn/src/witx.rs:17:45
stack backtrace:
   0:     0x56004aa5fa4c - std::backtrace_rs::backtrace::libunwind::trace::h91c465e73bf6c785
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
   1:     0x56004aa5fa4c - std::backtrace_rs::backtrace::trace_unsynchronized::hae9da36f5d58b5f3
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x56004aa5fa4c - std::sys_common::backtrace::_print_fmt::h7f499fa126a7effb
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/sys_common/backtrace.rs:67:5
   3:     0x56004aa5fa4c - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h3e2b509ce2ce6007
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/sys_common/backtrace.rs:46:22
   4:     0x56004aa86f9c - core::fmt::write::h753c7571fa063ecb
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/fmt/mod.rs:1168:17
   5:     0x56004aa58aa3 - std::io::Write::write_fmt::h2815c0519c99ba09
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/io/mod.rs:1660:15
   6:     0x56004aa620c2 - std::sys_common::backtrace::_print::h64941a6fc8b0ed9b
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/sys_common/backtrace.rs:49:5
   7:     0x56004aa620c2 - std::sys_common::backtrace::print::hcf25e43e1a9b0766
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/sys_common/backtrace.rs:36:9
   8:     0x56004aa620c2 - std::panicking::default_hook::{{closure}}::h78d3e6cf97fc623d
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:211:50
   9:     0x56004aa61ca5 - std::panicking::default_hook::hda898f8d3ad1a5ae
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:228:9
  10:     0x56004aa62713 - std::panicking::rust_panic_with_hook::h1a5ea2d6c23051aa
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:606:17
  11:     0x56004aa62402 - std::panicking::begin_panic_handler::{{closure}}::h07f549390938b73f
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:500:13
  12:     0x56004aa5fef4 - std::sys_common::backtrace::__rust_end_short_backtrace::h5ec3758a92cfb00d
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/sys_common/backtrace.rs:139:18
  13:     0x56004aa62169 - rust_begin_unwind
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:498:5
  14:     0x5600490cfd01 - core::panicking::panic_fmt::h3a79a6a99affe1d5
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/panicking.rs:116:14
  15:     0x5600490cfc4d - core::panicking::panic::h97167cd315d19cd4
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/panicking.rs:48:5
  16:     0x560049422084 - wasmtime_wasi_nn::witx::<impl wasmtime_wasi_nn::witx::types::UserErrorConversion for wasmtime_wasi_nn::ctx::WasiNnCtx>::nn_errno_from_wasi_nn_error::hf4b55e0bc8b56f4d
                               at /root/wasmtime/crates/wasi-nn/src/witx.rs:17:45
  17:     0x5600491685b8 - wasmtime_wasi_nn::witx::wasi_ephemeral_nn::set_input::{{closure}}::hf0dd54022d4b1a4e
                               at /root/wasmtime/crates/wasi-nn/src/witx.rs:6:1
  18:     0x560049258efa - tracing::span::Span::in_scope::h357ef6f5da237da6
                               at /root/.cargo/registry/src/mirrors.ustc.edu.cn-61ef6e0cd06fb9b8/tracing-0.1.31/src/span.rs:1091:9
  19:     0x560049166822 - wasmtime_wasi_nn::witx::wasi_ephemeral_nn::set_input::h21e40e093cc70a7c
                               at /root/wasmtime/crates/wasi-nn/src/witx.rs:6:1
  20:     0x56004916dc21 - wasmtime_wasi_nn::witx::wasi_ephemeral_nn::add_to_linker::{{closure}}::h5c2dd2b76d894e2d
                               at /root/wasmtime/crates/wasi-nn/src/witx.rs:6:1
  21:     0x5600491c1b0f - <F as wasmtime::func::IntoFunc<T,(wasmtime::func::Caller<T>,A1,A2,A3),R>>::into_func::wasm_to_host_shim::{{closure}}::{{closure}}::h029385688ad2ce0a
                               at /root/wasmtime/crates/wasmtime/src/func.rs:1893:41
  22:     0x56004912068d - core::ops::function::FnOnce::call_once::h134dd316713a2333
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/ops/function.rs:227:5
  23:     0x5600491094ac - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h0ed288d1197d920b
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/core/src/panic/unwind_safe.rs:271:9
  24:     0x5600492d5e3a - std::panicking::try::do_call::h4c5ab10ccbeac1bb
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:406:40
  25:     0x5600492df2eb - __rust_try
  26:     0x5600492d1dd2 - std::panicking::try::hd55d31f55d8c3744
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panicking.rs:370:19
  27:     0x5600492674cc - std::panic::catch_unwind::h51b4b8f4c8b947c9
                               at /rustc/9d1b2106e23b1abd32fce1f17267604a5102f57a/library/std/src/panic.rs:133:14
  28:     0x5600491c0d7a - <F as wasmtime::func::IntoFunc<T,(wasmtime::func::Caller<T>,A1,A2,A3),R>>::into_func::wasm_to_host_shim::{{closure}}::hd913e7c8f9ad8ed3
                               at /root/wasmtime/crates/wasmtime/src/func.rs:1888:29
  29:     0x560049197106 - wasmtime::func::Caller<T>::with::h85c65baca66367ae
                               at /root/wasmtime/crates/wasmtime/src/func.rs:1672:9
  30:     0x5600491bcff0 - <F as wasmtime::func::IntoFunc<T,(wasmtime::func::Caller<T>,A1,A2,A3),R>>::into_func::wasm_to_host_shim::h7addf7b81507d9a1
                               at /root/wasmtime/crates/wasmtime/src/func.rs:1879:34
  31:     0x7fb61545a1d7 - <unknown>
  32:     0x7fb615458f3f - <unknown>
  33:     0x7fb615459c82 - <unknown>
  34:     0x7fb615459bc7 - <unknown>
  35:     0x7fb615463668 - <unknown>
  36:     0x7fb615459596 - <unknown>
  37:     0x7fb61545706e - <unknown>
  38:     0x7fb615484b1e - <unknown>
  39:     0x7fb615484bc0 - <unknown>
  40:     0x56004918b83d - wasmtime::func::Func::call_unchecked::{{closure}}::h67a44e4750d46d0a
                               at /root/wasmtime/crates/wasmtime/src/func.rs:799:13
  41:     0x56004915406c - wasmtime_runtime::traphandlers::catch_traps::call_closure::h0840ee8827ee02fc
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:193:18
  42:     0x56004a5e4eea - wasmtime_setjmp
                               at /root/wasmtime/crates/runtime/src/helpers.c:55:3
  43:     0x560049154038 - wasmtime_runtime::traphandlers::catch_traps::{{closure}}::hf60fe2c5951928a3
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:181:9
  44:     0x5600491548c2 - wasmtime_runtime::traphandlers::CallThreadState::with::{{closure}}::ha0b6a6e90c48e4d1
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:231:38
  45:     0x56004911234b - wasmtime_runtime::traphandlers::tls::set::h2561d962449b52c5
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:481:12
  46:     0x56004915438d - wasmtime_runtime::traphandlers::CallThreadState::with::h6c6ff9ae16204d24
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:231:19
  47:     0x560049153ad7 - wasmtime_runtime::traphandlers::catch_traps::h1bff7e654c707f33
                               at /root/wasmtime/crates/runtime/src/traphandlers.rs:180:12
  48:     0x56004918fc45 - wasmtime::func::invoke_wasm_and_catch_traps::ha7b68f43f1dc4864
                               at /root/wasmtime/crates/wasmtime/src/func.rs:1210:22
  49:     0x56004918b78b - wasmtime::func::Func::call_unchecked::h479459478e9f9634
                               at /root/wasmtime/crates/wasmtime/src/func.rs:798:9
  50:     0x56004918c7ba - wasmtime::func::Func::call_impl::h04a65515f80a4926
                               at /root/wasmtime/crates/wasmtime/src/func.rs:948:13
  51:     0x56004918b2a1 - wasmtime::func::Func::call::h0116c273a8d66505
                               at /root/wasmtime/crates/wasmtime/src/func.rs
[message truncated]

view this post on Zulip Wasmtime GitHub notifications bot (Mar 21 2022 at 14:13):

alexcrichton commented on issue #3948:

cc @abrown

view this post on Zulip Wasmtime GitHub notifications bot (Mar 21 2022 at 16:37):

abrown commented on issue #3948:

@gusye1234, thanks for the detailed bug report. It looks like there may be some slight differences with the newer version of OpenVINO (e.g., tighter parameter checking) that could be causing the error; @brianjjones is planning to take a look. As a part of this, we will also try to upgrade the CI to use the latest version of OpenVINO, which is still stuck back at 2020.4.

view this post on Zulip Wasmtime GitHub notifications bot (Mar 22 2022 at 04:39):

gusye1234 commented on issue #3948:

Sure!
So maybe I can export the model from the newer version of OpenVINO to fix this problem.

view this post on Zulip Wasmtime GitHub notifications bot (Mar 22 2022 at 19:59):

brianjjones commented on issue #3948:

@gusye1234 I've found the issue and created a this PR #3956. Thanks for catching the issue.

@abrown This is ready to review, thanks.

view this post on Zulip Wasmtime GitHub notifications bot (Mar 24 2022 at 20:32):

abrown closed issue #3948:

Thanks for filing a bug report! Please fill out the TODOs below.

Note: if you want to report a security issue, please read our security policy!

Test Case

Steps to Reproduce

Expected Results

A success inference should happen for this test, outputting the classification results for the mobilenet.

Actual Results

A panic happened at the step of 

        wasi_nn::compute(context).unwrap();

It reported the error as :

Host error: BackendError(BackendAccess(parameter mismatch))
thread 'main' panicked at 'not implemented', crates/wasi-nn/src/witx.rs:17:45
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Versions and Environment

Wasmtime version or commit: commit head at e8ae3c0afdc7347d3de80c554353257efda2bbaa

Operating system: Ubuntu 20.04

Architecture: x86_64

OpenVINO version: 2021.4.582

Extra Info

My OpenVINO installed dir is on /opt/intel/openvino_2021, so I have to change one line in the ci/run-wasi-nn-example.sh to

source /opt/intel/openvino_2021/bin/setupvars.sh

but I don't think that's the problem.

Last updated: Nov 22 2024 at 16:03 UTC