Stream: git-wasmtime

Topic: wasmtime / issue #8361 Does wasmtime support AI model inf...

view this post on Zulip Wasmtime GitHub notifications bot (Apr 13 2024 at 14:46):

lebron8dong opened issue #8361:

Are there any related examples demo?
Thank you so much.

view this post on Zulip Wasmtime GitHub notifications bot (Apr 13 2024 at 16:41):

bjorn3 commented on issue #8361:

There is the wasi-nn specification implemented by wasmtime. https://github.com/bytecodealliance/wasmtime/tree/main/crates/wasi-nn/examples has a couple of examples.

view this post on Zulip Wasmtime GitHub notifications bot (Apr 16 2024 at 02:01):

rockwotj commented on issue #8361:

It's also possible to compile many models to Wasm and run inference. For example, https://github.com/sonos/tract/ compiles to WebAssembly & WASI and can run any ONNX compatible model.

I have an example of running a BERT model here: https://github.com/rockwotj/ai-qa-wasi/tree/repl

Last updated: Dec 23 2024 at 12:05 UTC