Stream: git-wasmtime

Topic: wasmtime / PR #15056 wasi-nn: support all tensor types fo...

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird opened PR #15056 from ChihweiLHBird:wasi-nn-onnx-input-types to bytecodealliance:main:

The ONNX backend can decode only f32 input tensors. For other types, compute returns UnsupportedTensorType, so models that take i64 token IDs cannot run.

This change decodes input tensors of all seven wasi-nn tensor types with one generic helper. For f16 and bf16, it turns on the half feature of ort and adds half as a dependency. half 2.4.1 is already in Cargo.lock, so no new crate comes in. The setup step now also accepts models with f16 and bf16 tensors. The change also removes bytes_to_f32_vec, which has no users now.

Outputs are still f32 only. That can be a follow-up.

CI does not run the wasi-nn tests. To run the new unit tests:

cargo test -p wasmtime-wasi-nn --features onnx-download --lib

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird removed the review request for wasmtime-wasi-reviewers from PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird requested rvolosatovs for a review on PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird requested wasmtime-wasi-reviewers for a review on PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird requested fitzgen for a review on PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird removed the review request for wasmtime-default-reviewers from PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:42):

ChihweiLHBird requested wasmtime-default-reviewers for a review on PR #15056.

Wasmtime GitHub notifications bot (Oct 29 2026 at 06:47):

ChihweiLHBird commented on PR #15056:

CC: @rahulchaphalkar

Wasmtime GitHub notifications bot (Oct 30 2026 at 01:04):

ChihweiLHBird commented on PR #15056:

CC: @alexcrichton

Last updated: Oct 31 2026 at 23:03 UTC