Stream: git-wasmtime

Topic: wasmtime / PR #12044 Support Nvidia-Cuda execution provid...

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 opened PR #12044 from zhen9910:zkong/update-ort-and-onnx-gpu to bytecodealliance:main:

As discussed in https://github.com/bytecodealliance/wasmtime/issues/8547, the existing wasi-nn onnx backend only uses the default CPU execution provider. This PR updated the onnxruntime crate ort to 2.0.0-rc.10 with improved cuda support and added onnx-cuda based wasi-nn GPU execution target in wasmtime-wasi-nn onnx backend.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested wasmtime-wasi-reviewers for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested fitzgen for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested wasmtime-default-reviewers for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 00:03):

zhen9910 updated PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 12:31):

devigned commented on PR #12044:

Looks like the bump to ort caused cargo vet to be angry, which is to be expected.

+1 to the addition of GPU support for the ONNX backend \o/

@abrown, you might be interested in this one.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 20:51):

fitzgen requested abrown for a review on PR #12044.

Last updated: Dec 06 2025 at 06:05 UTC