Stream: git-wasmtime

Topic: wasmtime / PR #12044 Support Nvidia-Cuda execution provid...

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 opened PR #12044 from zhen9910:zkong/update-ort-and-onnx-gpu to bytecodealliance:main:

As discussed in https://github.com/bytecodealliance/wasmtime/issues/8547, the existing wasi-nn onnx backend only uses the default CPU execution provider. This PR updated the onnxruntime crate ort to 2.0.0-rc.10 with improved cuda support and added onnx-cuda based wasi-nn GPU execution target in wasmtime-wasi-nn onnx backend.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested wasmtime-wasi-reviewers for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested fitzgen for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 18 2025 at 20:04):

zhen9910 requested wasmtime-default-reviewers for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 00:03):

zhen9910 updated PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 12:31):

devigned commented on PR #12044:

Looks like the bump to ort caused cargo vet to be angry, which is to be expected.

+1 to the addition of GPU support for the ONNX backend \o/

@abrown, you might be interested in this one.

view this post on Zulip Wasmtime GitHub notifications bot (Nov 19 2025 at 20:51):

fitzgen requested abrown for a review on PR #12044.

view this post on Zulip Wasmtime GitHub notifications bot (Dec 10 2025 at 20:13):

zhen9910 commented on PR #12044:

@abrown could you please review the PR and add the cargo vet entries?

view this post on Zulip Wasmtime GitHub notifications bot (Dec 11 2025 at 12:13):

alexcrichton commented on PR #12044:

@abrown is in the process of handing off wasi-nn maintenance/work to @jlb6740 and @rahulchaphalkar so as a heads up this might take a moment @zhen9910 to allocate time to work on it.

view this post on Zulip Wasmtime GitHub notifications bot (Dec 11 2025 at 18:54):

zhen9910 commented on PR #12044:

@abrown is in the process of handing off wasi-nn maintenance/work to @jlb6740 and @rahulchaphalkar so as a heads up this might take a moment @zhen9910 to allocate time to work on it.

I see, thanks for update

Last updated: Jan 10 2026 at 02:36 UTC