Gustavo Jardim (Dec 05 2025 at 18:30): Gustavo Jardim (Dec 05 2025 at 18:30):hi everyone, sorry, this is my first message here so I am not sure if I am on the right channel. But I would like to understand if WASM + wasmtime offers GPU support? I would like to develop a simple object detection service that leverages my gpu (5060 ti), and it needs to be compiled to wasm
Notification Bot (Dec 05 2025 at 18:48):A message was moved here from #wasmtime > CLI Argument Options by Alex Crichton.
Alex Crichton (Dec 05 2025 at 18:49):Wasmtime out-of-the-box has support for wasi-nn, but whether that's what you're looking for would require someone more knowledgable than I to investigate. There's also wasi-gfx historically which has had Wasmtime support too, but that's not in bytecodealliance/wasmtime the-repo.
Gustavo Jardim (Dec 05 2025 at 18:50):Ok, thanks, I'll look into it!
Chris Fallin (Dec 05 2025 at 18:50):To give a few links: wasi-gfx defines some interfaces for this, and there is the wasi-gfx-runtime reference implementation
Chris Fallin (Dec 05 2025 at 18:51):You haven't said anything about your environment and the "needs to be compiled to Wasm" requirement, so whether the above is viable depends on whether you are choosing your runtime (hence can choose the above) or have to deliver a portable Wasm module that works "anywhere"
Gustavo Jardim (Dec 05 2025 at 18:53):Got it. Yeah, that's the only thing that's strict, to be compiled to WASM, simply that. The runtime is up to me
Gustavo Jardim (Dec 05 2025 at 18:57):Aditionally, I'll be running ML inference models for the object detection. The best shot I've seen so far documented on the internet + AI search was wasmtime + wasi-nn + libtorch (pytorch). I am trying that but didn't have success so far.
Last updated: Dec 06 2025 at 06:05 UTC