Stream: git-wasmtime

Topic: wasmtime / PR #14775 Guest debugging: add support for wat...


view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 19:30):

cfallin opened PR #14775 from cfallin:the-watchpoints-are-watching-you to bytecodealliance:main:

Fixes #12188.

With guest debugging enabled, every linear memory now has a 1-to-1 shadow memory. This shadow stores, for every byte, a byte of flags. The one currently defined flag is a "write watchpoint" flag, which causes a guest-debug event to be emitted whenever the corresponding memory byte is written to.

Compiled guest code's store instructions, memory.fill, memory.copy, and memory.init will all hit a write watchpoint. Right now, external (host-API) writes to memories do not. Shared memories, and the linear memories underlying GC heaps, are not watched.

Shadow memories, like ordinary linear memories, are defined by a VM struct that contains a base pointer; when a memory is imported by another instance within a store, it gets a pointer to this VM struct as well. This single base pointer location allows the shadow memory to grow when the corresponding linear memory does.

Memory::debug_watch in the host API watches or unwatches a byte range, and a write to a watched byte raises DebugEvent::Watchpoint with the memory, address, length, and (for stores) value, before the write happens.

The debugger crate reports these as DebugRunResult::Watchpoint, and its WIT API now has memory.add-watchpoint/remove-watchpoint methods and a watchpoint event.

Supported is added in the gdbstub adapter for these watchpoints as well.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 19:30):

cfallin requested alexcrichton for a review on PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 19:30):

cfallin requested wasmtime-core-reviewers for a review on PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 19:30):

cfallin requested wasmtime-compiler-reviewers for a review on PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 20:47):

github-actions[bot] added the label wasmtime:api on PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 20:47):

github-actions[bot] added the label wasmtime:config on PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 15 2026 at 21:46):

github-actions[bot] commented on PR #14775:

Label Messager: wasmtime:config

It looks like you are changing Wasmtime's configuration options. Make sure to
complete this check list:

[fuzzing-config]: https://github.com/bytecodealliance/wasmtime/blob/ca0e8d0a1d8cefc0496dba2f77a670571d8fdcab/crates/fuzzing/src/generators.rs#L182-L194
[fuzzing-docs]: https://docs.wasmtime.dev/contributing-fuzzing.html


<details>

To modify this label's message, edit the <code>.github/label-messager/wasmtime-config.md</code> file.

To add new label messages or remove existing label messages, edit the
<code>.github/label-messager.json</code> configuration file.

Learn more.

</details>

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:16):

:memo: fitzgen submitted PR review:

Overall, looks reasonable to me, but I'm a little unsure about the bounds checking for shadow memories. Can you verify that out of bounds wasm stores and bulk memory libcalls don't result in out of bounds loads from the shadow memory, regardless whether we have guard pages configured or not? Probably good to have a test for this too. Also, double checking: do we turn debugging on randomly in the fuzzer config? Would want to make sure that this also gets enabled randomly through that in our fuzzing.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:16):

:speech_balloon: fitzgen created PR review comment:

Maybe assert that the given value's type is an integer and is less than or equal to 64 bits wide?

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:16):

:speech_balloon: fitzgen created PR review comment:

Why two explicit 64-bit loads instead of an i128 load?

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:16):

:speech_balloon: fitzgen created PR review comment:

How does bounds checking work for these shadow memories? Are they guaranteed to have the same guards and movable/immovable base pointers as normal memories? Seems like a good thing to document here.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:58):

:memo: cfallin submitted PR review.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 20:58):

:speech_balloon: cfallin created PR review comment:

The basic idea is that we always probe the main memory first, even on a store; so we cannot reach the shadow memory access until we've validated that the access is in-bounds (and then the shadow memory is grown along with the memory it shadows so it's always the same size).

The libcalls that also can hit watchpoints (for bulk ops) do explicit bounds-checks before accessing.

I'll add a comment!

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 21:00):

:memo: cfallin submitted PR review.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 16 2026 at 21:01):

:speech_balloon: cfallin created PR review comment:

We do a brif on the result, so I think the goal here was to try to avoid a brif on an i128 (instead OR'ing the halves together); but we have a lowering case for that so I should just use it. Will fix.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 19 2026 at 18:04):

:memo: alexcrichton submitted PR review:

At a high level, could this integrate with the normal memory allocator? It feels a bit odd to forcibly use malloc to allocate these memories and also perhaps a performance hazard waiting to happen. Fuzzing-wise I'm also not certain of this where we more-or-less rely on the fuzzer not seeing the memory allocation of linear memories because otherwise large reservations would immediately OOM.

I'm also personally always wary of adding more paths to do more things related to memory -- it's a pretty security/correctness critical part so I'd favor reuse of existing primitives over the creation of new ones.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 19 2026 at 18:33):

cfallin commented on PR #14775:

(Getting back to this now after the weekend, haven't addressed Nick's comments yet, sorry)

At a high level, could this integrate with the normal memory allocator?

I can definitely explore this direction more; my own early thoughts on that, though, were that it might break many more invariants (the defined-memories index space would no longer correspond to Wasm's memory index space above the imports).

perhaps a performance hazard waiting to happen

My thoughts were (IMHO at least): it's not a concern for debugging-enabled configs: such a config is already going to be pretty slow (due to the instrumentation), moreso with a "watchpoint barrier" at every store. I would, for example, definitely not want to try to integrate watchpoints with the pooling allocator if it takes explicit extra work to do that, because such a config feels like an antipattern to me: one should not need to optimize instantiation time when one is doing interactive debugging with wasmtime-cli and expects more-or-less one instantiation for the process lifetime. So it's additional configation testing surface that doesn't actually serve a user need (again IMHO).

Happy to be convinced otherwise though! And I'm very sympathetic to "don't add special cases" so maybe it's actually easier to just ride along with the configured allocator. I'll play with it some more.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 19 2026 at 19:30):

alexcrichton commented on PR #14775:

I was thinking more like what you have now where a memory points to another memory and it's got a special area in the VMContext for shadow memories -- I'd agree that changing the meaning of defined memories would probably wreak havoc everywhere. My rough and probably naive idea is that the normal instance allocator could be used to allocate shadow linear memories instead of malloc. That'd then be stored within the "main" linear memory as the shadow memory is today, and the main advantage would be that it'd integrate with all the other existing subsystems/etc we have by default.

My main worry is that by adding a new thing on the side we'll end up needing features for that over time and/or have bugs about how its subtly different from the "other thing". For example having to be so careful here about validating bounds checks already has me a bit worried, although I don't see any concrete issue doing a load first and then looking at the shadow memory (we can say we actually fix the store-across-two-pages-but-the-second-is-invalid problem!). If it's too onerous to implement this though it's probably not worth pursuing as it's all scoped ideally to debug-mode-only anyway.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 26 2026 at 23:46):

cfallin updated PR #14775.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 26 2026 at 23:48):

cfallin commented on PR #14775:

OK, I've refactored things so that shadows are built on top of a standard linear memory now. This does mean that, in explicit-bounds-check mode (which we always use during debugging, because we don't support signal-based traps), there are two separate bounds checks of two logically separate memories on every store (the watchpoint shadow read, then the actual write). I guess this is probably fine; later if we want we could try to add a "this linear memory is always the same size as that one" invariant, share a length field, and let compiler opts elide the redundant bounds-checks, but that seems like a lot right now. Alternately we could add a "trust me bro, I would have trapped by now" mode flag to the bounds-check lowering and reimplement the load-real, load-shadow, store-real sequence in this new setup but it doesn't seem worthwhile either.

view this post on Zulip Wasmtime GitHub notifications bot (Oct 26 2026 at 23:58):

cfallin updated PR #14775.


Last updated: Oct 31 2026 at 23:03 UTC