Stream: git-wasmtime

Topic: wasmtime / PR #5928 fuzzgen: Add invalid input counter

Wasmtime GitHub notifications bot (Mar 04 2023 at 19:52):

afonso360 opened PR #5928 from fuzzgen-fail-counter to main:

:wave: Hey,

This is a followup to a suggestion that @jameysharp pointed out in https://github.com/bytecodealliance/wasmtime/pull/5820#pullrequestreview-1304302471. With the refactoring done there we can now count how many inputs we reject.

This is great since we can at least keep track of this and hopefully improve it in the future. Right now it isn't great at about 74% rejected inputs:

== FuzzGen Statistics  ====================
Valid Inputs: 130000
Invalid Inputs: 373838 (74.2% of Total Inputs)
Total Runs: 705910
Successful Runs: 690177 (97.8% of Total Runs)
Timed out Runs: 8247 (1.2% of Total Runs)
Traps:
        user code: int_divz: 6448 (0.9% of Total Runs)
        user code: int_ovf: 566 (0.1% of Total Runs)
        user code: bad_toint: 472 (0.1% of Total Runs)

Wasmtime GitHub notifications bot (Mar 04 2023 at 19:52):

afonso360 requested jameysharp for a review on PR #5928.

Wasmtime GitHub notifications bot (Mar 04 2023 at 20:06):

alexcrichton submitted PR review.

Wasmtime GitHub notifications bot (Mar 04 2023 at 22:05):

afonso360 merged PR #5928.

Last updated: Dec 23 2024 at 12:05 UTC