akirilov-arm opened PR #2994 from aarch64_tests
to main
:
These changes are partially in support of #2960. With them the tests run on AArch64 should be the same as those executing on x86-64, except for a couple that are specific to the latter platform, 3 that fail under QEMU, and some CLIF tests missing the
target aarch64
directive.
alexcrichton submitted PR review.
alexcrichton created PR review comment:
Oh we've actually already got another env var for indicating that qemu is in use and virtual memory should be limited as a result, perhaps that would suffice for this test too?
alexcrichton submitted PR review.
alexcrichton created PR review comment:
I think this can probably remove the
#[cfg]
now? (it's probably best to keep a "know failing list" rather than a known passing list)
akirilov-arm submitted PR review.
akirilov-arm created PR review comment:
Since the CI tests are only on AArch64 and x86-64, that's what I did initially, but then I decided to make it easier for other platforms (and with QEMU it should be straightforward in principle to add s390x tests, for example).
I am happy to go for either approach (and what you say about a known failing list makes sense), but I think I will need to keep some of these tests disabled because right now they seem to fail due to memory exhaustion (everything passes when I run it natively on my AArch64 development machine).
akirilov-arm edited PR review comment.
akirilov-arm submitted PR review.
akirilov-arm created PR review comment:
Thanks, checking it instead should be more robust in case we decide to test on other platforms with QEMU.
alexcrichton submitted PR review.
alexcrichton created PR review comment:
Personally I prefer to get failures rather than silent passing on new architectures, and most of the test suite will already fail if you try to test wasmtime on a mips machine for example. Now that being said if these get switched to an ignore for s390x that seems reasonable!
(it's relatively easy to grep for
TODO.*s390x
or something similar whereas it's a bit more unclear to search for something that only runs for other platforms)
akirilov-arm submitted PR review.
akirilov-arm created PR review comment:
grep -R cfg.*ignore
was my approach :).
alexcrichton submitted PR review.
alexcrichton created PR review comment:
Heh true! Well either way doesn't matter too much to me, so I'm happy to do whatever you feel is best
uweigand submitted PR review.
uweigand created PR review comment:
According to the comment, the reason these were disabled are reference types, but we do in fact fully support reference types on s390x, so those should probably just work ...
uweigand submitted PR review.
uweigand created PR review comment:
... and I just verified the tests do indeed pass on s390x when enabled.
akirilov-arm submitted PR review.
akirilov-arm created PR review comment:
@uweigand What about the general question - should the tests be ignored or left to fail? E.g. if reference types weren't supported by the s390x backend, from your perspective would it have been preferable to keep a directive here to ignore the tests or not?
uweigand submitted PR review.
uweigand created PR review comment:
I think ignore by default is never a good idea. They should fail by default, and then can be set to ignore on a one-by-one basis per test/platform after analysis. (Then you can at least grep for your platform name to find a list of tests you still need to work on.)
akirilov-arm updated PR #2994 from aarch64_tests
to main
.
uweigand submitted PR review.
uweigand created PR review comment:
I just ran into this problem on s390x under QEMU as well. Shouldn't we just unconditionally ignore the pooling tests on all platforms if platform_is_emulated() is true?
akirilov-arm updated PR #2994 from aarch64_tests
to main
.
akirilov-arm requested alexcrichton for a review on PR #2994.
alexcrichton submitted PR review.
alexcrichton submitted PR review.
alexcrichton created PR review comment:
Could this use
(
and)
to group the latter condition here? I never remember the precedences of||
and&&
...
alexcrichton created PR review comment:
Could this check get moved to a helper function in
tests/all/gc.rs
to avoid duplicating the env var name too much?
akirilov-arm updated PR #2994 from aarch64_tests
to main
.
akirilov-arm requested alexcrichton for a review on PR #2994.
alexcrichton merged PR #2994.
Last updated: Nov 22 2024 at 17:03 UTC