Extend timeout on WebGPU CTS tests to x5.0
Categories
(Core :: Graphics: WebGPU, task, P1)
Tracking
()
People
(Reporter: ErichDonGubler, Assigned: teoxoy)
References
Details
Attachments
(5 files, 1 obsolete file)
:teoxoy and I were suspicious that WebGPU CTS tests would Just Run To Completion™ if we extended the WPT timeout windows by a sufficient amount. The Chromium team publishes (very) rough timing data for their WebGPU test runs
It turns out, if we match our current WPT long timeouts' to the worst case observed in Chromium by setting a --timeout-multipler=5.0
in invocations to wptrunner
, the vast majority of tests Just Run Right™. So, we're filing a patch stack to expose and use the timeout multiplier properly, adjust expected WPT test outcomes for WebGPU CTS, and then promote perma-PASS
ing tests on all platforms to tier 2 (as we've been doing with other CTS tests).
Reporter | ||
Updated•1 month ago
|
Reporter | ||
Comment 1•1 month ago
|
||
Reporter | ||
Comment 2•1 month ago
|
||
Updated•1 month ago
|
Reporter | ||
Comment 3•1 month ago
|
||
Reporter | ||
Comment 4•1 month ago
|
||
Assignee | ||
Comment 5•1 month ago
|
||
Reporter | ||
Comment 6•1 month ago
|
||
:teoxoy's prototypical Try push that proved that we got very interesting results, with ~400 intermittents on Windows[^1]: try:46d3500fb3c3
First Mega Serious™ Try push that actually tries to do this in a landable way: try:4ec08f6bd1a0
[^1]: Other platforms have similar results, but Windows is our team's current focus. 🙂
Comment hidden (obsolete) |
Comment hidden (obsolete) |
Updated•1 month ago
|
Comment hidden (obsolete) |
Reporter | ||
Comment 10•1 month ago
|
||
Reporter | ||
Updated•1 month ago
|
Updated•1 month ago
|
Comment 11•1 month ago
|
||
Pushed by egubler@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/6be3328e38a0 feat(wpt): expose `--timeout-multiplier` in `mozharness` r=webgpu-reviewers,teoxoy https://hg.mozilla.org/integration/autoland/rev/ec4906410b70 test(webgpu): set `--timeout-multiplier=5.0` for CTS r=webgpu-reviewers,teoxoy https://hg.mozilla.org/integration/autoland/rev/58dc9170f7e5 test(webgpu): `update-expected --preset reset-all` for `try:46d3500fb3c3346d4fc7b66e24cfb1d17a4231ce` r=webgpu-reviewers,teoxoy
Comment 12•1 month ago
|
||
bugherder |
Comment hidden (obsolete) |
Reporter | ||
Comment 14•1 month ago
|
||
Try push 5: try:57ff5cc81725
Reporter | ||
Updated•1 month ago
|
Comment hidden (obsolete) |
Comment 16•1 month ago
|
||
Pushed by egubler@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/ceb8667d6fc2 test(webgpu): promote long tests to tier 2 r=webgpu-reviewers,teoxoy
Comment 17•1 month ago
|
||
bugherder |
Reporter | ||
Updated•1 month ago
|
Description
•