Closed Bug 974156 Opened 10 years ago Closed 6 years ago

Abort Marionette testrun if we get more than 4 connection timeouts (in a row?)

Categories

(Remote Protocol :: Marionette, defect, P3)

defect

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: jgriffin, Unassigned)

References

(Depends on 1 open bug)

Details

(Keywords: pi-marionette-runner, Whiteboard: [runner])

Mochitest testruns get aborted if more than 4 tests time out.  We should consider something similar for Marionette.

Currently, in bug 971884, we're seeing a bunch of connection timeouts in gaiatest, which is causing the test run to go on for so long that buildbot kills it.  When this happens, we can't see gecko.log, and so have no idea what's really going on.

We should probably terminate a test run if we get 4 connection timeouts, or at least 4 connection timeouts in a row.  Possibly, we'd want to modify this behavior for long-running tests, so maybe something like a --max-timeouts argument would be appropriate.
Blocks: 971884
Bug 960436 will address the pipework required to let you have this behaviour. It will allow us to register handlers that will let you do some function X after Y failures of type Z has been seen. Once Bug 960436 is resolved, we can add specific handlers for gaiatest.
Depends on: 960436
Whiteboard: [runner]
[mass update] Setting Harness bugs to all P3
Priority: -- → P3
We will probably never do this considering it is not a current problem.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WONTFIX
Product: Testing → Remote Protocol
You need to log in before you can comment on or make changes to this bug.