Mats Palmgren (inactive) Reporter
	Description • 8 years ago

It takes ~24 hours to get reftest results on "Windows 8 x64 opt" on Try.
That's way too long to be acceptable.

It appears that the delay is caused by waiting for the jobs to be scheduled:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=35578c84e646&selectedJob=17843541
Click on the orange "R" at the link:
Requested: Wed Mar 9, 21:45:04
Started: Thu Mar 10, 17:21:32
Ended: Thu Mar 10, 17:48:18

	Kim Moir [:kmoir] ET
	Comment 1 • 8 years ago

I wonder if we should turn off win8 but default on try until we address our capacity issues

	Ryan VanderMeulen [:RyanVM]
	Comment 2 • 8 years ago

Effectively, we're already not running tests on Win8 on Try in the sense that I'd be willing to bet that many/most of our developers aren't waiting for results on that platform before just pushing and hoping for the best. However, I'm not crazy about outright making that decision given Win8 is our only 64-bit Windows test coverage, but I'm also not sure what the actual effects would be of doing so.

Do we often see issues on Win8 that don't happen on Win7? I'd be curious to know how often we hit XP bustage these days that got missed because of lack of default Try coverage.

	Chris AtLee [:catlee] Assignee
	Comment 3 • 8 years ago

Another option is to move some XP capacity over to Win8.

	Mats Palmgren (inactive) Reporter
	Comment 4 • 8 years ago

If anyone have the powers to manually force the scheduling of the following reftest, 
that would be most appreciated:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=8a7b56c74f22

	Phil Ringnalda (:philor)
	Comment 5 • 8 years ago

Someone already did (or your 14 hour number came up), but you do yourself have the power: downarrow menu at the upper right of the push on treeherder, "BuildAPI", [run me sooner] button on any pending job.

	Vlad Ciobancai [:vladC] [:vciobancai]
	Comment 6 • 8 years ago

(In reply to Chris AtLee [:catlee] from comment #3)
> Another option is to move some XP capacity over to Win8.

There are 13 windows 8 servers used for windows 10 tests. I do not know if there are used, if not, we can add them in to the production

	Kim Moir [:kmoir] ET
	Comment 7 • 8 years ago

We have moved 10 XP machines over to the Windows 8 pool (bug 1255812), but still have high pending counts for windows 8.  Should we reconsider turning off Win8 by default on try?  

Currently
3025 pending jobs on win8, 2996 of those are on try

	Chris AtLee [:catlee] Assignee
	Comment 8 • 8 years ago

Review commit: https://reviewboard.mozilla.org/r/54278/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/54278/

	Rail Aliiev [:rail]
	Comment 9 • 8 years ago

Comment on attachment 8754855 [details]
MozReview Request: Bug 1255533 - Disable win8 by default on try r=rail

https://reviewboard.mozilla.org/r/54278/#review50950

	Release Engineering SlaveAPI Service
	Comment 10 • 8 years ago

In production: https://hg.mozilla.org/build/buildbot-configs/rev/5f7d99a176f1

	Phil Ringnalda (:philor)
	Comment 15 • 8 years ago

Don't forget the part about adding the "disabled when not explicitly checked" (or "explicity" if you like the 10.6 spelling better) to trychooser, to give us that warm feeling of being covered when people start yelling about being backed out for Win8-only failures.

	Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)
	Comment 16 • 8 years ago

Something like this?

	Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)
	Comment 17 • 8 years ago

Now with more 'l's!

	Phil Ringnalda (:philor)
	Comment 18 • 8 years ago

No l lovin' for 10.6?

	Daniel Holbert [:dholbert]
	Comment 19 • 8 years ago

[ni=kwierso to land that TryChooser "disabled when not explicitly checked" patch.]

	Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)
	Comment 20 • 8 years ago

Whoops, forgot to do that. Fixed the other 'explicity's while I was at it.
https://hg.mozilla.org/build/tools/rev/154c6052d713

	Rail Aliiev [:rail]
	Comment 21 • 8 years ago

Loks like we are done here