Ryan VanderMeulen [:RyanVM] Reporter
	Description • 10 years ago

https://treeherder.mozilla.org/ui/logviewer.html#?job_id=561077&repo=mozilla-central
https://treeherder.mozilla.org/ui/logviewer.html#?job_id=734953&repo=b2g-inbound

Etc. All trees closed.

	Chris Cooper [:coop] (he/him)
	Comment 1 • 10 years ago

I see an obvious network blip this morning at 9:50am PT, which corresponds well to this bug. It seems to have affected just about everything:

use1:

http://netops2.private.scl3.mozilla.com/smokeping/sm.cgi?displaymode=n;start=2014-10-30%2007:32;end=now;target=Datacenters.RELENG-SCL3.nagios1-releng-use1~admin1b.private.releng.scl3.mozilla.com

scl3:

http://netops2.private.scl3.mozilla.com/smokeping/sm.cgi?displaymode=n;start=2014-10-30%2007:30;end=now;target=Datacenters.RELENG-SCL3.fw1-releng-scl3~admin1b.private.releng.scl3.mozilla.com

That same graph shows another similar blip at 7:50am PT. I think it's safe to re-open the trees at this point, but I'll be watching the graphs at 11:50am PT to see whether we have a repeat performance.

	Chris Cooper [:coop] (he/him)
	Comment 2 • 10 years ago

Here's a better look at the ubiquity:

http://netops2.private.scl3.mozilla.com/smokeping/sm.cgi?target=Datacenters.RELENG-SCL3

I've pinged netops.

	Ryan VanderMeulen [:RyanVM] Reporter
	Comment 3 • 10 years ago

Things seem to be in better shape now. Trees reopened.

	:kanban-engops
	Comment 4 • 10 years ago

A Pivotal Tracker story has been created for this Bug: https://www.pivotaltracker.com/story/show/81855346

	:kanban-engops
	Comment 5 • 10 years ago

A Pivotal Tracker story has been created for this Bug: https://www.pivotaltracker.com/story/show/82064742