Kim Moir [:kmoir] ET Assignee
	Description • 9 years ago

catlee mentioned that master lag is high (see bug 1049657)

https://www.hostedgraphite.com/da5c920d/86a8384e-d9cf-4208-989b-9538a1a53e4b/grafana/#/dashboard/db/buildbot-masters

It looks we could use some new linux64 and and even linux32 masters

	Rail Aliiev [:rail]
	Comment 4 • 9 years ago

Comment on attachment 8662984 [details] [diff] [review]
bug1205409tools.patch

Review of attachment 8662984 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm. Bonus point for removing trailing spaces. ;)

	Kim Moir [:kmoir] ET Assignee
	Comment 5 • 9 years ago

In production

	Kim Moir [:kmoir] ET Assignee
	Comment 6 • 9 years ago

patch to enable masters once I sort out the failing nagios checks

	Rail Aliiev [:rail]
	Comment 7 • 9 years ago

Comment on attachment 8665103 [details] [diff] [review]
bug1205409enable.patch

\o/

	Kim Moir [:kmoir] ET Assignee
	Comment 8 • 9 years ago

It looks like command_runner.py and pulse_publisher.py do not exist on these masters so there is something else wrong with the puppet config. Investigating.

	Kim Moir [:kmoir] ET Assignee
	Comment 9 • 9 years ago

found problem

must fix script that generates the puppet snippets too

	Kim Moir [:kmoir] ET Assignee
	Comment 10 • 9 years ago

Comment on attachment 8666197 [details] [diff] [review]
bug1205409fixtypo.patch

and merged to production

	Kim Moir [:kmoir] ET Assignee
	Comment 11 • 9 years ago

Comment on attachment 8665103 [details] [diff] [review]
bug1205409enable.patch

I locked some machines to the master yesterday and it looks like the jobs that ran last night were okay.

	Kim Moir [:kmoir] ET Assignee
	Comment 12 • 9 years ago

In production, masters enabled in slavealloc and running jobs. Nagios downtime cancelled.