Closed Bug 1164441 Opened 9 years ago Closed 9 years ago

nagios alert for free ips in amazon

Categories

(Infrastructure & Operations :: RelOps: General, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: catlee, Assigned: arich)

Details

(Whiteboard: [nagios])

Attachments

(2 files)

We've divided up our AWS VPCs into subnets, each subnet for a certain type of machines loosely corresponding to vlans (e.g. build, test, servers, etc.)

If we have very few or no free IPs in a subnet, that means we can't create new machines there.

We need a nagios check that alerts us if we're running low on available IPs per class of subnet, per region (or AZ).
Attachment #8606304 - Flags: review?(rail)
Attachment #8606304 - Flags: review?(rail)
Attachment #8606304 - Flags: review+
Attachment #8606304 - Flags: checked-in+
So we need a nagios check that runs:

/builds/aws_manager/bin/python /builds/aws_manager/cloud-tools/scripts/aws_check_subnets.py -r us-east-1 -r us-west-2 -s test -s try -s build
This adds in a custom nagios check to call the script that catlee wrote. This script shoud run as the user buildduty for credential purposes.

I've also modified the sudoers::custom manifest as well so that it takes three arguments, user, runas, and command. This gives us the flexibility to run commands as users other than root.
Assignee: relops → arich
Attachment #8626676 - Flags: review?(dustin)
Attachment #8626676 - Flags: review?(dustin) → review+
Attachment #8626676 - Flags: checked-in+
I added a nagios check for every 300 seconds, since this isn't something we're likely to hit with great rapidity unless something else is going wrong as well.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: