Closed Bug 1470066 Opened 6 years ago Closed 6 years ago

t-yosemite-r7-307.test.releng.mdc1.mozilla.com. is unreachable

Categories

(Infrastructure & Operations :: DCOps, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: dhouse, Assigned: van)

References

Details

(Whiteboard: REQ0235359 )

Reboot t-yosemite-r7-307.test.releng.mdc1.mozilla.com. 10.49.56.248
Requested by mozilla-auth0/ad|Mozilla-LDAP|dhouse
Relops controller action failed:
2018-06-21T05:00:27.150548 ssh_reboot -l roller -i ssh.key CommandError
2018-06-21T05:00:27.152964 ipmi ipmi_reset KeyError
2018-06-21T05:00:27.154776 ipmi ipmi_cycle KeyError
2018-06-21T05:05:27.029268 snmp_reboot pdu1.rit41.ops.releng.mdc1.mozilla.com aa8 SoftTimeLimitExceeded
Reboot t-yosemite-r7-307.test.releng.mdc1.mozilla.com. 10.49.56.248
Requested by mozilla-auth0/ad|Mozilla-LDAP|dhouse
Relops controller action failed:
2018-06-22T19:26:56.778917 ssh_reboot -l roller -i ssh.key TimeoutExpired
2018-06-22T19:26:56.781010 ipmi ipmi_reset KeyError
2018-06-22T19:26:56.782571 ipmi ipmi_cycle KeyError
Tried to reboot and reimage it, but it still isn't taking jobs or reappear in the taskcluster list. It is in taskcluster if you manually type the link to it.
Reboot t-yosemite-r7-307.test.releng.mdc1.mozilla.com. 10.49.56.248
Requested by mozilla-auth0/ad|Mozilla-LDAP|dhouse
Relops controller action failed:
2018-06-25T22:02:19.669954 ssh_reboot -l roller -i ssh.key TimeoutExpired
2018-06-25T22:02:19.673444 ipmi ipmi_reset KeyError
2018-06-25T22:02:19.677799 ipmi ipmi_cycle KeyError
Reboot t-yosemite-r7-307.test.releng.mdc1.mozilla.com. 10.49.56.248
Requested by mozilla-auth0/ad|Mozilla-LDAP|zfay
Relops controller action failed:
2018-06-30T19:44:49.472939 ssh_reboot -l roller -i ssh.key TimeoutExpired
2018-06-30T19:44:49.475348 ipmi ipmi_reset KeyError
2018-06-30T19:44:49.478587 ipmi ipmi_cycle KeyError
power cycling didn't work, opened REQ0235359 with QTS for remote hands.
Assignee: server-ops-dcops → vle
Whiteboard: REQ0235359
Reboot t-yosemite-r7-307.test.releng.mdc1.mozilla.com. 10.49.56.248
Requested by mozilla-auth0/ad|Mozilla-LDAP|riman
Relops controller action failed:
2018-07-02T22:59:10.265874 ssh_reboot -l roller -i ssh.key TimeoutExpired
2018-07-02T22:59:10.269688 ipmi ipmi_reset KeyError
2018-07-02T22:59:10.271333 ipmi ipmi_cycle KeyError
this one came back online.

vle@DESKTOP-3HK51T3:~$ fping t-yosemite-r7-307.test.releng.mdc1.mozilla.com                                                                      
t-yosemite-r7-307.test.releng.mdc1.mozilla.com is alive
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.