DC1 power failure
Wednesday, February 10th, 2010 5:27AM EST
Data center #1 experienced a power failure on one of the PDUs within our cabinets. The downtime occurred at approximately 1:30AM EST. The power was lost in the cabinet in which controls our firewalls and core routers. As any proper setup, we have a redundant (what’s called N+1 in network speak) setup. The issue was the primary firewall lost power and the backup firewall did not become active. We are investigating the issue and will schedule downtime in the future to test and determine what was the root cause. We will ensure this does not happen in the future and we apologize for any issue this may have caused.
Thank you for promptly resolving this issue. Very much appreciated. -Tantek
[...] PM EST – 12 AM EST data center #1 may experience some downtime. This is to investigate the downtime that occurred two weeks ago. The downtime should be intermittent, and each downtime should last no more than 5 minutes [...]