Categories: Development

Downtime Post-mortem

Late last night we suffered a major outage lasting four hours (7 AM – 11AM UTC). Our hosting provider (rackspace) was doing a routine maintenance job to patch our database server for a potential security vulnerability (GHOST), but after the maintenance the server failed restart properly. We ended up needing to restore our database on a new server from a backup that was taken one hour prior to the outage. So unfortunately, anything logged by users between 6AM and 7AM UTC has been lost and will need to be re-entered.

admin :

View Comments (2)

  • A few minutes ago (~11:30 AM Central), cronometer.com was automatically redirecting me to a malware site (redacted). Right now it's no longer doing so.

    • Hi Michael,

      I've examined all of our web servers and there is no evidence of any sort of compromise. Maybe your own machine or your router / ISP was hacked?