OVHcloud Web Hosting Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
PrivateSQL P19
Incident Report for Web Cloud
Resolved
Nous rencontrons un problème sur notre infrastructure à P19. Les PrivateSQL hébergés sur ce datacentre sont impactés.

---

We have an issue on our infrastructure on P19. The PrivateSQL hosted on this datacentre are impacted.

Update(s):

Date: 2019-08-23 21:52:03 UTC
Completed. The platform is stable.

Date: 2019-08-23 20:00:19 UTC
50% done

Date: 2019-08-23 19:14:06 UTC
Servers impacted by this issue have a high probability of crashing until they have been rebooted in a specific way: the services and the OS have to restart softly, but the \"shell\" of the VM (qemu process...) has to be rebuilt.
So we will reboot the PrivateSQL of P19. A 1 to 5 minutes downtime is expected.

Date: 2019-08-23 10:30:45 UTC
Almost all server are back online.

Date: 2019-08-23 10:10:25 UTC
Ceph cluster is back online, servers are recovering.

Date: 2019-08-23 08:21:06 UTC
Ceph cluster is still being recovered (about 94%)

Date: 2019-08-23 06:46:44 UTC
Ceph cluster is still being recovered (about 82%).

Date: 2019-08-23 06:17:32 UTC
Ceph cluster is still being recovered (about 70%).

Date: 2019-08-23 05:51:37 UTC
Linked issues:
- http://travaux.ovh.net/?do=details&id=40178

Ceph cluster is being recovered (2 instances of data is needed at least for the Ceph cluster to accept Ios).
When the Ceph cluster will be UP, we will restart the PCI infrastructure.
When the PCI infrastructure will be UP, we will restart the services.
Posted Aug 23, 2019 - 05:23 UTC
This incident affected: Web Hosting || Datacenter GRA (Cluster002, Cluster003, Cluster006, Cluster007, Cluster011, Cluster012, Cluster013, Cluster014, Cluster015, Cluster017, Cluster020, Cluster021, Cluster023, Cluster024, Cluster025, Cluster026, Cluster027, Cluster028, Cluster029, Cluster030, Cluster031).