impact :
- manager and apiv6 is down
- openstack api is down
We are working on this issue. Fix is in progress.
Update(s):
Date: 2017-08-07 13:07:38 UTC ALL régions are now UP.
Keystone is still stable.
We are keeping a close eye on the infrastructure.
Date: 2017-08-07 12:26:51 UTC SBG1 is up
GRA3 is up
responses times are OK.
Keystone is stable
Date: 2017-08-07 12:16:23 UTC We did identify an issue that was impacting a lot keystone response-time on token validation.
As now the infra is ok, we are now Rolling out other regions
Date: 2017-08-07 11:59:13 UTC We are still bringing back SBG1 nova API. We identified the same issue as before, impacting keystone.
We managed to contain it, and are now investigating so it does not impact us any more.
Swift is still up everywhere, and instances are properly running. Only API is impacted
Date: 2017-08-07 11:08:17 UTC SBG3 is UP
Date: 2017-08-07 10:56:31 UTC Swift is now UP on all regions
Date: 2017-08-07 10:52:44 UTC We managed to isolate the impacted services. We are bringing back the other services one by one.
Swift first
Date: 2017-08-07 10:43:40 UTC Load average is very high on keystone. It's not directly link with waw1 prodding.
Team Keystone working on this issue.
Date: 2017-08-07 09:42:48 UTC We are a issue with on validation on token. Keystone team working on this issue to resolved it.