Following a routine maintenance on a passive firewall of OSP infrastructure, traffic has been cut since 15:20 pm CET.
We investigate on the root cause.
Update(s):
Date: 2017-11-23 09:20:24 UTC Problem identified in our custom kernel.
Kernel patched and deployed, HA did its job.
We will hardened our staging tests to avoid a similar problem in the future.
Date: 2017-11-13 16:19:09 UTC The infrastructure is in a stable state, the incident only impacted the accessibility to the service.
We gathered the logs from the systems and the HA stack in use.
We have several scenarios to test before reactivating this stack.
Then we will operate a possibly service disruptive maintenance during a night in the near future.
Date: 2017-11-13 15:12:38 UTC We upped the service at 16:05, we are still investigating.
Posted Nov 13, 2017 - 14:56 UTC
This incident affected: Corporate websites || Corporate websites.