On the night from Friday, April 30 to Saturday, May 1 (CEST), we’ve encountered an issue with 2 new network switches.
This led to an interruption of the traffic in one of our data centers, which impacted several services, and a delay in part of the SMS traffic. This is likely a result of an unusually high peak in our network traffic, caused by a load test we performed. In the course of the night, the issue was solved, after which we needed Saturday morning to restore all impacted services in a controlled way.
Due to this unique turn of events and multiple technicians being involved, it will take some additional weeks to come to the definitive root cause. We perform this analysis together with the network switch supplier, in the meantime, we have taken the proper precautions to ensure a similar interference will not occur.