On January 11 at 01:12 UTC, Symantec VIP users may have experienced timeouts using the following services: VIP Manager, Authenticate User API, and VIP Self-Service Portal (SSP). The issue corrected itself by 02:50 UTC and the VIP services returned to normal operation.
We are actively investigating an internal networking error and preliminary corrective actions have been taken to prevent reoccurrence of this issue while the investigation is still ongoing. A full RCA will be provided to affected customers by the end of business on January 19, 2018.
The investigation into the issue continues. We have completed an analysis of the application servers and found no issues at this level, nor did we see a slow down on the time taken to process a request on the application level. However, our monitors indicated there was a load balancer failover due to a missed health check which terminated some inflight transactions. We have proactively tuned our network infrastructure to mitigate the issue, preventing the health check from failing prematurely, as we continue to investigate the root cause of the missed health check.