Service Issue in Vonage API Platform

‌

Date/Time Impacted

From 22:20 UTC until 22:26 UTC on June 23, 2023.

Services Impacted

Voice - Programmable SIP

Voice - Voice API

Voice - TTS

Auth & Identity - Verify

Auth & Identity - Number InsightMessages - Messages API Platform

SMS - SMS Platform

SMS - SMPP

SMS - 10 DLC

Summary

A very high amount of continuous network traffic overloaded our API platform, causing intermittent issues between 22:20 UTC & 22:26 UTC on June 23, 2023.

Root Cause

A sustained influx of network traffic triggered a memory spike in our API platform. This led to problems with resource management in certain components of the network stack causing intermittent issues with Voice, SMS and Verify APIs.

‌

Restoration Actions

Once the excess traffic was under control, the affected components in the network stack recovered and were subsequently monitored to ensure performance and throughput returned to their expected level. 

‌

Next Steps

• Improve resource management on the platform to better respond to high traffic situations
• Review monitoring and mitigation strategies to ensure high traffic events can be addressed appropriately
• Take a defence-in-depth approach to leverage a variety of tools to deploy layers of resource and traffic management to mitigate the impact of high traffic events

‌

‌

We value your feedback and want to do the best we can for you. Please let us know how we did or your ideas for how we can improve our incident communication processes through the following short survey: https://forms.gle/1tm8P2c99mcMP6XA7