Incident Statement - Voice - Quality Degradation to PSTN
Date/Time Impacted
2025/03/04 08:57 UTC - 10:42 UTC
Services Impacted
Voice Connectivity to multiple PSTN destinations.
Summary
At 08:57 UTC calls to the PSTN failed to connect and returned a 404 or Failed call status. This mostly affected traffic to the UK, over 3 periods of time.
The affected period were:
Mitigation for UK traffic was implemented at 10:15 UTC and resolved the issue for most previously affected calls.
Root Cause
A core routing service experienced server issues related to insufficient disk space.
Restoration Actions
The servers affected had disk space cleared to resolve the issue.
Next Steps
Ensure there are sufficient backup and failsafe routes for when the core routing service is unavailable.
Improved monitoring and audits to monitor disk utilization and catch issues earlier.
Improved service monitoring and alerting to improve reaction and resolution times.
Improved processes across Vonage to improve major incident handling.