Home / Technology / Telstra's Timing Fail: Ignored Warnings Led to Chaos
Telstra's Timing Fail: Ignored Warnings Led to Chaos
6 Sep
Summary
- A research paper warned of systemic risks 11 months prior.
- Network time protocol failure caused widespread chaos.
- Key engineers with system knowledge were on break.
A significant Telstra mobile network outage in July was preventable, with a key academic paper warning of systemic risks 11 months prior. This publication, funded by the federal government, identified network time protocol as a critical function whose failure could cascade through modern networks.
This exact function failed at Telstra, causing a nationwide disruption. The outage originated when a GPS card reset to an earlier date, impacting all connected clocks and leading to train stoppages, eftpos failures, and emergency call issues.
Telstra's own review revealed that crucial engineers familiar with the timing system were on mandatory break during the incident. Furthermore, alarms for these servers were only monitored during business hours, not by round-the-clock teams.
Despite the review, the regulator, Australian Communications and Media Authority, is reportedly considering significant action, including potential fines up to $30 million, and the chief executive has faced a substantial pay cut.
