Previous incidents

April 2025
No incidents reported
March 2025
Mar 31, 2025
1 incident

Some CDN requests failing in California

Degraded

Resolved Mar 31 at 04:16pm BST

The issue has been resolved.

The issue was caused by packet loss affecting our new Los Angeles datacenter. The datacenter traced the issue to their upstream provider, Arelion, which was experiencing network instability.

The issue was resolved when Arelion was temporarily disabled as an upstream provider and traffic was rerouted through other providers.

We require that our datacenters identify and reroute traffic automatically and quickly in such scenarios. However, the resolution of this i...

1 previous update

Mar 15, 2025
1 incident

Some uploads failing

Degraded

Resolved Mar 16 at 03:25pm GMT

The issue has been resolved.

The issue was caused by two servers in one cluster failing simultaneously. This impacted the uploading of new files to about 20% of Sirv accounts.

Uploads are designed to continue as normal when one server is down but when two servers are down, some uploads can fail, which is what happened. They failed due to an exporter service that stopped running on one server, then the other server. Errors prevented the services from restarting. Then a second issue caused th...

2 previous updates

February 2025
Feb 26, 2025
1 incident

502 responses for some files

Degraded

Resolved Feb 26 at 09:32am GMT

The issue was resolved within 3 minutes. The cause was the rebooting of multiple servers at the same time, whilst only 1 server should have been rebooted. This was an oversight in our standard operating procedures. We are investigating ways to automatically protect and prevent this from recurring.

1 previous update