Image processingSome image processing requests failed for 7 minutes
For a 7 minute period between 13:48 and 13:55 UTC, there was a partial outage for new image processing requests. The issue occurred during the rollout of a new feature to whitelist domains (thus blocking requests from other domains). It was caused by a misconfiguration of an updated server module for one of Sirv's image processing clusters. The error was identified and resolved as quickly as possible.
During the period, Sirv's other image processing clusters operated as normal and all CDN requests were completed as normal - only fresh requests received by the misconfigured cluster were affected. This affected approximately 1.5% of total requests.
We are reviewing our processes to identify what more can be done to avoid such issues in the future.