#Fail: Yesterday’s Internet Outage Was Caused By A Single Customer

Yesterday a number of major websites went down due to a failure with a content delivery network provider. Now we know what happened. A single customer managed to take down a significant portion of the Internet:

A major internet blackout that hit many high-profile websites on Tuesday has been blamed on a software bug.

Fastly, the cloud-computing company responsible for the issues, said the bug had been triggered when one of its customers had changed their settings.

The outage has raised questions about relying on a handful of companies to run the vast infrastructure that underpins the internet.

Fastly apologised and said the problem should have been anticipated.

The outage, which lasted about an hour, hit some popular websites such as Amazon, Reddit, the Guardian and the New York Times.

And:

The company operates servers at strategic points around the world to help customers move and store content close to their end users.

But a customer quite legitimately changing their settings had exposed a bug in a software update issued to customers in mid-May, causing “85% of our network to return errors”, it said.

That’s not good and I think that someone in Fastly’s QA department is about to get a talking to. Not to mention that I think that there will be tighter controls on what changes customers can make so that something like this can’t happen again as one single change from one customer should not take down a significant portion of the Internet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: