{"id":3962,"date":"2017-01-10T11:53:35","date_gmt":"2017-01-10T16:53:35","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=3962"},"modified":"2017-01-10T11:53:35","modified_gmt":"2017-01-10T16:53:35","slug":"load-testing-blunders-of-2016","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/","title":{"rendered":"The Biggest Load Testing Blunders of 2016"},"content":{"rendered":"

Now that the first week of 2017 is officially over, let’s take a look back at some of 2016’s biggest load testing blunders. The story is familiar: a site experiences heavy load, they forgot to do performance testing, and then their site goes down.\u00a0Here are a few examples to show you exactly why you should load test as we look at the biggest load testing blunders of 2016.<\/p>\n

\"hamilton-load-testing\"
Credit: Hamilton Official FB Page<\/figcaption><\/figure>\n

8. The Hamilton Ticket Lottery<\/strong><\/span><\/p>\n

The popular Broadway musical Hamilton\u00a0ran a campaign offering front-row seats for just $10, provided you won an online auction. Registration for the auction goes live, thousands hit the site at once, the website crashed<\/a><\/span>, and people missed out on the lottery. It was so bad that the developers had to take the site completely offline to fix the issue and many were unable to register for the auction.<\/span><\/p>\n

\"beyonce-load-testing\"
Credit: Beyonc\u00e9.com<\/figcaption><\/figure>\n

7. Beyonc\u00e9’s Super Bowl Ad & Ivy Park\u00a0Website Issues<\/strong><\/span><\/p>\n

Beyonc\u00e9 both performed and aired a commercial to millions during the Super Bow, announcing her now tour, immediately causing her official website to go down<\/span><\/a>. Later in the year, Beyonc\u00e9’s clothing line, Ivy Park<\/a>, was finally available in stores\/online. The mad rush of prospective buyers caused participating retailer’s websites to crash<\/a><\/span>.<\/span><\/p>\n

\"dwyane-wade-load-testing\"
Credit: Dwyane Wade<\/figcaption><\/figure>\n

6. Dwyane Wade & The Miami Heat Merch Site<\/strong><\/span><\/p>\n

The Miami Heat ran a special promotion where all Dwyane Wade branded merchandise was to be sold for $13 in celebration for his 13 seasons with the team. Cue massive increase in traffic, the website quickly crashes<\/a><\/span>, purchases cannot be completed, and fans take to social media to complain.<\/span><\/p>\n

\"oculus-rift-load-testing\"
Credit: Oculus<\/figcaption><\/figure>\n

5. The Oculus Rift Pre-Order Crash<\/strong><\/span><\/p>\n

People could finally pre-order the Oculus Rift, the highly anticipated\u00a0VR device, after many years of waiting. Pre-orders went live on Jan 7th, and soon after, the pre-order page crashed<\/a><\/span>. People started to complain on social media, and the CEO announced that their site was “experiencing extremely high load”.<\/span><\/p>\n

\"uk-voter-registration-load-testing\"
Credit: Gov.uk<\/figcaption><\/figure>\n

4. U.K. Voter Registration Website<\/strong><\/span><\/p>\n

The U.K. was about to vote on one of their most important issues in 2016: whether or not they would withdraw from the EU. Naturally, many waited until the last minute to register to vote, and upon registering,\u00a0the registration website went down<\/a><\/span>. Turns out the reg. application was only hosted on one instance, in one data center.\u00a0<\/span><\/p>\n

\"pokemon-go-load-testing\"
Credit: Pokemon\/Niantic<\/figcaption><\/figure>\n

3. Pok\u00e9mon Go Launch<\/strong><\/span><\/p>\n

The beloved Pok\u00e9mon franchise finally came to mobile devices via an augmented-reality game allowing you to explore the real world while capturing virtually overlaid Pok\u00e9mon. Upon the games launch, Niantic’s (the devs) servers were absolutely destroyed by intense load<\/a><\/span>\u00a0(7.5 million U.S. downloads in first week). On day one, users experienced slow downloads, connectivity issue, crashes, only those that registered with a Gmail address could initially play<\/a><\/span>, and a host of other issues that continued for the next two weeks or so.<\/span><\/p>\n

\"canadian-immigration-website\"
Credit: Government of Canada<\/figcaption><\/figure>\n

2. The Multiple Times the Canadian Immigration Website Went Down<\/strong><\/span><\/p>\n

The polarizing political race in the United States caused many to be uncertain. When Donald Trump won Super Tuesday, the Canadian immigration website went down<\/a><\/span> as Google searches for “How Can I Move to Canada” increased by a factor of 1,500%. Then when Trump was elected President, the immigration website again crashed<\/a><\/span>.<\/span><\/p>\n

\"macys-black-friday-load-testing\"<\/p>\n

1. The Macy’s Black Friday Crash<\/strong><\/span><\/p>\n

Macy’s did not prepare their websites and mobile apps for Black Friday, and as expected, disaster ensued. Arguably the biggest weekend for retailers, Macy’s either neglected to load test or didn’t properly scale out their test pans. Either way, their website and app crashed on Black Friday<\/a><\/span>, causing them to loose who knows how much money while also angering shoppers, creating a social media onslaught.<\/span><\/p>\n

<\/del>Lessons Learned<\/strong><\/span><\/h3>\n

Determine Max Number of Users\u00a0<\/strong><\/span><\/p>\n

Before you begin your performance tests, it’s important to determine how many users you are expecting to hit your site\/app. Consult your development team and have everyone agree upon a number. Keep this number in mind with what you’re testing, and adjust accordingly.<\/span><\/p>\n

Allow Time For Testing<\/strong><\/span><\/p>\n

It’s important to examine your Project Plan and understand how much time you have for testing.\u00a0Ask yourself “what kind of testing is the most important for a high-profile release?”. Tackle the most important projects first that require extensive testing, then move onto the smaller projects.<\/span><\/p>\n

Be Prepared<\/strong><\/span><\/p>\n

If you’re running a major sale, don’t load test, and then you’re website crashes, you’re probably to blame. However, it’s the unexpected that we must be prepared for. Perhaps your site only sees 10,000 page views a month, but suddenly your last blog post went viral, and now some 600K+ people are accessing your site. It’s hard to prepare for these kind of events, which is all the more reason to load test just in case.<\/span><\/p>\n

Reflect on Past Incidents<\/strong><\/span><\/p>\n

Has your website\/app ever crashed before in the past? Did it slow down? Do you have any existing website metrics that could show behavior under load? If so, reflect upon these past incidents and determine what caused the issues in the first place. It’s important to learn from our mistakes.<\/span><\/p>\n

Start Small & Establish Baseline
\n<\/strong><\/span><\/p>\n

When you’re ready to begin testing, start out small. Begin by creating a simple load test with 100 users that will hit your website\/app over and over again. Smaller tests like these are ideal for establishing baseline levels of performance.<\/span><\/p>\n

Scale Out Your Tests<\/strong><\/span><\/p>\n

Once a baseline level of performance has been established with smaller load tests, you can now scale out your tests in a more realistic manner. Begin by growing your test (250 users, 500 users, 1,000 users, 5,000 users, 15,000 users, etc.) until you can pinpoint the highest level of load your website can take before crashing. Scale the tests back down again to be even more thorough.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Now that the first week of 2017 is officially over, let’s take a look back at some of 2016’s biggest load testing blunders. The story is familiar: a site experiences heavy load, they forgot to do performance testing, and then their site goes down.\u00a0Here are a few examples to show you exactly why you should load test as we look at the biggest load testing blunders of 2016. 8. The Hamilton Ticket Lottery The popular BroadwayRead More →<\/a><\/p>\n","protected":false},"author":1,"featured_media":4036,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[55,107,149,150,203,277,318,550],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-user","4":"post-3962","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"post_tag-55","10":"post_tag-blunders","11":"post_tag-crash","12":"post_tag-crashed","13":"post_tag-fail","14":"post_tag-issues","15":"post_tag-load-testing","16":"post_tag-website"},"yoast_head":"\nThe Biggest Load Testing Blunders of 2016<\/title>\n<meta name=\"description\" content=\"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Biggest Load Testing Blunders of 2016\" \/>\n<meta property=\"og:description\" content=\"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2017-01-10T16:53:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2017\/01\/Biggest-Load-Testing-Fails-2016.png\" \/>\n\t<meta property=\"og:image:width\" content=\"960\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"RedLine13\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"RedLine13\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\"},\"author\":{\"name\":\"RedLine13\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\"},\"headline\":\"The Biggest Load Testing Blunders of 2016\",\"datePublished\":\"2017-01-10T16:53:35+00:00\",\"dateModified\":\"2017-01-10T16:53:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\"},\"wordCount\":1014,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"2016\",\"blunders\",\"crash\",\"crashed\",\"fail\",\"issues\",\"Load Testing\",\"website\"],\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\",\"name\":\"The Biggest Load Testing Blunders of 2016\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2017-01-10T16:53:35+00:00\",\"dateModified\":\"2017-01-10T16:53:35+00:00\",\"description\":\"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Biggest Load Testing Blunders of 2016\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\",\"name\":\"RedLine13\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"caption\":\"RedLine13\"},\"sameAs\":[\"http:\/\/127.0.0.1\"],\"url\":\"https:\/\/www.redline13.com\/blog\/author\/user\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Biggest Load Testing Blunders of 2016","description":"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/","og_locale":"en_US","og_type":"article","og_title":"The Biggest Load Testing Blunders of 2016","og_description":"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.","og_url":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/","og_site_name":"RedLine13","article_published_time":"2017-01-10T16:53:35+00:00","og_image":[{"width":960,"height":720,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2017\/01\/Biggest-Load-Testing-Fails-2016.png","type":"image\/png"}],"author":"RedLine13","twitter_card":"summary_large_image","twitter_misc":{"Written by":"RedLine13","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/"},"author":{"name":"RedLine13","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28"},"headline":"The Biggest Load Testing Blunders of 2016","datePublished":"2017-01-10T16:53:35+00:00","dateModified":"2017-01-10T16:53:35+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/"},"wordCount":1014,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["2016","blunders","crash","crashed","fail","issues","Load Testing","website"],"articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/","url":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/","name":"The Biggest Load Testing Blunders of 2016","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2017-01-10T16:53:35+00:00","dateModified":"2017-01-10T16:53:35+00:00","description":"From the Canadian Immigration website crashing after Trumps win or Macy's app going down on Black Friday, here're the biggest load testing blunders of 2016.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2017\/01\/load-testing-blunders-of-2016\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"The Biggest Load Testing Blunders of 2016"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28","name":"RedLine13","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","caption":"RedLine13"},"sameAs":["http:\/\/127.0.0.1"],"url":"https:\/\/www.redline13.com\/blog\/author\/user\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/3962","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=3962"}],"version-history":[{"count":0,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/3962\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/4036"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=3962"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=3962"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=3962"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}