{"id":4799,"date":"2018-05-15T14:21:38","date_gmt":"2018-05-15T18:21:38","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=4799"},"modified":"2018-05-15T14:21:38","modified_gmt":"2018-05-15T18:21:38","slug":"load-test-an-aws-hosted-site-with-aws-load-generators","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/","title":{"rendered":"Can You Load Test an AWS Hosted Site with AWS Load Generators?"},"content":{"rendered":"<p style=\"font-weight: 400;\">A question sometimes comes up: can you load test an AWS hosted site, that uses products such as AWS WAF, AWS CloudFront, and the AWS Elastic Container Service, with AWS Load Generators?<\/p>\n<p style=\"font-weight: 400;\">The concern is that AWS networking may optimize routes and utilize internal large network pipes, etc.\u00a0 The premise is that that will render the results inaccurate compared to real world results.<\/p>\n<p>Let&#8217;s look at Load Testing AWS from AWS and what you need to know.<\/p>\n<p>I won&#8217;t bury the lead. Load testing AWS from AWS can be done without worrying about network optimizations.\u00a0 You can easily verify this, but\u00a0if you still feel avoiding the optimizations will give you a better sense of response\u00a0time, then you have options.<\/p>\n<h2>Options to Load Test an AWS Hosted Site<\/h2>\n<p>1) Test from a different region and set up a secondary account just for running load tests.\u00a0 \u00a0Testing across accounts or regions will force IP traffic over public routes that will land back in AWS.\u00a0 Remember, AWS networks not only have optimizations for performance, but a lot of rules about keeping network\u00a0traffic separated to protect account security.\u00a0 With all the <a href=\"https:\/\/www.redline13.com\/blog\/2018\/01\/aws-ec2-paris-region-support\/\">AWS regions<\/a> available, there are a lot of options.<\/p>\n<p>We have performance tested AWS region to region communication for a large scale streaming service, specifically for passing text messages through real-time content classifiers.\u00a0 The classifier\u00a0runs around 30ms if you call from within the region, and almost 180 ms if you call from EU to US-EAST.\u00a0 So calling between regions definitely has public internet latency.<\/p>\n<p>2) Add latency or control throughput.\u00a0 Since you cannot accurately simulate a user&#8217;s browser or mobile phone, use generated latency.\u00a0 \u00a0Every home connection, mobile connection, or that connection we use at Starbucks\u00a0has so many variables that impact actual network flow.\u00a0 <a href=\"https:\/\/wiki.apache.org\/jmeter\/Controlling%20Bandwidth%20in%20J\" target=\"_blank\" rel=\"noopener\">JMeter<\/a> has a feature to control bandwidth so you can create different kinds of connections.<\/p>\n<p>This can be passed into RedLine13 via command line options.<a href=\"https:\/\/d1u7j79bg1ays7.cloudfront.net\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-4958 alignright\" src=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner.jpg\" alt=\"\" width=\"168\" height=\"184\" srcset=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner.jpg 1083w, https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner-274x300.jpg 274w, https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner-936x1024.jpg 936w, https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/SaaSPartner-768x840.jpg 768w\" sizes=\"auto, (max-width: 168px) 100vw, 168px\" \/><\/a><\/p>\n<p>Another idea is not to worry about network costs in load testing.\u00a0 This very much depends on what you are trying to test.\u00a0 If latency is not controllable, we try to improve and manage the performance time of our services.\u00a0 We look at API response times of \/api\u00a0or \/registration or \/something else.<\/p>\n<p>What we are really trying to determine and optimize on is the SLA of &#8216;My Service&#8217; (see below).\u00a0 Reducing or controlling for latency gives us a better understanding of actual performance time. That gives us options to load test an AWS hosted site.<\/p>\n<div><a href=\"https:\/\/d1u7j79bg1ays7.cloudfront.net\/blog\/wp-content\/uploads\/2018\/05\/Simple-Load-Test-View.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-4800\" src=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/Simple-Load-Test-View.png\" alt=\"\" width=\"880\" height=\"552\" srcset=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/Simple-Load-Test-View.png 880w, https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/Simple-Load-Test-View-300x188.png 300w, https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/Simple-Load-Test-View-768x482.png 768w\" sizes=\"auto, (max-width: 880px) 100vw, 880px\" \/><\/a><\/div>\n","protected":false},"excerpt":{"rendered":"<p>A question sometimes comes up: can you load test an AWS hosted site, that uses products such as AWS WAF, AWS CloudFront, and the AWS Elastic Container Service, with AWS Load Generators? The concern is that AWS networking may optimize routes and utilize internal large network pipes, etc.\u00a0 The premise is that that will render the results inaccurate compared to real world results. Let&#8217;s look at Load Testing AWS from AWS and what you need to<a class=\"more-link\" href=\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\">Read More &rarr;<\/a><\/p>\n","protected":false},"author":1,"featured_media":4803,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-user","4":"post-4799","6":"format-standard","7":"has-post-thumbnail","8":"category-aws"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.12 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Load Testing an AWS Hosted Site with AWS Load Generators<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Load Testing an AWS Hosted Site with AWS Load Generators\" \/>\n<meta property=\"og:description\" content=\"A question sometimes comes up: can you load test an AWS hosted site, that uses products such as AWS WAF, AWS CloudFront, and the AWS Elastic Container Service, with AWS Load Generators? The concern is that AWS networking may optimize routes and utilize internal large network pipes, etc.\u00a0 The premise is that that will render the results inaccurate compared to real world results. Let&#8217;s look at Load Testing AWS from AWS and what you need toRead More &rarr;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2018-05-15T18:21:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/AWS-inter-region-peering.1a0b372fa6524a44c8f8394313220d347e19b6f5.png\" \/>\n\t<meta property=\"og:image:width\" content=\"551\" \/>\n\t<meta property=\"og:image:height\" content=\"475\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"RedLine13\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"RedLine13\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\"},\"author\":{\"name\":\"RedLine13\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\"},\"headline\":\"Can You Load Test an AWS Hosted Site with AWS Load Generators?\",\"datePublished\":\"2018-05-15T18:21:38+00:00\",\"dateModified\":\"2018-05-15T18:21:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\"},\"wordCount\":426,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"articleSection\":[\"AWS\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\",\"name\":\"Load Testing an AWS Hosted Site with AWS Load Generators\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2018-05-15T18:21:38+00:00\",\"dateModified\":\"2018-05-15T18:21:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Can You Load Test an AWS Hosted Site with AWS Load Generators?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\",\"name\":\"RedLine13\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"caption\":\"RedLine13\"},\"sameAs\":[\"http:\/\/127.0.0.1\"],\"url\":\"https:\/\/www.redline13.com\/blog\/author\/user\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Load Testing an AWS Hosted Site with AWS Load Generators","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/","og_locale":"en_US","og_type":"article","og_title":"Load Testing an AWS Hosted Site with AWS Load Generators","og_description":"A question sometimes comes up: can you load test an AWS hosted site, that uses products such as AWS WAF, AWS CloudFront, and the AWS Elastic Container Service, with AWS Load Generators? The concern is that AWS networking may optimize routes and utilize internal large network pipes, etc.\u00a0 The premise is that that will render the results inaccurate compared to real world results. Let&#8217;s look at Load Testing AWS from AWS and what you need toRead More &rarr;","og_url":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/","og_site_name":"RedLine13","article_published_time":"2018-05-15T18:21:38+00:00","og_image":[{"width":551,"height":475,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/05\/AWS-inter-region-peering.1a0b372fa6524a44c8f8394313220d347e19b6f5.png","type":"image\/png"}],"author":"RedLine13","twitter_card":"summary_large_image","twitter_misc":{"Written by":"RedLine13","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/"},"author":{"name":"RedLine13","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28"},"headline":"Can You Load Test an AWS Hosted Site with AWS Load Generators?","datePublished":"2018-05-15T18:21:38+00:00","dateModified":"2018-05-15T18:21:38+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/"},"wordCount":426,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"articleSection":["AWS"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/","url":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/","name":"Load Testing an AWS Hosted Site with AWS Load Generators","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2018-05-15T18:21:38+00:00","dateModified":"2018-05-15T18:21:38+00:00","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2018\/05\/load-test-an-aws-hosted-site-with-aws-load-generators\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Can You Load Test an AWS Hosted Site with AWS Load Generators?"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28","name":"RedLine13","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","caption":"RedLine13"},"sameAs":["http:\/\/127.0.0.1"],"url":"https:\/\/www.redline13.com\/blog\/author\/user\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/4799","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=4799"}],"version-history":[{"count":0,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/4799\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/4803"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=4799"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=4799"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=4799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}