{"id":4979,"date":"2018-07-16T09:52:57","date_gmt":"2018-07-16T13:52:57","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=4979"},"modified":"2018-07-16T09:52:57","modified_gmt":"2018-07-16T13:52:57","slug":"load-testing-with-different-aws-ec2-instance-types","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/","title":{"rendered":"Load Testing with Different AWS EC2 Instance Types Gives Different Results"},"content":{"rendered":"

Which AWS EC2 Instance Type Will Work Best for your Load Test?<\/h3>\n

Before performing a load test, you need to determine the right AWS EC2 instance type. Instance types comprise various combinations of CPU, memory, storage, and networking capacity and give you the flexibility to choose the appropriate mix of resources for your applications. There of course cost implications for which we discus estimation of those in a related\u00a0 post<\/a>.\u00a0 In this blog post we will see how load testing with different AWS EC2 instance types can impact your load testing results, sometimes in surprising ways.<\/p>\n

More importantly, you can repeat this with your own test scripts and different instance types and find what is best for you!<\/p>\n

Introduction<\/h3>\n

We will perform load tests on different AWS EC2 instance sizes and compare the results. We will keep other configuration settings constant, such as AWS locations, so that we don\u2019t introduce other variables. The results will give us something to think about when selecting the right instances for future load testing.<\/p>\n

Our example load test will be to sort a large array. To do this we will generate 100,000 numbers and save it on a file and then implement a \u201cHeap Sort\u201d algorithm to sort the numbers. Lastly we will run the script on different instances sizes in one load test at the same time. We are setting the thread count to 100 and will run the test with RedLine13. We would expect better hardware to produce better results. However at the end of the testing, a little surprise may come up.<\/p>\n

Let\u2019s start<\/h3>\n

First, we used a free site<\/a> to generate 100,000 random numbers and saved it. We did this by selecting \u201cMake a list of numbers starting at\u201d 1 and ending at 100,000 and clicked \u201cGenerate List of Numbers\u201d. After generating the numbers we downloaded the txt file.<\/p>\n

\"Random<\/p>\n

Later we added a Thread Group to our Test Plan.<\/p>\n

\"JMeter<\/p>\n

We needed to extract the AWS instance type size and pass this as a variable to name our action in the Sorting algorithm. To do this, we can use 2 different methods. One of them is OSSampler<\/strong> and the other is the JSR223 Sampler<\/strong> on Apache JMeter. In this example, we used the JSR223 Sampler to execute a command on AWS instances. As a sidenote, we will create a separate blog post about How to get AWS Meta Information<\/strong> soon.<\/p>\n

Let\u2019s add the JSR223 Sampler to our Thread Group and add the script to execute a Linux command on an EC2 instance to get the instance type. \"JSR223<\/p>\n

After executing the script, the important point is that we need to save the AWS instance name as a variable. Our variable name is \u201coutput<\/strong>\u201d.<\/p>\n

Now, we add a BeanShell Sampler on our Thread Group to execute Merge sorting operations. The crucial part of this section is giving the sampler a distinguishing name. Our distinguishing name is the AWS instance name which we extracted from our previous sampler (\u201coutput<\/strong>\u201d). So we are naming this sampler as BeanShell ${output}<\/code>. ${output}<\/code> refers to AWS EC2 instance type name such as a m4.largelocal.<\/p>\n

\"BeanShell<\/p>\n

After completing the script, we are now running the script on various AWS EC2 instances at the same time. With RedLine13, adding an EC2 server is extremely easy and flexible. Click Servers \u2192 Server Mgmt \u2192 Add Server and then choose the instances.<\/p>\n

\"Server<\/p>\n

\"Add<\/p>\n

\"Configure<\/p>\n

Load Test Results with Different AWS EC2 Instance Types<\/h3>\n

In our example we have picked 5 different instance types:<\/p>\n

    \n
  1. m3.medium<\/li>\n
  2. m4.large<\/li>\n
  3. t2.2xlarge<\/li>\n
  4. t2.medium<\/li>\n
  5. t2.nano<\/li>\n<\/ol>\n

    After launching these servers, let\u2019s run the our script on RedLine13. The results are shown below and it gave us unexpected results.<\/p>\n

    \"Load<\/p>\n

    After this test, our initial thought is that we won\u2019t use m3.medium instance type for load testing. However, as we stated above, different load tests will behave differently on different AWS EC2 instance types. So the takeaway is to look at load testing with different AWS EC2 instance types by trying your load test<\/a> on different instance types and determine which is best for you.<\/p>\n

    Beanshell Sampler Java Code<\/strong><\/h3>\n
    def string = \"\/bin\/bash -c EC2metadata --instance-type\".execute().text\n\nString[] test = string.split(\"-\");\nString newTest = test[17];\nvars.put(\"output\", newTest)\n\nimport java.util.*;\nimport java.text.*;\nimport java.io.*;\n\nprivate static int[] a;\nprivate static int n;\nprivate static int left;\nprivate static int right;\nprivate static int largest;\n\npublic void buildheap(int[] a) {\n    n = a.length - 1;\n    for (int i = n \/ 2; i >= 0; i--) {\n        maxheap(a, i);\n    }\n}\n\npublic void maxheap(int[] a, int i) {\n    left = 2 * i;\n    right = 2 * i + 1;\n\n    if (left <= n && a[left] > a[i]) {\n        largest = left;\n    } else {\n        largest = i;\n    }\n\n    if (right <= n && a[right] > a[largest]) {\n        largest = right;\n    }\n\n    if (largest != i) {\n        exchange(i, largest);\n        maxheap(a, largest);\n    }\n}\n\n\npublic void exchange(int i, int j) {\n    int t = a[i];\n    a[i] = a[j];\n    a[j] = t;\n}\n\npublic void sort(int[] myarray) {\n    a = myarray;\n    buildheap(a);\n    for (int i = n; i > 0; i--) {\n        exchange(0, i);\n        n = n - 1;\n        maxheap(a, 0);\n    }\n}\n\nString csvTest = \"numbers.txt\";\nArrayList strList = new ArrayList();\nFile file = new File(System.getProperty(\"user.dir\") + File.separator + csvTest);\nif (!file.exists()) {\n    throw new Exception(\"ERROR: file \" + csvTest + \" not found in \" + csvDir + \" directory.\");\n}\n\nint[] arr = new int[100000];\nBufferedReader bufRdr = new BufferedReader(new FileReader(file));\nString line = null;\nint i = 0;\nwhile ((line = bufRdr.readLine()) != null) {\n    strList.add(line);\n    arr[i] = Integer.parseInt(line);\n    i++;\n}\n\ni = 0;\nlog.info(\"size\" + arr.length);\n\/\/ log.info(\"a\"+arr[99]);\nbufRdr.close();\n\nsort(arr);<\/pre>\n","protected":false},"excerpt":{"rendered":"
    Which AWS EC2 Instance Type Will Work Best for your Load Test? Before performing a load test, you need to determine the right AWS EC2 instance type. Instance types comprise various combinations of CPU, memory, storage, and networking capacity and give you the flexibility to choose the appropriate mix of resources for your applications. There of course cost implications for which we discus estimation of those in a related\u00a0 post.\u00a0 In this blog post we willRead More →<\/a><\/p>\n","protected":false},"author":1,"featured_media":4988,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,2,35],"tags":[],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-user","4":"post-4979","6":"format-standard","7":"has-post-thumbnail","8":"category-aws","9":"category-blog","10":"category-load-testing"},"yoast_head":"\nLoad Testing with Different AWS EC2 Instance Types<\/title>\n<meta name=\"description\" content=\"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Load Testing with Different AWS EC2 Instance Types\" \/>\n<meta property=\"og:description\" content=\"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2018-07-16T13:52:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/07\/ec2_instance_types_table_1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"368\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"RedLine13\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"RedLine13\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\"},\"author\":{\"name\":\"RedLine13\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\"},\"headline\":\"Load Testing with Different AWS EC2 Instance Types Gives Different Results\",\"datePublished\":\"2018-07-16T13:52:57+00:00\",\"dateModified\":\"2018-07-16T13:52:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\"},\"wordCount\":686,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"articleSection\":[\"AWS\",\"Blog\",\"Load Testing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\",\"name\":\"Load Testing with Different AWS EC2 Instance Types\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2018-07-16T13:52:57+00:00\",\"dateModified\":\"2018-07-16T13:52:57+00:00\",\"description\":\"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Load Testing with Different AWS EC2 Instance Types Gives Different Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\",\"name\":\"RedLine13\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"caption\":\"RedLine13\"},\"sameAs\":[\"http:\/\/127.0.0.1\"],\"url\":\"https:\/\/www.redline13.com\/blog\/author\/user\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Load Testing with Different AWS EC2 Instance Types","description":"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/","og_locale":"en_US","og_type":"article","og_title":"Load Testing with Different AWS EC2 Instance Types","og_description":"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.","og_url":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/","og_site_name":"RedLine13","article_published_time":"2018-07-16T13:52:57+00:00","og_image":[{"width":400,"height":368,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2018\/07\/ec2_instance_types_table_1.png","type":"image\/png"}],"author":"RedLine13","twitter_card":"summary_large_image","twitter_misc":{"Written by":"RedLine13","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/"},"author":{"name":"RedLine13","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28"},"headline":"Load Testing with Different AWS EC2 Instance Types Gives Different Results","datePublished":"2018-07-16T13:52:57+00:00","dateModified":"2018-07-16T13:52:57+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/"},"wordCount":686,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"articleSection":["AWS","Blog","Load Testing"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/","url":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/","name":"Load Testing with Different AWS EC2 Instance Types","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2018-07-16T13:52:57+00:00","dateModified":"2018-07-16T13:52:57+00:00","description":"Load testing with different AWS EC2 instance types gives different results. Here's an example. You can reuse this to run your own tests with different AWS EC2 instance types to see what's best for you.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2018\/07\/load-testing-with-different-aws-ec2-instance-types\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Load Testing with Different AWS EC2 Instance Types Gives Different Results"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28","name":"RedLine13","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","caption":"RedLine13"},"sameAs":["http:\/\/127.0.0.1"],"url":"https:\/\/www.redline13.com\/blog\/author\/user\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/4979","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=4979"}],"version-history":[{"count":0,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/4979\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/4988"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=4979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=4979"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=4979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}