{"id":8998,"date":"2022-02-09T12:27:34","date_gmt":"2022-02-09T17:27:34","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=8998"},"modified":"2022-02-09T12:27:34","modified_gmt":"2022-02-09T17:27:34","slug":"run-load-tests-with-increasing-load","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/","title":{"rendered":"Case Study: Run Load Tests with Increasing Load"},"content":{"rendered":"\n

This Case Study is how one company, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits. Thanks to Joseph Bonifacio, lead QA at GradeCam.<\/p>\n\n\n\n

About GradeCam<\/strong><\/h3>\n\n\n\n

GradeCam<\/a> is a provider of easy and innovative assessment solutions that empower educators to minimize workloads and maximize learning. Whether it\u2019s bridging the distance between in-class and online assignments, saving time scoring and transferring grades, or aggregating flexible and shareable data, GradeCam simplifies and streamlines tasks so teachers can focus on teaching. And perhaps best of all, it doesn\u2019t require any proprietary forms, special equipment, or time-intensive training to get started.<\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Objective of Load Tests<\/strong><\/h3>\n\n\n\n

Scaling changes were proposed. One of the proposed changes was to see if scaling pods per cluster would be a simple, short-term change that could positively impact performance (if needed).  Below shows two of the calls average and 95th percentiles over the increasing, stepped load tests.  As GradeCam interpreted, very light evidence showed that they could consistently expect improved performance based on scaling architecture alone, at least with these two specific end-points.<\/p>\n\n\n\n

GradeCam has a separate testing environment that closely resembles their production environment.  They use the testing environment to test changes with code merges or DevOps modifications that either (1) improve performance or (2) have a risk of degrading performance.  Before applying or merging changes, they use data-driven testing to compare performance before and after.<\/p>\n\n\n\n

Unlike other systems that might experience ramp-up like a bell curve, student users are more likely to log in in short bursts and utilize the system with sustained activity.  This results in a load profile more like \u201csteps\u201d up and then a gradual leveling off as users sign-off.<\/p>\n\n\n\n

\"Run<\/figure><\/div>\n\n\n\n

Steps taken to gradually run load tests with increasing load<\/strong><\/h3>\n\n\n\n

GradeCam uses JMeter to generate load in their systems. They run separate tests with an increasing number of threads (in this case the amount of load is so high, they increase the number of AWS instances) to simulate the \u201cstepped\u201d bursts of activity.<\/p>\n\n\n\n

This approach allows them to produce \u201dspikes\u201d in their users’ behavior.  Their test users behave like students taking an online test – and students normally begin a test within a short period of time.  So by separating their load into separate tests, they can simulate the first ten or fifteen minutes of their workflow and increase the volume with each subsequent test.  <\/p>\n\n\n\n

Besides a more realistic workflow, the benefits of stepped load tests allows them to look for a ceiling and compare the different results across the different tests.<\/p>\n\n\n\n

Challenges\/Setbacks<\/strong><\/h3>\n\n\n\n

A reoccurring challenge is test data management.  With lighter loads, it is easier to generate test data on a JMeter setUp thread or even leave test data in the environment.  However, as you increase the number of threads by thousands, this requires management of more and more realistic data.<\/p>\n\n\n\n

In order to overcome this, they’ve created a test data framework that automated test data generation as needed.  This required more up-front time and development but as a result, they\u2019ve been able to execute performance tests on RedLine13 with relative ease between different test executions and test cases.<\/p>\n\n\n\n

Results\/Benefits<\/strong><\/h3>\n\n\n\n

They\u2019ve begun using the results collected by RedLine13 from their JMeter tests and their system metric\u2019s platform to make data-driven decisions regarding their systems architecture and performance.  Comparison testing allows them to apply new configurations with more confidence.<\/p>\n\n\n\n

In addition, they\u2019ve expanded their metric observation to track trends over time, allowing them to understand their systems performance over time and catch unexpected regressions that may have been initially downplayed as a risk for performance.<\/p>\n\n\n\n

\"\"
GradeCam Engineering Team<\/figcaption><\/figure>\n\n\n\n

Free Trial<\/h3>\n\n\n\n

RedLine13 offers a free trial that includes all of our Premium features.  Sign up now<\/a>  and starting increasing your load today!<\/p>\n","protected":false},"excerpt":{"rendered":"

This Case Study is how one company, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits. Thanks to Joseph Bonifacio, lead QA at GradeCam. About GradeCam GradeCam is a provider of easy and innovative assessment solutions that empower educators to minimize workloads and maximize learning. Whether it\u2019s bridging the distance between in-class and online assignments, saving time scoring and transferring grades, or aggregatingRead More →<\/a><\/p>\n","protected":false},"author":7,"featured_media":9020,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-cbaeckstrom","4":"post-8998","6":"format-standard","7":"has-post-thumbnail","8":"category-blog"},"yoast_head":"\nCase Study: Run Load Tests with Increasing Load - RedLine13<\/title>\n<meta name=\"description\" content=\"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Case Study: Run Load Tests with Increasing Load - RedLine13\" \/>\n<meta property=\"og:description\" content=\"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2022-02-09T17:27:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/01\/Gradecam-screenshots.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2602\" \/>\n\t<meta property=\"og:image:height\" content=\"1704\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Chris Baeckstrom\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Chris Baeckstrom\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\"},\"author\":{\"name\":\"Chris Baeckstrom\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/969c3ed71bfb140abd38d17818cd9773\"},\"headline\":\"Case Study: Run Load Tests with Increasing Load\",\"datePublished\":\"2022-02-09T17:27:34+00:00\",\"dateModified\":\"2022-02-09T17:27:34+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\"},\"wordCount\":661,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\",\"name\":\"Case Study: Run Load Tests with Increasing Load - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2022-02-09T17:27:34+00:00\",\"dateModified\":\"2022-02-09T17:27:34+00:00\",\"description\":\"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Study: Run Load Tests with Increasing Load\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/969c3ed71bfb140abd38d17818cd9773\",\"name\":\"Chris Baeckstrom\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/776ba47b4b25ab883054c8fee0241158a549c6217bc321ab4027256ec71ce93a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/776ba47b4b25ab883054c8fee0241158a549c6217bc321ab4027256ec71ce93a?s=96&d=mm&r=g\",\"caption\":\"Chris Baeckstrom\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/cbaeckstrom\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Case Study: Run Load Tests with Increasing Load - RedLine13","description":"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/","og_locale":"en_US","og_type":"article","og_title":"Case Study: Run Load Tests with Increasing Load - RedLine13","og_description":"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.","og_url":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/","og_site_name":"RedLine13","article_published_time":"2022-02-09T17:27:34+00:00","og_image":[{"width":2602,"height":1704,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/01\/Gradecam-screenshots.png","type":"image\/png"}],"author":"Chris Baeckstrom","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Chris Baeckstrom","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/"},"author":{"name":"Chris Baeckstrom","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/969c3ed71bfb140abd38d17818cd9773"},"headline":"Case Study: Run Load Tests with Increasing Load","datePublished":"2022-02-09T17:27:34+00:00","dateModified":"2022-02-09T17:27:34+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/"},"wordCount":661,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/","url":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/","name":"Case Study: Run Load Tests with Increasing Load - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2022-02-09T17:27:34+00:00","dateModified":"2022-02-09T17:27:34+00:00","description":"y, GradeCam, has run load tests with increasing load. It will discuss their challenges and setbacks, as well as their results and benefits.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2022\/02\/run-load-tests-with-increasing-load\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Case Study: Run Load Tests with Increasing Load"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/969c3ed71bfb140abd38d17818cd9773","name":"Chris Baeckstrom","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/776ba47b4b25ab883054c8fee0241158a549c6217bc321ab4027256ec71ce93a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/776ba47b4b25ab883054c8fee0241158a549c6217bc321ab4027256ec71ce93a?s=96&d=mm&r=g","caption":"Chris Baeckstrom"},"url":"https:\/\/www.redline13.com\/blog\/author\/cbaeckstrom\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=8998"}],"version-history":[{"count":5,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8998\/revisions"}],"predecessor-version":[{"id":9108,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8998\/revisions\/9108"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/9020"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=8998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=8998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=8998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}