{"id":7639,"date":"2021-02-05T09:58:36","date_gmt":"2021-02-05T14:58:36","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=7639"},"modified":"2022-05-23T16:52:29","modified_gmt":"2022-05-23T20:52:29","slug":"jmeter-soak-test-and-what-it-costs","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/","title":{"rendered":"JMeter Soak Testing and What it Costs"},"content":{"rendered":"

A JMeter Soak Test is a long running load test using JMeter. We\u2019ll talk more below. But if you\u2019re going to run a long test, there are costs that need to be understood. We\u2019ll talk about that with an example from RedLine13 customer University of California.<\/p>\n

What is Soak Testing<\/strong><\/h3>\n

There is plenty of information out there. Software Testing Help<\/a> says: \u201cIt is a type of performance testing to check if an Application Under Test (AUT) can withstand continuous load for a pre-determined time frame.\u201d They go on to talk about the need, when to start, strategies and constraints.<\/p>\n

What it Costs to Soak Test<\/strong><\/h3>\n

Since load testing is almost entirely done in the cloud where there is a per hour or per minute cost, any team doing soak testing is going to have to answer the question of what this will cost. We decided it would be most meaningful to get information from a RedLine13 customer.<\/p>\n

University of California and Soak Testing<\/strong><\/h3>\n

The University of California is a RedLine13 customer. We asked Anukrati Manerikar, from the University of California Office of the President<\/a>, about the JMeter soak testing that they do. They were running soak tests on the HCM PeopleSoft<\/a> online web portal application. She provided information on an actual test with a duration of 13 hours for 3,500 concurrent users. The Load Agent ran on a AWS m5.12Xlarge server.<\/p>\n

We need to next explain the RedLine13 pricing model<\/a> which is unlike others in the load testing industry. RedLine13 charges a subscription price like others but it\u2019s much cheaper and has almost no limitations. The only other cost for our customers is the AWS cost to run the load agents. The load agents are running on the customer AWS servers. That means AWS charges the customer directly without any markup by RedLine13. And RedLine13 doesn\u2019t get back any of the cost charged by AWS.<\/p>\n

Back to our example, the University of California ran their test on an m5.12Xlarge server with 48 vCPUs for 13 hours. And the cost was a little less than $36 as you can see in the screenshot below.<\/p>\n

\"Soak <\/p>\n

Yes, that\u2019s their total cost.<\/p>\n

We can look at this summary screenshot and see some other interesting information. During the soak test, over 2 million requests were sent. You can also see response time information, data usage, etc. RedLine13 also provides much more detailed information.<\/p>\n

Anukrati spoke at the RedLine13 Customer Advisory Board meeting. She spoke about moving from LoadRunner, the quality of the RedLine13 documentation, and more. Read about her talk here<\/a> with a link to a video of her talk.<\/p>\n

JMeter Soak Testing on 30 AWS Servers for 27 Hours – A RedLine13 Customer Shares Their Story<\/h3>\n

Read about another customer running an even bigger soak test<\/a> and what their costs were.<\/p>\n

Try a JMeter Soak Test on RedLine13 for Yourself<\/h3>\n

You can try your own soak test on RedLine13<\/a> for free and see what it will cost you.<\/p>\n","protected":false},"excerpt":{"rendered":"

A JMeter Soak Test is a long running load test using JMeter. We\u2019ll talk more below. But if you\u2019re going to run a long test, there are costs that need to be understood. We\u2019ll talk about that with an example from RedLine13 customer University of California. What is Soak Testing There is plenty of information out there. Software Testing Help says: \u201cIt is a type of performance testing to check if an Application Under Test (AUT)Read More →<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,7],"tags":[88,165,283,408,475],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-user","4":"post-7639","6":"format-standard","7":"category-blog","8":"category-jmeter","9":"post_tag-aws","10":"post_tag-customer","11":"post_tag-jmeter","12":"post_tag-pricing","13":"post_tag-soak-testing"},"yoast_head":"\nJMeter Soak Testing and What it Costs - RedLine13<\/title>\n<meta name=\"description\" content=\"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"JMeter Soak Testing and What it Costs - RedLine13\" \/>\n<meta property=\"og:description\" content=\"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2021-02-05T14:58:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-05-23T20:52:29+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/54.161.25.214\/wp-content\/uploads\/2021\/02\/word-image.png\" \/>\n<meta name=\"author\" content=\"RedLine13\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"RedLine13\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\"},\"author\":{\"name\":\"RedLine13\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\"},\"headline\":\"JMeter Soak Testing and What it Costs\",\"datePublished\":\"2021-02-05T14:58:36+00:00\",\"dateModified\":\"2022-05-23T20:52:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\"},\"wordCount\":501,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"AWS\",\"customer\",\"JMeter\",\"Pricing\",\"soak testing\"],\"articleSection\":[\"Blog\",\"JMeter\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\",\"name\":\"JMeter Soak Testing and What it Costs - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2021-02-05T14:58:36+00:00\",\"dateModified\":\"2022-05-23T20:52:29+00:00\",\"description\":\"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"JMeter Soak Testing and What it Costs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\",\"name\":\"RedLine13\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"caption\":\"RedLine13\"},\"sameAs\":[\"http:\/\/127.0.0.1\"],\"url\":\"https:\/\/www.redline13.com\/blog\/author\/user\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"JMeter Soak Testing and What it Costs - RedLine13","description":"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/","og_locale":"en_US","og_type":"article","og_title":"JMeter Soak Testing and What it Costs - RedLine13","og_description":"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.","og_url":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/","og_site_name":"RedLine13","article_published_time":"2021-02-05T14:58:36+00:00","article_modified_time":"2022-05-23T20:52:29+00:00","og_image":[{"url":"http:\/\/54.161.25.214\/wp-content\/uploads\/2021\/02\/word-image.png"}],"author":"RedLine13","twitter_card":"summary_large_image","twitter_misc":{"Written by":"RedLine13","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/"},"author":{"name":"RedLine13","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28"},"headline":"JMeter Soak Testing and What it Costs","datePublished":"2021-02-05T14:58:36+00:00","dateModified":"2022-05-23T20:52:29+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/"},"wordCount":501,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["AWS","customer","JMeter","Pricing","soak testing"],"articleSection":["Blog","JMeter"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/","url":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/","name":"JMeter Soak Testing and What it Costs - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2021-02-05T14:58:36+00:00","dateModified":"2022-05-23T20:52:29+00:00","description":"A JMeter Soak Test is a long running load test using JMeter. What does it cost? We share costs from RedLine13 customer University of California.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2021\/02\/jmeter-soak-test-and-what-it-costs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"JMeter Soak Testing and What it Costs"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28","name":"RedLine13","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","caption":"RedLine13"},"sameAs":["http:\/\/127.0.0.1"],"url":"https:\/\/www.redline13.com\/blog\/author\/user\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7639","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=7639"}],"version-history":[{"count":1,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7639\/revisions"}],"predecessor-version":[{"id":9678,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7639\/revisions\/9678"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=7639"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=7639"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=7639"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}