{"id":7735,"date":"2021-03-17T09:20:05","date_gmt":"2021-03-17T13:20:05","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=7735"},"modified":"2022-05-23T16:49:38","modified_gmt":"2022-05-23T20:49:38","slug":"stop-a-jmeter-load-test","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/","title":{"rendered":"Automatically stop a JMeter load test after too many errors"},"content":{"rendered":"

Despite our best efforts, we have all been there before. That load test that just concluded generated thousands of errors that it shouldn\u2019t have. It could have been a miscalculation or a shifted decimal place on estimated traffic volumes; or rather it was a configuration setting on the target machines that was overlooked. Regardless, we wish we could have intercepted that test early in its execution, possibly saving valuable time, data charges, and virtual machine costs. Wouldn’t it be nice if there was a setting that we could tick to automatically stop a JMeter load test upon x<\/em> number of errors encountered? Or better yet, after x<\/em> number of a certain type of error?<\/p>\n

If you were wondering if this is possible, this blog post will come as good news. There isn\u2019t a JMeter setting, but with a few lines of BeanShell<\/a> or Groovy<\/a> inside your test plan, we will show you step-by-step how to automatically stop a JMeter load test upon generating too many errors, and even provide you with some interesting suggestions on how you can take this automation a step further.<\/p>\n

<\/p>\n

The basic structure of our simple test plan which is covered step-by-step below.<\/span><\/p>\n

How to stop a JMeter load test in a few easy steps:<\/h2>\n

Step 1.   Create a test plan<\/strong><\/h3>\n

Create a new JMeter test plan containing a few basic elements. We will need a regular Thread Group<\/em> to contain our test, and to that we will add a \u201cOnce Only Controller<\/em><\/a>\u201d and a \u201cLoop Controller<\/em><\/a>\u201d:<\/p>\n

<\/p>\n

Step 2.  Add initial controller<\/strong><\/h3>\n

Under our \u201cOnce Only Controller<\/em>\u201d, we\u2019ll want to add a \u201cBeanShell Preprocessor<\/em><\/a>\u201d containing the following script.<\/p>\n

<\/p>\n

For convenience you can copy and paste these lines as follows:<\/p>\n

\n
 vars.put(\"__threshold\", \"10\");<\/strong>
 vars.put(\"__count\", \"0\");<\/strong>
 vars.put(\"__loopCount\", \"100\");<\/strong><\/pre>\n<\/blockquote>\n
This will set us up to run one-hundred requests, however as you will see later, __threshold<\/strong> will cause the test to abort upon encountering ten HTTP errors.<\/p>\n
Step 3.  Make it loop<\/strong><\/h3>\n
Moving to our \u201cLoop Controller<\/em>\u201d we will want to set the \u201cLoop Count<\/em>\u201d field to ${__loopCount}<\/strong> as depicted below. JMeter will automatically pull this value as we have set it in the previous step, making it convenient to configure our test from a single location.<\/p>\n
<\/p>\n
Step 4.  Add a web request<\/strong><\/h3>\n
Still under our \u201cLoop Controller<\/em>\u201d, we will want to add an \u201cHTTP Request<\/em><\/a>\u201d (here aptly named \u201cError-Prone HTTP Request\u201d) that will likely generate an error for the purposes of our demonstration. To achieve this, we have specified a web address which does not resolve, though any request that generates an error (e.g.<\/em>, 404 not found, 500 internal error, etc<\/em>.) will do. You can also see in the screen capture below that we have added a \u201cFlow Control Action<\/em><\/a>\u201d which is an optional step to delay each request by 500ms simply to make execution slow enough that we can follow along as our test runs.<\/p>\n
<\/p>\n
Step 5.  Add the conditional logic<\/strong><\/h3>\n
This is where we will add the error detection and test termination logic. Under our \u201cLoop Controller<\/em>\u201d we will want to add a \u201cBeanShell Postprocessor<\/em><\/a>\u201d containing the following lines of scripting:<\/p>\n
<\/p>\n
For convenience you can copy and paste these lines as follows:<\/p>\n
\n
int __count = Integer.parseInt(vars.get(\"__count\"));<\/strong>
int __threshold = Integer.parseInt(vars.get(\"__threshold\"));<\/strong>
int responseCode;<\/strong>
try {<\/strong>
  responseCode = Integer.parseInt(prev.getResponseCode());<\/strong>
}
<\/strong>catch (Exception ex) {<\/strong>
  responseCode = 0;<\/strong>
}<\/strong>
boolean errorResponse = ((responseCode < 200) || <\/strong>
  (responseCode >= 400) || (prev.getErrorCount() > 0));<\/strong>
if (errorResponse) {<\/strong>
  __count = __count + 1;<\/strong>
}<\/strong>
log.warn( \"Errors = \" + __count );<\/strong>
if (__count >= __threshold) {<\/strong>
log.warn(\"Maximum number of errors reached, aborting test.\");<\/strong>
  ctx.getEngine().stopTest();<\/strong>
}<\/strong>
vars.put(\"__count\", String.valueOf(__count));<\/strong><\/pre>\n<\/blockquote>\n
Step 6.  Prove we can stop a JMeter load test<\/strong><\/h3>\n
From the \u201cOptions<\/em>\u201d menu, you may want to select \u201cLog viewer<\/em>\u201d which will show the output from our JMeter test as we run in GUI mode to debug. In the lower pane of JMeter shown in the screen capture below, you can easily see that our test generates errors which are accumulated in our __count<\/strong> variable and upon reaching the value of 10<\/strong> specified in __threshold<\/strong>, the test terminates despite not reaching the preconfigured number of iterations.<\/p>\n
\"stop<\/strong><\/p>\n
This example was purposely crafted in a simple manner to most easily convey the concept of how to stop a JMeter load test early based on certain error conditions. We chose to use any HTTP response that generated a web exception or was not a 200<\/strong> or 300<\/strong> series code. The determination of what constitutes the error is entirely at your discretion as it relates to your specific design requirements. You may even consider intercepting this condition to interface with a messaging service to send an alert, as you will likely be preoccupied with the enjoyment that this type of automation brings. See how easy it is to implement this how-to guide with a free RedLine13<\/a> trial subscription.<\/p>\n\n\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
Despite our best efforts, we have all been there before. That load test that just concluded generated thousands of errors that it shouldn\u2019t have. It could have been a miscalculation or a shifted decimal place on estimated traffic volumes; or rather it was a configuration setting on the target machines that was overlooked. Regardless, we wish we could have intercepted that test early in its execution, possibly saving valuable time, data charges, and virtual machine costs.Read More →<\/a><\/p>\n","protected":false},"author":1,"featured_media":7833,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,7],"tags":[100,195,236,283,318,424],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-user","4":"post-7735","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"category-jmeter","10":"post_tag-beanshell","11":"post_tag-error-handling","12":"post_tag-groovy","13":"post_tag-jmeter","14":"post_tag-load-testing","15":"post_tag-redline13"},"yoast_head":"\nAutomatically stop a JMeter load test after too many errors - RedLine13<\/title>\n<meta name=\"description\" content=\"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automatically stop a JMeter load test after too many errors - RedLine13\" \/>\n<meta property=\"og:description\" content=\"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2021-03-17T13:20:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-05-23T20:49:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2021\/03\/Title-Image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"320\" \/>\n\t<meta property=\"og:image:height\" content=\"230\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"RedLine13\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"RedLine13\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\"},\"author\":{\"name\":\"RedLine13\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\"},\"headline\":\"Automatically stop a JMeter load test after too many errors\",\"datePublished\":\"2021-03-17T13:20:05+00:00\",\"dateModified\":\"2022-05-23T20:49:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\"},\"wordCount\":733,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"Beanshell\",\"Error Handling\",\"Groovy\",\"JMeter\",\"Load Testing\",\"RedLine13\"],\"articleSection\":[\"Blog\",\"JMeter\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\",\"name\":\"Automatically stop a JMeter load test after too many errors - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2021-03-17T13:20:05+00:00\",\"dateModified\":\"2022-05-23T20:49:38+00:00\",\"description\":\"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Automatically stop a JMeter load test after too many errors\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28\",\"name\":\"RedLine13\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g\",\"caption\":\"RedLine13\"},\"sameAs\":[\"http:\/\/127.0.0.1\"],\"url\":\"https:\/\/www.redline13.com\/blog\/author\/user\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Automatically stop a JMeter load test after too many errors - RedLine13","description":"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/","og_locale":"en_US","og_type":"article","og_title":"Automatically stop a JMeter load test after too many errors - RedLine13","og_description":"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.","og_url":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/","og_site_name":"RedLine13","article_published_time":"2021-03-17T13:20:05+00:00","article_modified_time":"2022-05-23T20:49:38+00:00","og_image":[{"width":320,"height":230,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2021\/03\/Title-Image.png","type":"image\/png"}],"author":"RedLine13","twitter_card":"summary_large_image","twitter_misc":{"Written by":"RedLine13","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/"},"author":{"name":"RedLine13","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28"},"headline":"Automatically stop a JMeter load test after too many errors","datePublished":"2021-03-17T13:20:05+00:00","dateModified":"2022-05-23T20:49:38+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/"},"wordCount":733,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["Beanshell","Error Handling","Groovy","JMeter","Load Testing","RedLine13"],"articleSection":["Blog","JMeter"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/","url":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/","name":"Automatically stop a JMeter load test after too many errors - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2021-03-17T13:20:05+00:00","dateModified":"2022-05-23T20:49:38+00:00","description":"Follow along step-by-step as we show you how to automatically stop a JMeter load test after reaching a predetermined error theshold.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2021\/03\/stop-a-jmeter-load-test\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Automatically stop a JMeter load test after too many errors"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/4acbcdcb8a9c72ec5a274e69c0ebea28","name":"RedLine13","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4c9a289323b21a01c3e940f150eb9b8c542587f1abfd8f0e1cc1ffc5e475514?s=96&d=mm&r=g","caption":"RedLine13"},"sameAs":["http:\/\/127.0.0.1"],"url":"https:\/\/www.redline13.com\/blog\/author\/user\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7735","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=7735"}],"version-history":[{"count":1,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7735\/revisions"}],"predecessor-version":[{"id":9670,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/7735\/revisions\/9670"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/7833"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=7735"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=7735"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=7735"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}