{"id":10794,"date":"2023-08-15T10:55:11","date_gmt":"2023-08-15T14:55:11","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=10794"},"modified":"2023-10-12T10:45:45","modified_gmt":"2023-10-12T14:45:45","slug":"chatgpt-assisted-jmeter-load-testing","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/","title":{"rendered":"ChatGPT Assisted JMeter Load Testing"},"content":{"rendered":"

\"\"<\/strong><\/p>\n

There has been a lot of excitement surrounding large language models (LLMs<\/a>) and especially ChatGPT<\/a> made available by OpenAI<\/a>. Heralded as a paradigm in making powerful AI capabilities widely accessible, the GPT-3.5<\/a> and GPT-4<\/a> models behind the ChatGPT interface continue to find uses in business, data science, linguistics, and writing that did not exist in the short time before their release.<\/p>\n

In this article, we will illustrate how the LLM behind ChatGPT can be leveraged to simplify certain steps in creating JMeter<\/a> test plans. We will review several examples and discuss the benefits and limitations of using large language models as AI assistants in the specific context of load testing.<\/p>\n

<\/a>Getting Started<\/h3>\n

Our first step enlisting the assistance of AI is to create an account. From the ChatGPT app<\/a>, you can sign up for a free account<\/a> which gives you access to the GPT-3.5 model \u2013 or you can subscribe for a premium and gain access to the more capable GPT-4 model. For our purposes, the free version will suffice.<\/p>\n

<\/a>Introducing ChatGPT for JMeter Test Design<\/h3>\n

When interacting with ChatGPT, the initial input from the user must be supplied in the form of a prompt<\/a>. To get started, let\u2019s consider the following prompt:<\/p>\n

Create a JMeter test that probes the ultimate load of the website \"http:\/\/www.my-enterprise-app.com\/\".<\/strong><\/pre>\n
The output for each instance of ChatGPT will vary slightly, however we can consistently expect the response in the format which follows. For this general prompt, in this case we received a list of instructions on how to create a JMeter test:<\/p>\n
\"Generic<\/p>\n
If this is not the first time using JMeter, this list of instructions is only marginally useful. This begins to highlight the strengths and weaknesses of the current generation of AI assistant tools. It would be far more beneficial to us if we were much more specific in our requests.<\/p>\n
We can do this using the following prompt:<\/p>\n
How can I set up a JMeter thread group that targets \"http:\/\/www.my-enterprise-app.com\/\" and scales to one million threads over the course of one hour?<\/strong><\/pre>\n
Now things are getting more interesting. While still confronted with a number of generic steps, ChatGPT begins to tell us some specifics. To scale to the level of 1M<\/em> threads, it recommends using the Ultimate Thread Group<\/a> plugin:<\/p>\n
\"ChatGPT<\/p>\n
In addition to this, the output also lists some additional instructions for adding HTTP Request<\/a> samplers to our thread group, and setting the target URL to “www.my-enterprise-app.com”:<\/p>\n
\"Instructions<\/p>\n
However, there are still many manual tasks that remain, and blanks that need to be filled in before we have a working test plan on our hands. For the experienced test designer, we will want to be even more specific in our prompts to ChatGPT to maximize our efficiency using this tool.<\/p>\n
<\/a>ChatGPT helps with Focused Tasks<\/h3>\n
Suppose that we wanted to stress test a new user registration page within our target test application. The form on the page accepts username, email, and password fields. We have a large list of these data fields in a CSV file. We can consider asking ChatGPT using the following prompt:<\/p>\n
Create a JMeter script that generates \u201cusername\u201d, \u201cemail\u201d, and \u201cpassword\u201d form input for an HTTP Request sampler from CSV source data.<\/strong><\/pre>\n
The output is much more specific for our use case. We have file structure, field mappings, and specific instructions on how to integrate our data with various test plan elements:<\/p>\n
\"Instructions<\/p>\n
There are still many tasks that we as the test designer need to complete ourselves. Despite this, ChatGPT has served us in identifying how to configure the test plan elements and outlaid a step-by-step plan on how to achieve what we have asked. Though our use case has limitations, it is still an impressive use of this newly available technology.<\/p>\n
<\/a>Using ChatGPT to Code JMeter Scripts<\/h3>\n
Undeniably ChatGPT excels at conversational output. It is concise, easy to understand, and even polite. However, large language models are not limited to the syntax of written grammar. They also possess a surprisingly good capacity for generating code. Let\u2019s take the next example a step further and enlist ChatGPT to write a short Groovy script as part of a slightly more complicated JMeter test.<\/p>\n
Let\u2019s use the following prompt:<\/p>\n
Write a Groovy script for a JMeter Post processor element that extracts a \u201csuccess\u201d value from a JSON response.<\/strong><\/pre>\n
With enthusiasm, ChatGPT quickly provides the following:<\/p>\n
\"Output<\/p>\n
It suggests using the JSON Extractor<\/a> element, which is appropriate for our use case. Furthermore, it understands the context of \u201ca \u2018<\/em>success\u2019 value from a JSON response<\/em>\u201d usually comes as part of a fully-qualified JSON structure. Without providing the actual format, it inferred that structure as a likely expected response. Using this, it provides the following Groovy script as requested:<\/p>\n
import org.apache.jmeter.threads.JMeterVariables\n<\/strong>\/\/ Get the extracted \"success\" values from the JSON Extractor\n<\/strong>def successValues = vars.getObject(\"successValue_matchNr\")\n<\/strong>\/\/ Initialize a counter for successful responses\n<\/strong>def successfulResponses = 0\n<\/strong>\/\/ Loop through the extracted values and count successful responses\n<\/strong>for (int i = 1; i <= successValues.toInteger(); i++) {\n<\/strong>        def successValue = vars.get(\"successValue_\" + i)\n<\/strong>        if (successValue == \"true\") {\n<\/strong>        successfulResponses++\n<\/strong>    }\n<\/strong>}\n<\/strong>\/\/ Set the total successful responses count to a JMeter variable\n<\/strong>vars.put(\"successfulResponses\", successfulResponses.toString())<\/strong><\/pre>\n
Finally, it also summarizes how the script works:<\/p>\n
\"Supplemental<\/p>\n
Most large language models including GPT-3.5 have understanding of most programming languages. It is possible to ask ChatGPT to automate other coding tasks. This includes writing the JMX test plan file itself. If we wanted to same time and automate some boilerplate tasks in generating the skeleton test plan for any of the above examples, we could follow up entering this prompt:<\/p>\n
Write the raw JMX file for a simple JMeter test.<\/strong><\/pre>\n
The following result is provided by ChatGPT. From the xml<\/strong> code block, we can save the output as a *.JMX<\/strong> file:<\/p>\n
\"Raw<\/p>\n
Opening the output directly in JMeter is possible without any further editing of this code:<\/p>\n
\"View<\/p>\n
<\/a>Conclusion<\/h3>\n
The recent availability of large language models backed by AI assistant interfaces like ChatGPT represent a new tool to help developers automate their workflows. Though often romanticized in the media as a form of sentient intelligence, and feared by many who don\u2019t understand them \u2013 in their present iteration they are merely tools. Like any tool, we can expect the best result by understanding how to properly use them.<\/p>\n
\n
Did you know that RedLine13 offers a full-featured time-limited free trial? Sign up now<\/a>, and start testing today!<\/p>\n","protected":false},"excerpt":{"rendered":"
There has been a lot of excitement surrounding large language models (LLMs) and especially ChatGPT made available by OpenAI. Heralded as a paradigm in making powerful AI capabilities widely accessible, the GPT-3.5 and GPT-4 models behind the ChatGPT interface continue to find uses in business, data science, linguistics, and writing that did not exist in the short time before their release. In this article, we will illustrate how the LLM behind ChatGPT can be leveraged toRead More →<\/a><\/p>\n","protected":false},"author":11,"featured_media":10795,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,7],"tags":[572,644,128,649,283,646,645,318,424,647],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-dkoziel","4":"post-10794","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"category-jmeter","10":"post_tag-ai","11":"post_tag-chatgpt","12":"post_tag-cloud-load-testing","13":"post_tag-examples","14":"post_tag-jmeter","15":"post_tag-large-language-models","16":"post_tag-llm","17":"post_tag-load-testing","18":"post_tag-redline13","19":"post_tag-test-automation"},"yoast_head":"\nChatGPT Assisted JMeter Load Testing - RedLine13<\/title>\n<meta name=\"description\" content=\"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ChatGPT Assisted JMeter Load Testing - RedLine13\" \/>\n<meta property=\"og:description\" content=\"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-15T14:55:11+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-12T14:45:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2023\/08\/word-image-10794-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Koziel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Koziel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\"},\"author\":{\"name\":\"David Koziel\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\"},\"headline\":\"ChatGPT Assisted JMeter Load Testing\",\"datePublished\":\"2023-08-15T14:55:11+00:00\",\"dateModified\":\"2023-10-12T14:45:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\"},\"wordCount\":910,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"AI\",\"ChatGPT\",\"Cloud Load Testing\",\"examples\",\"JMeter\",\"large language models\",\"LLM\",\"Load Testing\",\"RedLine13\",\"Test Automation\"],\"articleSection\":[\"Blog\",\"JMeter\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\",\"name\":\"ChatGPT Assisted JMeter Load Testing - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2023-08-15T14:55:11+00:00\",\"dateModified\":\"2023-10-12T14:45:45+00:00\",\"description\":\"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ChatGPT Assisted JMeter Load Testing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\",\"name\":\"David Koziel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"caption\":\"David Koziel\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ChatGPT Assisted JMeter Load Testing - RedLine13","description":"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/","og_locale":"en_US","og_type":"article","og_title":"ChatGPT Assisted JMeter Load Testing - RedLine13","og_description":"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.","og_url":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/","og_site_name":"RedLine13","article_published_time":"2023-08-15T14:55:11+00:00","article_modified_time":"2023-10-12T14:45:45+00:00","og_image":[{"width":400,"height":300,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2023\/08\/word-image-10794-1.png","type":"image\/png"}],"author":"David Koziel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Koziel","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/"},"author":{"name":"David Koziel","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20"},"headline":"ChatGPT Assisted JMeter Load Testing","datePublished":"2023-08-15T14:55:11+00:00","dateModified":"2023-10-12T14:45:45+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/"},"wordCount":910,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["AI","ChatGPT","Cloud Load Testing","examples","JMeter","large language models","LLM","Load Testing","RedLine13","Test Automation"],"articleSection":["Blog","JMeter"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/","url":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/","name":"ChatGPT Assisted JMeter Load Testing - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2023-08-15T14:55:11+00:00","dateModified":"2023-10-12T14:45:45+00:00","description":"ChatGPT can be leveraged to simplify certain steps in creating JMeter test plans. Examples included plus benefits and limitations.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/chatgpt-assisted-jmeter-load-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"ChatGPT Assisted JMeter Load Testing"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20","name":"David Koziel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","caption":"David Koziel"},"url":"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10794","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=10794"}],"version-history":[{"count":3,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10794\/revisions"}],"predecessor-version":[{"id":10808,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10794\/revisions\/10808"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/10795"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=10794"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=10794"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=10794"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}