{"id":10820,"date":"2023-08-30T07:11:34","date_gmt":"2023-08-30T11:11:34","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=10820"},"modified":"2023-10-12T10:45:18","modified_gmt":"2023-10-12T14:45:18","slug":"compare-jmeter-test-results","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/","title":{"rendered":"Compare JMeter Test Results with the JMeter Merge Results Plugin"},"content":{"rendered":"

<\/a> \"Compare<\/p>\n

A common approach to load testing often involves running a series of load tests to ascertain the performance of a target test application. The question that is sometimes asked is how to compare JMeter test results from two or more runs of a similar JMeter<\/a> test on the same graph. In this article we will show you how to compare the results of two separate load tests using the Merge Results<\/em><\/a> plugin.<\/p>\n

In a previous post<\/a> we reviewed some of the most popular JMeter plugins. On that list was one called the Merge Results<\/em> plugin. This element differs from most other types of test plan elements in that it is not intended to run as part of a test in itself. Rather, it is a tool to be used locally that accepts the JTL<\/code> results from one or more previously executed tests. It then performs a merge operation on those results into a single combined JTL<\/code> file.<\/p>\n

<\/a>Configuring the Merge Results Plugin<\/h3>\n

We can think of the Merge Results<\/em> plugin as a stand-alone utility, however we must be inside JMeter in order to use it. It must be added to a test plan, however there is no requirement that it be part of your load test, or even for the test plan to be saved. Once it has been installed from the Plugins Manager<\/a>, right click the root test plan element to add a new component. Select from the \u201cNon-Test Elements<\/em>\u201d submenu, and you will find the option for the Merge Results<\/em> plugin.<\/p>\n

\"The
The Merge Results plugin is added as a Non-Test Element.<\/figcaption><\/figure>\n

The most essential task to using the Merge Results<\/em> plugin is to reference your JTL<\/code> files from previous JMeter test runs. If you have previous test runs using RedLine13, you can access these by enabling output files<\/a>. Under the \u201cMerge Options<\/em>\u201d heading, you can add multiple rows with each one referencing the results file from a separate test under the \u201cInput File Name<\/em>\u201d column:<\/p>\n

\"Configuring
Configuring the Merge Results plugin.<\/figcaption><\/figure>\n

It is also very useful to specify a unique \u201cPrefix Label<\/em>\u201d for each row, as this will allow you to distinguish or separately graph load test results grouped by test run. In this example we used TEST 1<\/code> and TEST 2<\/code> which will be reflected in the merged results.<\/p>\n

The last textbox at the bottom of the Merge Results configuration is where you specify the filename of the merged JTL<\/code> file that will be created as part of the merge process. This is a location that you select. The \u201cConfigure<\/em>\u201d button to the right will give you advanced options as to what columns are to be exported within the merged JTL<\/code> file.<\/p>\n

<\/a>Visualizing Merged Results<\/h3>\n

Once you have specified all of your input files, click on the \u201cMerge<\/em>\u201d button to generate the merged JTL<\/code> output. The default format for this output is CSV<\/a><\/code>, though XML<\/a><\/code> is a configurable option. If exported in CSV<\/code> format, you may directly open the JTL<\/code> file in a spreadsheet application such as Excel<\/a> to make graphs or conduct derivative analysis.<\/p>\n

A more classical option is to generate the JMeter Dashboard Report<\/em><\/a> on this merged JTL<\/code> file. This feature is built into the JMeter user interface, and can be accessed from the \u201cTools<\/em>\u201d menu:<\/p>\n

\"The<\/p>\n

This will display a dialog which has several required fields. The \u201cResults File<\/em>\u201d textbox is where you can specify the path to your newly generated merged JTL<\/code> file. As shown, this will accept a file either in JTL<\/code> or CSV<\/code>\u00a0format:<\/p>\n

\"The<\/p>\n

Also required is a user.properties<\/code> file, though the relevance of this may not be important to your results and therefore a file with default values is often suitable. The \u201cOutput Directory<\/em>\u201d field is where you can specify a destination folder for your generated JMeter Dashboard Report<\/em>. This folder must be empty of all contents in order to proceed. Once these options are set, click on the \u201cGenerate Report<\/em>\u201d button to create your HTML dashboard report.<\/p>\n

Once the JMeter Dashboard Report<\/em> is generated, you can open the index.html file from the output directory you have entered above. Under the \u201cCharts<\/em>\u201d heading, you will find all the usual tables, charts, and graphs within this report that contain and compare the results from your multiple specified load tests. Here is an example of a Response Time Percentiles<\/em> graph showing combined results form both of our specified example tests:<\/p>\n

\"Compare
Data from multiple tests displayed on a merged graph within the JMeter Dashboard Report.<\/figcaption><\/figure>\n

The capability to compare JMeter test results extends beyond just the ability to compare two side-by-side. You may enter as many input JTL<\/code> files as you have available to create even more sophisticated comparisons. You can also perform advanced statistical analyses beyond the JMeter Dashboard Report<\/em> by using the CSV<\/code> format and a spreadsheet application.<\/p>\n

\n

Did you know that RedLine13 offers a full-featured, time-limited free trial? Sign up now<\/a>, and start testing today!<\/p>\n","protected":false},"excerpt":{"rendered":"

A common approach to load testing often involves running a series of load tests to ascertain the performance of a target test application. The question that is sometimes asked is how to compare JMeter test results from two or more runs of a similar JMeter test on the same graph. In this article we will show you how to compare the results of two separate load tests using the Merge Results plugin. In a previous postRead More →<\/a><\/p>\n","protected":false},"author":11,"featured_media":10821,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,7],"tags":[128,152,653,283,654,299,652,318,651,650,424],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-dkoziel","4":"post-10820","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"category-jmeter","10":"post_tag-cloud-load-testing","11":"post_tag-csv-file","12":"post_tag-csv-results","13":"post_tag-jmeter","14":"post_tag-jmeter-plugin","15":"post_tag-jmeter-plugins","16":"post_tag-jtl-file","17":"post_tag-load-testing","18":"post_tag-merge-jtl","19":"post_tag-merge-results","20":"post_tag-redline13"},"yoast_head":"\nCompare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13<\/title>\n<meta name=\"description\" content=\"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Compare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13\" \/>\n<meta property=\"og:description\" content=\"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-30T11:11:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-12T14:45:18+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2023\/08\/word-image-10820-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Koziel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Koziel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\"},\"author\":{\"name\":\"David Koziel\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\"},\"headline\":\"Compare JMeter Test Results with the JMeter Merge Results Plugin\",\"datePublished\":\"2023-08-30T11:11:34+00:00\",\"dateModified\":\"2023-10-12T14:45:18+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\"},\"wordCount\":824,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"Cloud Load Testing\",\"CSV File\",\"CSV Results\",\"JMeter\",\"JMeter Plugin\",\"jmeter-plugins\",\"JTL file\",\"Load Testing\",\"Merge JTL\",\"Merge Results\",\"RedLine13\"],\"articleSection\":[\"Blog\",\"JMeter\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\",\"name\":\"Compare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2023-08-30T11:11:34+00:00\",\"dateModified\":\"2023-10-12T14:45:18+00:00\",\"description\":\"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Compare JMeter Test Results with the JMeter Merge Results Plugin\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\",\"name\":\"David Koziel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"caption\":\"David Koziel\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Compare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13","description":"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/","og_locale":"en_US","og_type":"article","og_title":"Compare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13","og_description":"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin","og_url":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/","og_site_name":"RedLine13","article_published_time":"2023-08-30T11:11:34+00:00","article_modified_time":"2023-10-12T14:45:18+00:00","og_image":[{"width":400,"height":300,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2023\/08\/word-image-10820-1.png","type":"image\/png"}],"author":"David Koziel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Koziel","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/"},"author":{"name":"David Koziel","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20"},"headline":"Compare JMeter Test Results with the JMeter Merge Results Plugin","datePublished":"2023-08-30T11:11:34+00:00","dateModified":"2023-10-12T14:45:18+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/"},"wordCount":824,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["Cloud Load Testing","CSV File","CSV Results","JMeter","JMeter Plugin","jmeter-plugins","JTL file","Load Testing","Merge JTL","Merge Results","RedLine13"],"articleSection":["Blog","JMeter"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/","url":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/","name":"Compare JMeter Test Results with the JMeter Merge Results Plugin - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2023-08-30T11:11:34+00:00","dateModified":"2023-10-12T14:45:18+00:00","description":"Compare JMeter test results from two or more runs of a similar JMeter test on the same graph with the Merge Results Plugin","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2023\/08\/compare-jmeter-test-results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Compare JMeter Test Results with the JMeter Merge Results Plugin"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20","name":"David Koziel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","caption":"David Koziel"},"url":"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=10820"}],"version-history":[{"count":3,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10820\/revisions"}],"predecessor-version":[{"id":10830,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10820\/revisions\/10830"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/10821"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=10820"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=10820"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=10820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}