{"id":9351,"date":"2022-03-28T11:05:53","date_gmt":"2022-03-28T15:05:53","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=9351"},"modified":"2022-04-11T10:13:29","modified_gmt":"2022-04-11T14:13:29","slug":"compare-load-tests-results-using-csv-data","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/","title":{"rendered":"Compare Load Tests Results using CSV Data"},"content":{"rendered":"

\"Compare<\/strong><\/p>\n

RedLine13 provides detailed real-time and post-test metrics, but there may be certain cases where you want to compare load test results.\u00a0 In this post, we will discuss some of the ways you can compare metrics both within the same test, and between multiple tests.<\/p>\n

Compare Results from Multiple Load Tests<\/h3>\n

It is possible to compare results between multiple test runs by combining exports and using a spreadsheet application like Excel.\u00a0 Below we have a graph which combines request response times for three different test runs.\u00a0 One reason why we might do this is to ensure that our test is reliable and produces the same results over multiple runs.<\/p>\n

\"Response
This composite graph was made by simply combining columns from CSV exports for multiple test runs from RedLine13. The consistent response times help to validate with evidence that these tests produce consistent results.<\/figcaption><\/figure>\n

Working with Exported Results<\/h3>\n
\"Detail
The “Export as CSV” button is a feature of RedLine13 graphs.<\/figcaption><\/figure>\n

You can easily export many graphed metrics simply by clicking on the \u201cExport as CSV<\/em>\u201d button for the particular chart you want. (We will also discuss more advanced exports directly from JMeter<\/a> later.) The above graph shows average response times which are specific to the test results. Additionally we expose graphs for load generators such as average CPU usage shown below:<\/p>\n

\"Graph
Sampled load agent CPU usage and other load generator metrics are among those available for CSV export.<\/figcaption><\/figure>\n

The graphs that you chose to export will depend on the type of analysis you are conducting.\u00a0 Data from exported graphs is focused and concise for your convenience.\u00a0 There are other options we provide if you need more advanced data exports.<\/p>\n

<\/a>Structure of RedLine13 Exports<\/h3>\n

Clicking on the \u201cExport as CSV<\/em>\u201d button will download a comma-separated values<\/a> (CSV) file. The format of this file is straightforward. In the first column there will be a \u201ctimestamp<\/em>\u201d value which is a numeric representation (epoch time<\/a>) of when the data point was sampled.<\/p>\n

\"Sample<\/p>\n

To do useful analysis on this data, convert the raw timestamp with programs such as Microsoft Excel, which can easily convert this time into a more human readable format.<\/p>\n

The formula for the time conversion in Excel is:<\/p>\n

=(VALUE\/86400)+DATE(1970,1,1)<\/strong><\/span><\/pre>\n
Compare Results from Multiple Sources within the Same Test<\/h3>\n
Once you have the data and converted date and time in a program like Excel, it is possible to run some interesting derivative analyses.<\/p>\n
\"compare<\/p>\n
In this basic example, we can compare response times from requests within our tests side-by-side with load generator CPU usage. This lets us analyze to see if there is any correlation between the two. If true, this would suggest response times are artificially high due to load generators becoming overloaded. The above graph does not<\/em> indicate this, and therefore substantiates our results in this regard.<\/p>\n
<\/a>Accessing the Raw Data<\/h3>\n
When you run a test with RedLine13, we give you the option of saving all of the raw data for the purposes of doing your own custom analysis. To enable visibility of this at the end of your test, you\u2019ll need to ensure you select this option before<\/em> your test runs:<\/p>\n
\"Checkbox<\/p>\n
With response output saved, you can find several new options under \u201cOutput Files<\/em>\u201d shortly after your test concludes. Here you will find the option to download or view your JMeter Dashboard Report. Just below that, we present the option to download a \u201cGenerated Merged JTL<\/em>\u201d file:<\/p>\n
\"Options
The merged JTL file is available for download after your JMeter test concludes, when output files are saved for that test.<\/figcaption><\/figure>\n
Essentially this JTL file<\/a> is the full raw JMeter test output in CSV format. You can open this file directly from a program such as Excel and perform similar analyses as the CSV exports we have described above. The difference here is the added data which is available. Here you can find the HTTP response code, thread name, bytes transmitted, response times, and much more. Each row is similarly time coded in epoch time, meaning that load generator metrics like CPU and memory usage can be overlaid as shown in the example above.<\/p>\n
<\/a>More Data with Integrations<\/h3>\n
In terms of the types of analyses most businesses need, CSV suffices remarkably well. However, we do understand that more specialized applications might require a deeper analysis including external metrics. For these cases, we have a few recommendations. An application performance monitoring (APM) framework such as Dynatrace<\/a> will allow you to custom instrument your tests. In another post we have covered how to integrate with JMeter and get metrics from your tests into Dynatrace<\/a>. Another solution would be to capture additional metrics with the time series database InfluxDB<\/a>. RedLine13 offers a plugin for this tool, which can in turn integrate with visualization software like Grafana<\/a>. We have in fact covered one customer\u2019s experience<\/a> where they used this in their load tests.<\/p>\n
\n
RedLine13 offers a full-featured free trial that gives you access to everything we discussed in this post. Sign up now<\/a> and start testing today!<\/p>\n","protected":false},"excerpt":{"rendered":"
RedLine13 provides detailed real-time and post-test metrics, but there may be certain cases where you want to compare load test results.\u00a0 In this post, we will discuss some of the ways you can compare metrics both within the same test, and between multiple tests. Compare Results from Multiple Load Tests It is possible to compare results between multiple test runs by combining exports and using a spreadsheet application like Excel.\u00a0 Below we have a graph whichRead More →<\/a><\/p>\n","protected":false},"author":11,"featured_media":9352,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[574,169,283,318,424],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-dkoziel","4":"post-9351","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"post_tag-csv","10":"post_tag-data-analysis","11":"post_tag-jmeter","12":"post_tag-load-testing","13":"post_tag-redline13"},"yoast_head":"\nCompare Load Tests Results using CSV Data - RedLine13<\/title>\n<meta name=\"description\" content=\"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Compare Load Tests Results using CSV Data - RedLine13\" \/>\n<meta property=\"og:description\" content=\"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-28T15:05:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-04-11T14:13:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/03\/word-image-9.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"270\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Koziel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Koziel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\"},\"author\":{\"name\":\"David Koziel\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\"},\"headline\":\"Compare Load Tests Results using CSV Data\",\"datePublished\":\"2022-03-28T15:05:53+00:00\",\"dateModified\":\"2022-04-11T14:13:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\"},\"wordCount\":861,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"CSV\",\"Data Analysis\",\"JMeter\",\"Load Testing\",\"RedLine13\"],\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\",\"name\":\"Compare Load Tests Results using CSV Data - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2022-03-28T15:05:53+00:00\",\"dateModified\":\"2022-04-11T14:13:29+00:00\",\"description\":\"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Compare Load Tests Results using CSV Data\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\",\"name\":\"David Koziel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"caption\":\"David Koziel\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Compare Load Tests Results using CSV Data - RedLine13","description":"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/","og_locale":"en_US","og_type":"article","og_title":"Compare Load Tests Results using CSV Data - RedLine13","og_description":"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.","og_url":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/","og_site_name":"RedLine13","article_published_time":"2022-03-28T15:05:53+00:00","article_modified_time":"2022-04-11T14:13:29+00:00","og_image":[{"width":400,"height":270,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/03\/word-image-9.png","type":"image\/png"}],"author":"David Koziel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Koziel","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/"},"author":{"name":"David Koziel","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20"},"headline":"Compare Load Tests Results using CSV Data","datePublished":"2022-03-28T15:05:53+00:00","dateModified":"2022-04-11T14:13:29+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/"},"wordCount":861,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["CSV","Data Analysis","JMeter","Load Testing","RedLine13"],"articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/","url":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/","name":"Compare Load Tests Results using CSV Data - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2022-03-28T15:05:53+00:00","dateModified":"2022-04-11T14:13:29+00:00","description":"RedLine13 allows you to compare load test results using CSV data exports. In this blog post, we will discuss how.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2022\/03\/compare-load-tests-results-using-csv-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Compare Load Tests Results using CSV Data"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20","name":"David Koziel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","caption":"David Koziel"},"url":"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/9351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=9351"}],"version-history":[{"count":13,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/9351\/revisions"}],"predecessor-version":[{"id":9443,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/9351\/revisions\/9443"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/9352"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=9351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=9351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=9351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}