{"id":8025,"date":"2021-06-02T13:28:39","date_gmt":"2021-06-02T17:28:39","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=8025"},"modified":"2022-01-18T09:41:32","modified_gmt":"2022-01-18T14:41:32","slug":"how-to-upload-data-files-above-the-limit","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/","title":{"rendered":"How to Upload Data Files Above the Limit"},"content":{"rendered":"\n

<\/p>\n\n\n

\"How<\/p>\n

There are certain situations where you may need to run JMeter<\/a> tests with attached files above file size and count limits<\/a> of your RedLine13 subscription.  In this brief guide, we will walk you through how to upload data files above this limit by hosting extra files in AWS S3<\/a>.<\/p>\n

<\/p>\n

Enabling the JMeter File Download plugin<\/h3>\n

The first step is to make sure the “JMeter File Download<\/em>” plugin<\/a> is installed on your RedLine13 account.  Navigate to “Your Plugins<\/em>” under the main “Account<\/em>” menu:<\/p>\n

\"Accessing<\/p>\n

<\/p>\n

From there, you will want to add the “JMeter File Download<\/em>” plugin from the list by clicking on the “+<\/strong>” icon:<\/p>\n

\"Adding<\/p>\n

Once installed, it will show up under the “Installed<\/em>” plugin listing.<\/p>\n

<\/p>\n

 <\/h3>\n

Setting up an AWS S3 bucket<\/h3>\n

The next few steps deal with uploading your extra files to AWS S3.  In your AWS console, select the S3 service:<\/p>\n

\"Selecting<\/p>\n

Then create an S3 bucket for your files:<\/p>\n

\"Creating<\/p>\n

The bucket name we have given ours in this example is “jmeter-storage-example<\/em>“.  Open the bucket and select “Upload<\/em>” to add your files:<\/p>\n

\"S3<\/p>\n

<\/p>\n

If you have a single file, you can simply upload that file.  If you have multiple files, they will have to be archived together as a TAR or TGZ file<\/a>, which will in turn be extracted on your load agent.  These files end up in the “.\/downloads<\/strong><\/span>” folder on your load agent instances.  Accordingly, the path to a file named example.txt will be “.\/downloads\/example.txt<\/strong><\/span>“.  Below we have added “jmeter-files.tgz<\/strong><\/span>“:<\/p>\n

\"Uploading<\/p>\n

If we select our uploaded file in S3, we can view its properties.  The “Object URL<\/em>” can be copied here.  This is what we will need to access the file from our RedLine13 test:<\/p>\n

\"S3<\/p>\n

<\/p>\n

Tying it all together<\/h3>\n

Back in RedLine13, if we create a new JMeter test, you can find the “Plugins for JMeter Tests<\/em>” subsection under “Advanced JMeter Test Options<\/em>” near the bottom of the page.  Check the box next to “JMeter File Download<\/em>” to enable that plugin.  This should open the box as shown below (with the blue outline). Inside the “File to Download to Load Agents<\/em>” text box, paste the “Object URL<\/em>” copied from the previous step.  Since this file is a TGZ archive and we want to extract it on the load agent, we have also checked that option:<\/p>\n

\"Configuring<\/a>
Configuring the “JMeter File Download<\/em>” plugin.<\/figcaption><\/figure>\n

At this point, when we run the load test, the files contained within “jmeter-files.tgz<\/strong><\/span>” will be downloaded from S3, extracted to “.\/downloads\/…<\/strong><\/span>“, and available on our test instance.  Therefore, we would reference downloaded files in JMeter as follows:<\/p>\n

\"Referencing<\/a><\/p>\n

This effectively moves the upload size limit to 160GB if uploaded to S3 from the console (or up to 5TB if uploaded using the AWS CLI<\/a> or API, documentation here<\/a>), and for practical purposes makes the file count unlimited.<\/p>\n

(Note:<\/em> One additional consideration you may have might be securing your S3 endpoint, which is possible using a pre-signed URL.)<\/p>\n

If you don\u2019t already have a RedLine13 account, we do offer a trial which will allow you to try the procedure detailed here for yourself.  Sign up today<\/a> and get started!<\/p>","protected":false},"excerpt":{"rendered":"

There are certain situations where you may need to include files above file size and count limits of your RedLine13 subscription. In this brief guide, we will walk you through how to upload data files above this limit by hosting extra files in AWS S3.Read More →<\/a><\/p>\n","protected":false},"author":11,"featured_media":8086,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,2,35,41],"tags":[88,213,283,318,424,441],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-dkoziel","4":"has-excerpt","5":"post-8025","7":"format-standard","8":"has-post-thumbnail","9":"category-aws","10":"category-blog","11":"category-load-testing","12":"category-plugins","13":"post_tag-aws","14":"post_tag-file-upload","15":"post_tag-jmeter","16":"post_tag-load-testing","17":"post_tag-redline13","18":"post_tag-s3"},"yoast_head":"\nHow to Upload Data Files Above the Limit - RedLine13<\/title>\n<meta name=\"description\" content=\"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Upload Data Files Above the Limit - RedLine13\" \/>\n<meta property=\"og:description\" content=\"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2021-06-02T17:28:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-01-18T14:41:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2021\/06\/word-image-60.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Koziel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Koziel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\"},\"author\":{\"name\":\"David Koziel\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\"},\"headline\":\"How to Upload Data Files Above the Limit\",\"datePublished\":\"2021-06-02T17:28:39+00:00\",\"dateModified\":\"2022-01-18T14:41:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\"},\"wordCount\":544,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"AWS\",\"file upload\",\"JMeter\",\"Load Testing\",\"RedLine13\",\"S3\"],\"articleSection\":[\"AWS\",\"Blog\",\"Load Testing\",\"Plugins\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\",\"name\":\"How to Upload Data Files Above the Limit - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2021-06-02T17:28:39+00:00\",\"dateModified\":\"2022-01-18T14:41:32+00:00\",\"description\":\"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Upload Data Files Above the Limit\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\",\"name\":\"David Koziel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"caption\":\"David Koziel\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Upload Data Files Above the Limit - RedLine13","description":"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/","og_locale":"en_US","og_type":"article","og_title":"How to Upload Data Files Above the Limit - RedLine13","og_description":"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.","og_url":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/","og_site_name":"RedLine13","article_published_time":"2021-06-02T17:28:39+00:00","article_modified_time":"2022-01-18T14:41:32+00:00","og_image":[{"width":400,"height":300,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2021\/06\/word-image-60.png","type":"image\/png"}],"author":"David Koziel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Koziel","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/"},"author":{"name":"David Koziel","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20"},"headline":"How to Upload Data Files Above the Limit","datePublished":"2021-06-02T17:28:39+00:00","dateModified":"2022-01-18T14:41:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/"},"wordCount":544,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["AWS","file upload","JMeter","Load Testing","RedLine13","S3"],"articleSection":["AWS","Blog","Load Testing","Plugins"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/","url":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/","name":"How to Upload Data Files Above the Limit - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2021-06-02T17:28:39+00:00","dateModified":"2022-01-18T14:41:32+00:00","description":"In this brief guide, we will show you how to upload test data files above the RedLine13 account limit by hosting extra files in AWS S3.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2021\/06\/how-to-upload-data-files-above-the-limit\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"How to Upload Data Files Above the Limit"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20","name":"David Koziel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","caption":"David Koziel"},"url":"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8025","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=8025"}],"version-history":[{"count":3,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8025\/revisions"}],"predecessor-version":[{"id":8905,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/8025\/revisions\/8905"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/8086"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=8025"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=8025"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=8025"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}