Skip to content
  • ZipCode Api
  • Blog
  • About RedLine13
RedLine13
RedLine13
Primary Navigation Menu
Menu
  • Start Testing
  • Demo
  • Pricing
  • JMeter
  • Partners
  • Docs
    • Documentation Home
    • AWS Set Up for load testing
    • AWS Approval for Large Tests
    • PHP, NodeJS, Python Load Tests
    • Scalability
    • Jenkins Plugin Setup
    • Premium Features
    • Knowledge Base

How to Upload Data Files Above the Limit

By: David Koziel

How to Upload Data Files Above the Limit

There are certain situations where you may need to run JMeter tests with attached files above file size and count limits of your RedLine13 subscription.  In this brief guide, we will walk you through how to upload data files above this limit by hosting extra files in AWS S3.

Enabling the JMeter File Download plugin

The first step is to make sure the “JMeter File Download” plugin is installed on your RedLine13 account.  Navigate to “Your Plugins” under the main “Account” menu:

Accessing "Your Plugins" from the main Account menu

From there, you will want to add the “JMeter File Download” plugin from the list by clicking on the “+” icon:

Adding the JMeter File Download plugin

Once installed, it will show up under the “Installed” plugin listing.

 

Setting up an AWS S3 bucket

The next few steps deal with uploading your extra files to AWS S3.  In your AWS console, select the S3 service:

Selecting the AWS S3 Service

Then create an S3 bucket for your files:

Creating a new S3 storage bucket

The bucket name we have given ours in this example is “jmeter-storage-example“.  Open the bucket and select “Upload” to add your files:

S3 storage bucket details

If you have a single file, you can simply upload that file.  If you have multiple files, they will have to be archived together as a TAR or TGZ file, which will in turn be extracted on your load agent.  These files end up in the “./downloads” folder on your load agent instances.  Accordingly, the path to a file named example.txt will be “./downloads/example.txt“.  Below we have added “jmeter-files.tgz“:

Uploading file contents into an S3 storage bucket

If we select our uploaded file in S3, we can view its properties.  The “Object URL” can be copied here.  This is what we will need to access the file from our RedLine13 test:

S3 storage bucket content properties

Tying it all together

Back in RedLine13, if we create a new JMeter test, you can find the “Plugins for JMeter Tests” subsection under “Advanced JMeter Test Options” near the bottom of the page.  Check the box next to “JMeter File Download” to enable that plugin.  This should open the box as shown below (with the blue outline). Inside the “File to Download to Load Agents” text box, paste the “Object URL” copied from the previous step.  Since this file is a TGZ archive and we want to extract it on the load agent, we have also checked that option:

Configuring the JMeter File Download plugin
Configuring the “JMeter File Download” plugin.

At this point, when we run the load test, the files contained within “jmeter-files.tgz” will be downloaded from S3, extracted to “./downloads/…“, and available on our test instance.  Therefore, we would reference downloaded files in JMeter as follows:

Referencing a downloaded file in a JMeter test plan

This effectively moves the upload size limit to 160GB if uploaded to S3 from the console (or up to 5TB if uploaded using the AWS CLI or API, documentation here), and for practical purposes makes the file count unlimited.

(Note: One additional consideration you may have might be securing your S3 endpoint, which is possible using a pre-signed URL.)

If you don’t already have a RedLine13 account, we do offer a trial which will allow you to try the procedure detailed here for yourself.  Sign up today and get started!

2021-06-02
Previous Post: How to Automatically Install JMeter Plugins
Next Post: Advanced JMeter Training

Recent Posts

  • JMeter XML Format Post Processor
  • Order of Elements in JMeter
  • The JMeter Synthesis Report
  • Using the JMeter Plugins Manager
  • JMeter Rotating JTL Listener

Related

  • JMeter XML Format Post Processor
  • Order of Elements in JMeter
  • The JMeter Synthesis Report
  • Using the JMeter Plugins Manager
  • JMeter Rotating JTL Listener
  • Using Test Fragments in JMeter Tests
  • Step-by-Step Guide to Testing with JMeter
  • Functional Testing vs Performance Testing
  • A Gentle Introduction to Load Testing
  • Using the JMeter Counter Element

© RedLine13, LLC | Privacy Policy | Contract
Contact Us: info@redline13.com

Designed using Responsive Brix. Powered by WordPress.