RedLine13 is a load testing platform that brings the low cost power of the cloud to JMeter and other open source load testing tools.
Pricing and features for RedLine13 is simple and straightforward. As our tagline implies, we’re all about (almost) free load testing. Here at RedLine13 we provide a central service that allows our users the ability to freely create an account, setup connections to your AWS account, configure and run load tests, view real time graphics and reports, and to see how much money was spent on your Amazon account for the test. Additionally users can opt for a range of paid, subscription-based accounts that grant them even more features. For your convenience we have outlined our various subscriptions, their costs, and the features that you get with each.
|Plan for single user||Plan for a testing team||Custom plan for multiple teams|
One day of length
1 Team Member
Unlimited Test length
1 Team Members
Unlimited Test length
20 Team Members (more can be added – see below)
What is a vCPU? Every AWS server has a virtual CPU count. For example, an m5.xlarge instance type has four virtual CPUs in total. See AWS EC2 for details.
Limited time offer: All new paid RedLine13 accounts at any paid subscription level will get a free copy of the new eBook Master Apache JMeter. “All the power of Apache JMeter explained by 3 members of project’s team who are also experts in the performance field.”
Compare plans in detail below.
|Features||Free Subscription||Basic Subscription||Premium Subscription|
|Supported Test Types|
(JMeter, Gatling, Custom, LogFile, URL)
|Number of Tests||Unlimited||Unlimited||Unlimited|
|Test Duration||1 Day||Unlimited||Unlimited|
|Virtual CPUs (vCPUs)||10||50||Unlimited|
|File Upload Limit||1||5||25|
|Users for JMeter-Selenium||Unlimited||Unlimited||Unlimited|
|Data Retention||30 days||1 Year||2 Years|
|Number of Team Members||1||1|
additional testers for $60 per year
|Number of AWS Keys||1||1||5|
|Number of Concurrent Tests||1||1||5|
|URLs Graphed per Test||100||100||300|
|Jenkins Continuous Integration||✓||✓|
|Team & Server Management||✓||✓|
|Firefox Add-On For Selenium + JMeter||✓||✓|
|Cost*||Free||$75/Month or $500/Year||$299/Month or $2,500/Year|
* cost of each plan does not include the cost of the AWS spot instances (spot or on-demand)
Supported Test Types
As those within the testing industry know best, there’s generally not one specific (or agreed upon) type of test that does it all. This is why we offer a range of the most popular forms of tests out there. At RedLine13 users can create and run Apache JMeter tests, Gatling tests, Simple URL tests, JMeter WebDriver tests, Log File Replay tests, and even create custom PHP and Node.js tests, among others.
Number of Tests
Regardless of which subscription plan that you opt for, you are able to run an unlimited amount of load tests with RedLine13. This means that you don’t have to make any sacrifices when it comes to running load tests, no matter how large or small they are. Make a mistake? Then there’s no issues, as you can just run it again.
The length of a load test is something that’s quite important, especially if you want to be able to scale your tests and get real-world results. Our free members can run tests for up to one day. For any of the paid subscription plans, your tests can last as long as you want them too.
Simulating a certain amount of users is arguably one of the most important aspects of load testing. We believe that no matter what, our users should be able to simulate an unlimited amount of users which is why that regardless of which plan you have, you can still incorporate as many users as you’d like.
Users for JMeter-Selenium
We have incorporated support for JMeter and Selenium which allows users to seamless launch a variety of tests at scale. You can create real user tests and even generate the result images that you would normally create with a standard Selenium test. In accordance with our philosophy, we believe that it’s important to be able to generate an unlimited amount of users for JMeter-Selenium, and that comes with every subscription, regardless of price.
What’s a cloud-based load testing solution without the ability to back up your data to the cloud? (hint: a bad one). Data retention is crucial for a variety of obvious reasons, which is why we provide our users with the ability to back up their data. Free users can back up their data for up to 30 days, basic users get one year, while pro and premium members have up to two years of data retention. If you ever needed to refer back to old load tests that you generated in the past to cross-reference, for example, you have the ability to access that data.
Number of Team Members
If you’re running a variety of different load tests, chances are you aren’t doing it alone. RedLine13 offers users team management capabilities, which allows you to share your various tests and test data between a group of users. Free users and those with a basic plan have access to one team member, while our pro and premium users can share their tests with up to five different teams in total. We work better when we work together.
Number of AWS Keys
In order to offer the most competitive pricing on the market, we help you set up and deploy your load testing instances within your Amazon Web Services account. Free and basic users have the ability to use one AWS key, which is practical as these users probably only have one AWS account. For larger businesses that need more, our pro users have access to use up to two AWS keys while premium users can use up to five in total.
We provide our users with a host of various reporting features that help you breakdown your results. Users can view new requests per period, average response times, the ability to align charts, new page requests per second, the page average response time, KB per request, errors per second, error average response time, KB per error, load agent CPU usage, network bytes received, network bytes transmitted, and more.
The ability to clone a test so that you can replay it again or save it later for Jenkins is invaluable for load testing. Premium (paid) users have the ability to replay tests as many times as they would like or clone the tests as many times as they’d like.
Team management further enhances the sharing of tests and data between different groups of users. With this premium feature users can see what teams they are on, manage them, add or remove users from a team, and when team members log in they will have the ability to access test results from all members on their team.
Server management allows users to set up test servers before running a test in addition to setting up running servers to remain active after a test has been completed. Users can load up as many servers as they want, use the same server controls used on other tests, and more. Thanks to this feature, these instances become ready for your tests to use. Additionally there is also an optional setting for minimum shutdown time allowing users to keep instances running for longer periods of time.
Being able to see your results as a percentile provides our users with more clarity and insight into the metric response. Percentile results inform users about things like how many of your tests responded back within different time periods. Paid users can turn on percentile results before starting a test. That information is then displayed right before the graph data once the test is completed.
Premium users also have API access. This feature provides you with a POST API endpoint allowing you to script running tests. When you’re ready to begin a test in this mode, it will be displayed as if it were any other type of test. Tests that incorporate API access are able to be cloned or setup via Jenkins for your convenience, as well. For more, the API documentation can be found here.
Premium users can incorporate a range of different controls for AWS. Users have access to AWS instance tagging, AWS location selector, EC2 instance size selector, on-demand and spot selection, configurable disk sizes, and even security controls via subnets and security groups.
Firefox Add-on For Selenium + JMeter
Premium users can also utilize a custom Firefox add-on we have created for Selenium + JMeter. With the Selenium-IDE add-on, users have the ability to record web traffic and then create performance tests based on that collected data for JMeter. You can play back your Selenium test-cases while simultaneous recording a performance test in JMeter. The results are extrapolated as a .jmx file which you can then upload to either JMeter or run at scale at RedLine13. Get the Add-on Here
Merged Results Files
Premium includes merged results files. When running tests across 10’s or 100’s of servers the ability to create merged JTL or Merged Gatling log files simplify post processing results.