We always talk about how inexpensive it is to load test with RedLine13 and AWS. Still, users are concerned and ask us what AWS will cost them. So here’s a real customer who runs high volume testing, what’s referred to as Continuous Load Testing. Let’s see how much their AWS Continuous Load Testing costs are.
Jay Holland is the Director of QA and DevOps at Precision Sample, LLC, a market research company leading the way among survey panel and consumer research companies. Jay’s team runs their continuous load testing four times a day against their production environment in order to see if their API calls have suffered any change in response times. Each of the four times a day they run 9 API tests for a total of 36 tests per day. Two of those times are at their highest peak times. They need their clients to have great response times. As far as cost, it’s only $.08, that’s 8 cents, per test from AWS. Which is about $86 a month. The cost isn’t an issue for them compared to the fast feedback metrics they get.
They use Jenkins to manage their load tests which they run with Redline13. Lots of posts exist on using Jenkins with RedLine13, such as Integrating Automated Testing with Jenkins – Team Support Included.
Their continuous load testing has uncovered issues in their systems. For example, it brought to light longer than wanted response times. They are in the middle of a database conversion, so based on these tests they are fine-tuning the database in order to get the response times they are looking for.
They have also created a slack channel that the team can see pass/fail results and respond quickly if they get a fail.
For Jay Holland and Precision Sample, they’ve found a cost-effective way to use Continuous Load Testing, minimize continuous load testing costs, and keep their systems running optimally.
“RedLine13 is a key part of our Continuous Load Testing environment. We depend on it.”
Want to get started with RedLine13? Here is a guide and video which walks you through running your first JMeter test on Redline13.
Comments are closed, but trackbacks and pingbacks are open.