Been following #AWS Reinvent and noticed the mention of AWS MarketPlace + HP Load Runner.  Turns out HP charges you more to run on your AWS, here is some basic analysis.   Public Pricing Community Edition – 50 virtual users Free. HP 150 – 150 Virtual Users 50$ per EC2 instance per hour + AWS instance cost HP 300 – 300 Virtual Users 125$ per EC2 instance per hour + AWS instance cost HP Load RunnerRead More →

We upgraded our usage of AWS library 3.5.*, it has been a while since we have updated.  While updating we have put together a few other AWS friendly updates AWS Cross Account Roles Cross account roles is the preferred AWS mechanism for granting access to service providers.  This was feedback provided direct from AWS folks and per docs SaaS products should leverage Cross Account Roles to perform actions on behalf of customers RedLine13 Docs on setting it upRead More →

BlazeMeter has become a real leader in making a professional version of Apache JMeter. We have heard through the grapevine that Blazemeter is trying to raise another $10M in addition to the original Series A of $6.5M and $1.2M of Seed funding. We wish them well because commercial backing can really help advance open source projects with additional development, and especially better PR, Marketing and Selling efforts. We have a track record of being a part ofRead More →

The BlazeMeter Chrome Extension is a very good Apache JMeter test plan recorder directly in the browser.  It is a great improvement over the default JMeter recorder, which is a bit old-school and acts as a proxy on your system. Though BlazeMeter has not open sourced or contributed this back to the community, they do allow you to export valid JMeter test plans. We appreciate this free-to-use recorder and can quickly demonstrate recording and playing back at scale on RedLine13.Read More →

We upgraded the agents with updated version of curl to better support testing sites with SSL and ciphers that were only supported  via command line options passed into curl. A user reported that testing a site such as https://sslspdy.com would return an error Cannot communicate securely with peer: no common encryption algorithm(s). This is noted as a resolved issue in RHEL (curl does not support ECDSA certificates)  and unresolved in Fedora (NSS does not enable ECC cipher-suitesRead More →

We have added support for controlling custom properties being passed into Gatling or JMeter test plans. This is available for JMeter and Gatling tests and in the advanced settings sections. Gatling Command Line JMeter Command LineRead More →

RedLine13 Just Got Real RedLine13 started from a need to support 50,000 users registering in minutes.   The load testing market has been full of large, expensive, closed, and locked-down providers.   There was no way for RunSignUp to scale without a large investment for initially a point in time need.  Stephen Sigwart and Bob Bickel decided they needed to build something quick for their business.  Afterwards, they realized they had something special – easy, inexpensive, and rapid load testing.  Read More →

From the Open Source Load Testing presentation http://www.slideshare.net/richardfriedman/open-source-load-testing Perhaps in a perfect world, every time code is submitted and reviewed, a Jenkins job kicks off a load test against your specific change.  However, in reality, this has quite a few issues: Too early.  Load testing too early in your process is noise Time.  Realistically, most projects are not scoped with time for this Scope.  Changing a readme file should not generate a load test For me, I have foundRead More →

From the Open Source Load Testing presentation http://www.slideshare.net/richardfriedman/open-source-load-testing Everything else was build up to the review of this slide. What is available in  open source load testing tools?  There are so many ways to slice and dice all the great open source projects and this slide is not a deep review or demo of each project.  I looked at the dimensions of the projects in terms of content covered in this presentation. Distributed.  Does it support scaling loadRead More →

From the Open Source Load Testing presentation http://www.slideshare.net/richardfriedman/open-source-load-testing As the running of load tests should fade into the background, the work of analyzing your results starts.  We can first look at this from two aspects: Load Test Results.  Your load test results will show you analysis from a black-box perspective, you can see the overall response time and throughput.  If an issue is exposed, where did it happen?  Perhaps you are running a LAMP stack – wasRead More →