{"id":10239,"date":"2022-12-12T13:06:29","date_gmt":"2022-12-12T18:06:29","guid":{"rendered":"https:\/\/www.redline13.com\/blog\/?p=10239"},"modified":"2022-12-15T11:54:39","modified_gmt":"2022-12-15T16:54:39","slug":"selenium-load-testing","status":"publish","type":"post","link":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/","title":{"rendered":"Selenium Load Testing: When and How"},"content":{"rendered":"

\"Selenium<\/p>\n

People often ask if they can use Selenium for load testing. The Selenium website<\/a> says:<\/p>\n

Performance testing using Selenium and WebDriver is generally not advised. Not because it is incapable, but because it is not optimised for the job and you are unlikely to get good results.<\/p><\/blockquote>\n

The site goes on to recommend JMeter. We would say that Selenium can be used for load testing with limitations as many RedLine13 customers do.<\/p>\n

RedLine13<\/a> is a cloud-based platform extending an easy-to-use load testing infrastructure.  Users of RedLine13 routinely run large scale scripted tests<\/a> numbering in the tens and even hundreds of millions of requests.  However, browser based testing presents several unique challenges, the most significant of which is a high resource overhead requirement.<\/p>\n

Here is how we ran a 500 virtual user Selenium WebDriver<\/a> test on RedLine13.  In this particular case, the target test application was taken to the failure point.<\/p>\n

<\/a>Selenium Load Testing Test Script<\/h3>\n

We created a simple test script for this demonstration.  Your test script can be as simple or as complicated as necessary.  The concepts used in this demonstration should carry regardless of this. Here is the script that was used:<\/p>\n

const redline = require('redline13-webdriver');\n<\/b>const By = redline.webdriver.By;\n<\/b>const until = redline.webdriver.until;\n<\/b>const Condition = redline.webdriver.Condition;\n<\/b>const BROWSER = 'chrome';\n<\/b>const URL_1 = 'https:\/\/demoqa.com\/';\n<\/b>const URL_2 = 'https:\/\/demoqa.com\/webtables';\n<\/b>const DELAYED_CAPTURE = 14500;\n<\/b>const DELAYED_INTERATION = 20000;\n<\/b>const ITERATIONS = 5;\n<\/b>const main = () => {\n<\/b>  const driver = redline.loadBrowser(BROWSER);  \n<\/b>  for(var i=0; i < ITERATIONS; i++){\n<\/b>     driver.get(URL_1).then(_ => {\n<\/b>     driver.manage().timeouts().implicitlyWait(DELAYED_CAPTURE);\n<\/b>     redline.snap('capture1.png');\n<\/b>     setTimeout(function timedDelay() {console.log(\"...\");}, DELAYED_INTERATION);\n<\/b>     driver.get(URL_2).then(_ => {\n<\/b>        driver.manage().timeouts().implicitlyWait(DELAYED_CAPTURE);\n<\/b>        redline.snap('capture2.png');<\/b>   <\/b>   \n<\/b>     });  \n<\/b>     driver.manage().timeouts().implicitlyWait(DELAYED_INTERATION);\n<\/b>     });\n<\/b>  }\n<\/b>  driver.quit();\n<\/b>};\n<\/b>main();<\/b><\/pre>\n
<\/a>Selenium Load Testing Test Plan<\/h3>\n
Initially we started with a single-user test.  As we ran through several iterations of this test we made small changes until arriving at the behavior we wanted.  Then to scale the test up to my target number of 500 virtual users, we simply increased the user count in RedLine13 and ran it on both more powerful and a larger number of servers.  Scaling any load test on RedLine13 is as easy as a few clicks to generate tens or even thousands of times more load.<\/p>\n
Below is the configuration for this test.  Custom tests on RedLine13 can be run in a number of different languages<\/a>, but here we have chosen Node.js<\/a>.  Therefore we must set the Load Agent Language. We also need to select \u201cWebDriver Node.js<\/em>\u201d to enable Selenium WebDriver support from Node.js.  For this test we have selected \u201cChrome<\/em>\u201d as the browser. Since our target test application resides on \u201cdemoqa.com\u201d, we have specified this in the \u201cDomains\u201d field and ticked \u201cEnable Hard Filter<\/em>\u201d.  This prevents web page dependencies from being considered in the results.<\/p>\n
\"Selenium
There are a number of options to customize the setup of Selenium WebDriver tests on RedLine13.<\/figcaption><\/figure>\n
When preparing to scale our test, the clone feature<\/a> of RedLine13 is particularly useful.  We can start with a small proof-of-concept test and increase the capacity of our test only when we know that it works as intended.  For instance with this test, we we able to do our proof-of-concept runs using only 10 virtual users, and once satisfied with the execution, quickly scaled to 500 users simply by changing the number of and size of the servers used.<\/p>\n
\"It
It is easy to rapidly and massively scale tests on RedLine13.<\/figcaption><\/figure>\n
<\/a>Selenium Load Testing Results<\/h3>\n
\"Results
Results summary for our fully-scaled Selenium WebDriver demonstration test.<\/figcaption><\/figure>\n
Due to the fact we are simulating the entire client experience with Selenium WebDriver tests, they tend to be resource-intensive.  Unlike scripted tests using JMeter<\/a>, tests based on WebDriver need to run a full web browser for each simulated virtual user.<\/p>\n
\"Test
Test results section showing aggregated percentile response times.<\/figcaption><\/figure>\n
One of the most compelling advantages of running a Selenium WebDriver load test on RedLine13 is the ability to view detailed aggregated charts across all load agents. In the above example, we can see graphed percentiles for response times.  Similarly in the graph below, we can view plotted request counts per second that each resource on our target pages produces.<\/p>\n
\"Sampled
Sampled requests per second graphs all page resource requests.<\/figcaption><\/figure>\n
With output files enabled, your Selenium WebDriver test has the option to capture the rendered browser pages to obtain visual confirmation of your target test application.  This is useful to see how the various elements of your web application are rendered as load is scaled up.  For our example, we can see that despite stressing our application to the point of failure, the pages continued to render appropriately.<\/p>\n
\"Rendered
Rendered browser pages as captured during our Selenium WebDriver test.<\/figcaption><\/figure>\n
<\/a>Conclusion<\/h3>\n
It is possible to run load tests with Selenium WebDriver tests on RedLine13 with limitations. Under those limitations, it is actually quite easy.  The ability to scale your test is constrained only by the number of AWS resources that you wish to provision. As we have demonstrated, you can design your test with a small-scale, cost effective proof-of-concept and effortlessly scale that test up to achieve any practical number of virtual users.  Bearing in mind that Selenium WebDriver tests are more resource-intensive than scripted tests, the size of your test is dependent only on the quantity of AWS resources you are willing to provision.<\/p>\n
\n
Did you know that RedLine13 offers a full-featured free trial?  Sign up now<\/a> and run your own large-scale Selenium WebDriver tests today!<\/p>\n","protected":false},"excerpt":{"rendered":"
People often ask if they can use Selenium for load testing. The Selenium website says: Performance testing using Selenium and WebDriver is generally not advised. Not because it is incapable, but because it is not optimised for the job and you are unlikely to get good results. The site goes on to recommend JMeter. We would say that Selenium can be used for load testing with limitations as many RedLine13 customers do. RedLine13 is a cloud-basedRead More →<\/a><\/p>\n","protected":false},"author":11,"featured_media":10278,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,45],"tags":[283,318,456],"class_list":{"0":"entry","1":"post","2":"publish","3":"author-dkoziel","4":"post-10239","6":"format-standard","7":"has-post-thumbnail","8":"category-blog","9":"category-selenium","10":"post_tag-jmeter","11":"post_tag-load-testing","12":"post_tag-selenium"},"yoast_head":"\nSelenium Load Testing: When and How - RedLine13<\/title>\n<meta name=\"description\" content=\"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Selenium Load Testing: When and How - RedLine13\" \/>\n<meta property=\"og:description\" content=\"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"RedLine13\" \/>\n<meta property=\"article:published_time\" content=\"2022-12-12T18:06:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-15T16:54:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/12\/Title-image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Koziel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Koziel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\"},\"author\":{\"name\":\"David Koziel\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\"},\"headline\":\"Selenium Load Testing: When and How\",\"datePublished\":\"2022-12-12T18:06:29+00:00\",\"dateModified\":\"2022-12-15T16:54:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\"},\"wordCount\":885,\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"keywords\":[\"JMeter\",\"Load Testing\",\"selenium\"],\"articleSection\":[\"Blog\",\"Selenium\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\",\"name\":\"Selenium Load Testing: When and How - RedLine13\",\"isPartOf\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\"},\"datePublished\":\"2022-12-12T18:06:29+00:00\",\"dateModified\":\"2022-12-15T16:54:39+00:00\",\"description\":\"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.redline13.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Selenium Load Testing: When and How\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#website\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"name\":\"RedLine13\",\"description\":\"(Almost) Free Load Testing in the Cloud\",\"publisher\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.redline13.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#organization\",\"name\":\"RedLine13\",\"url\":\"https:\/\/www.redline13.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"contentUrl\":\"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg\",\"width\":300,\"height\":68,\"caption\":\"RedLine13\"},\"image\":{\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20\",\"name\":\"David Koziel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g\",\"caption\":\"David Koziel\"},\"url\":\"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Selenium Load Testing: When and How - RedLine13","description":"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/","og_locale":"en_US","og_type":"article","og_title":"Selenium Load Testing: When and How - RedLine13","og_description":"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.","og_url":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/","og_site_name":"RedLine13","article_published_time":"2022-12-12T18:06:29+00:00","article_modified_time":"2022-12-15T16:54:39+00:00","og_image":[{"width":400,"height":300,"url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2022\/12\/Title-image.png","type":"image\/png"}],"author":"David Koziel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Koziel","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#article","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/"},"author":{"name":"David Koziel","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20"},"headline":"Selenium Load Testing: When and How","datePublished":"2022-12-12T18:06:29+00:00","dateModified":"2022-12-15T16:54:39+00:00","mainEntityOfPage":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/"},"wordCount":885,"publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"keywords":["JMeter","Load Testing","selenium"],"articleSection":["Blog","Selenium"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/","url":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/","name":"Selenium Load Testing: When and How - RedLine13","isPartOf":{"@id":"https:\/\/www.redline13.com\/blog\/#website"},"datePublished":"2022-12-12T18:06:29+00:00","dateModified":"2022-12-15T16:54:39+00:00","description":"Selenium load testing has limitations but it can be done. Here is how we ran a 1,000 virtual user test on RedLine13.","breadcrumb":{"@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.redline13.com\/blog\/2022\/12\/selenium-load-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.redline13.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Selenium Load Testing: When and How"}]},{"@type":"WebSite","@id":"https:\/\/www.redline13.com\/blog\/#website","url":"https:\/\/www.redline13.com\/blog\/","name":"RedLine13","description":"(Almost) Free Load Testing in the Cloud","publisher":{"@id":"https:\/\/www.redline13.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.redline13.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.redline13.com\/blog\/#organization","name":"RedLine13","url":"https:\/\/www.redline13.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","contentUrl":"https:\/\/www.redline13.com\/blog\/wp-content\/uploads\/2013\/06\/cropped-rl13-header-logo.jpg","width":300,"height":68,"caption":"RedLine13"},"image":{"@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/51d282221e3230ab35f964f98ada9b20","name":"David Koziel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.redline13.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2babf644e0993fc86893c24d7525f1e3be114a8746c01249797f25587ae1697a?s=96&d=mm&r=g","caption":"David Koziel"},"url":"https:\/\/www.redline13.com\/blog\/author\/dkoziel\/"}]}},"_links":{"self":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10239","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/comments?post=10239"}],"version-history":[{"count":14,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10239\/revisions"}],"predecessor-version":[{"id":10312,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/posts\/10239\/revisions\/10312"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media\/10278"}],"wp:attachment":[{"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/media?parent=10239"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/categories?post=10239"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.redline13.com\/blog\/wp-json\/wp\/v2\/tags?post=10239"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}