We have seen an example to Re-run failed tests using iRetryListener. In the previous example, the count of the tests run was changing based on the maxRetryCountvalue. To over come that, we need to add the below code snippet for onFinish method by implementing 'ITestListener'
There may be many reasons for a Test case getting failed, may be due to element not found or time out exception or stale element exception etc. Normally in automation after executing scripts/tests, we will check for the results and if the test fails because of above reasons we will re-run then again.
Instead of that we can ask testNG to execute the failed test cases again for X (we can define) number of times and check for the updated results.
What is Assertion????
Asserts helps us to verify the conditions of the test and decide whether test has failed or passed. A test is considered successful ONLY if it is completed without throwing any exception. There is a difference between SoftAssert and Hard Assert.
Let us focus more on using Assertions (Hard assert). Also check SoftAssert example in TestNG for more details on soft asserts.
If you want your classes / methods to be run in an unpredictable order, then we should go for preserve-order attribute in testng. In TestNg bydefault the preserve-order attribute will be set to 'true', this means, TestNG will run your tests in the order they are found in the XML file.
We will try to execute the below example, by taking three classes. For the first one, We will set the preserve-order attribute to false and check for the the Output.
Create three classes as
TestNG provides an ability to run test classes in parallel. By using parallel execution of classes, each class will be started and executed simultaneously in different threads.
Let us look at basic example for Parallel Execution of Classes using testng.xml.
We will create a Two classes with Two test methods each and try to execute in different threads.
Create class and name it as : TestParallelClassOne.java
TestNG provides multiple ways to execute tests in separate threads. In testng.xml, if we set 'parallel' attribute on the
If we want to run methods/classes in separate threads, we need to set 'parallel' attribute on the
TestNG allows the user to pass values to test methods as arguments by using parameter annotations through testng.xml file.
Some times it may be required for us to pass values to test methods during run time. Like we can pass user name and password through testng.xml instead of hard coding it in testmethods. or we can pass browser name as parameter to execute in specific browser.
Let us now try to understand parameterization with a basic example.
TestNg provides an option to include or exclude Groups, Test Methods, Classes and Packages using include and exclude tags by defining in testng.xml.
First we will create an examples to use include and exclude tags for Test Methods in a class.
We will create a Class with three Test Methods. In that we will include two test methods and try to exclude one test method.
Below is the example class file with three test methods
TestNG provides an option to execute multiple tests in a single configuration file (testng.xml). It allows to divide tests into different parts and group them in a single tests. We can group all the tests related to database into one group, Regression tests in one group. And all the test cases related to Unit test cases into one group and so on..
TestNG makes it easy by following the below Syntax to add multiple tests in testng.xml.