Test suite collection failed in jenkins

Archive
, ,
1

Test suite collection failed in jenkins

--------------------------------------------------------------------------------Test Suites/0_Bitsane Regression test suite - 20180524_111444........47/47(100%)--------------------------------------------------------------------------------Test Suites/2_BT_Authorization test suite - Chrome (headless) - 20180524_111444........................................................................2/2(100%)Test Suites/3_BT_Balances test suite - Chrome (headless) - 20180524_111448...........................................................................21/21(100%)Test Suites/4_BT_Exchange test suite - Chrome (headless) - 20180524_111453.............................................................................9/9(100%)Test Suites/5_BT_News test suite - Chrome (headless) - 20180524_111453.2/2(100%)Test Suites/6_BT_Support test suite - Chrome (headless) - 20180524_111453..............................................................................7/7(100%)Test Suites/7_BT_Profile test suite - Chrome (headless) - 20180524_111453..............................................................................6/6(100%)--------------------------------------------------------------------------------C:\Katalon_Studio_Windows_64-5.4.1>exit 1 Build step 'Выполнить команду Windows' marked build as failureFinished: FAILURE
2

Because some of your tests failed.

47/47, 2/2 ect are tests passed but not necessarily ok.

The real information is the code after the exit:

Below is the list of exit codes after console mode execution:

  • 0: the execution passed with no failed or error test case.
  • 1: the execution has failed test cases.
  • 2: the execution has error test cases.
  • 3: the execution has failed test cases and error test cases.
  • 4: the execution cannot start because of invalid arguments.
3

Katalon 5.8 gives exit code 0 even with fails. Is there other people that get into the same issue with this version ? In previous version it was working correctly.

10-25-2018 01:05:49 PM - [FAILED] - Test Cases/Website/JOB-26044 - Display geolocation information FAILED because (of) (Stack trace: com.kms.katalon.core.exception.StepFailedException: com.kms.katalon.core.webui.exception.WebElementNotFoundException: Web element with id: 'Object Repository/JobDetail/jobDetail - geolocation' located by 'By.xpath: //*[@data-test-id = 'geolocation']' not foundC:\katalon>exit 0 Finished: SUCCESS