Welcome to the new Parasoft forums! We hope you will enjoy the site and try out some of the new features, like sharing an idea you may have for one of our products or following a category.

soatest report "Failed Tests" incorrect

huiraym
huiraym Posts: 12 ✭
in SOAtest

Hi newbie question...
I have a test suite which reads an xlsx with 10 test cases.
Of the 10 test cases, only the 3rd one failed.
I would expect the report should show 9 successful and 1 failed. But instead, it shows 2 successful, 8 failed.
It seems like any test cases executed after the failed one will be counted as failed. Is there an option to change to have the failed tests number correctly?
Thanks.

Comments

  • benken_parasoft
    benken_parasoft Posts: 1,291 ✭✭✭

    If your tests are using a data source then they will execute multiple times, once for each row from the data source. Any violations should indicate which test failed as well as the row number. A single test can run multiple times and fail multiple times. The totals you see in the report reflect the actual number of executions of each test.

    If you have doubts about which tests are passing or failing then you can also get a more detailed breakdown. To do this, click "Parasoft > Preferences... > Reports", enable "Overview of checked files and executed tests", then disable "Only top-level test suites".

Categories