I'm trying to mark Jenkins build status as failed if more than 10% of the cucumber scenarios have failed. if 90% has passed the build should be success.
I have referred to the cucumber reports documentations https://www.jenkins.io/doc/pipeline/steps/cucumber-reports/ https://plugins.jenkins.io/cucumber-reports/ and have set
failedScenariosPercentage : 10
but the build is marked as failed even if 1 scenario has failed.
weirdly in console I see it is logged that
Found 0.496278 failed steps, while expected not more than 0.000000 present. Build status left unchanged.
I haven't set any checks on test steps. The pipeline steps are as follows
post {
always {
cucumber failedFeaturesNumber: -1,
failedScenariosNumber: -1,
skippedStepsNumber: -1,
failedStepsNumber: -1,
pendingStepsNumber:-1,
undefinedStepsNumber: -1,
fileIncludePattern: '**/*cucumber-report.json',
sortingMethod: 'ALPHABETICAL',
failedScenariosPercentage:10
}
}
Can someone tell me if I'm doing something wrong here?