In many teams, I see that there is a strong emphasis on deterministic tests: Each test must pass every time if there is no change in the code base. Wayne Roseberry from Microsoft shows that this is not helpful:
Especially the tests which pass only 60-90% of the time contributed to many bug reports in his projects. Unreliable tests are not easy to use in build pipelines. Gating tests must be fast and precise. But, in nightly test runs, test teams benefit from flaky tests during bug discovery.
