Using a mock filesystem can help reduce test flakiness and speed up tests. A regular filesystem introduces two problems for tests. The first problem is that a shared resource ‘the filesystem’ is now shared between tests that may be running…

Software testing is an integral part of the development process, ensuring that applications function as intended and meet user expectations. However, one persistent and often frustrating issue that developers encounter is the phenomenon of…

Axel Kee on Ruby Yagi describes fixes for 3 common reasons for flaky RSpec tests. 1. Time dependant functions Avoid inter-day flakes by anchoring with instead of variable Specify the timezone with instead of relying on the systems…

Collecting data for your tests is often harder than it needs to be. You may have seen some combination of spreadsheets, slack, emails, reruns in home-brewed solutions. These might even be run by hand, where instead of spending time…

How much do you know about the trends in your test suites? Whether you are tracking it or not some trends exist between runs. In a perfect test environment, the tests and the CI are perfectly deterministic and all code is equally easy to…

Flaky tests are hard Tracking down flaky tests is hard, and TestRecall aims to make that much easier. Flaky tests are tests that randomly fail or pass without any changes to the underlying code. One of the hardest parts of debugging flaky…