An introduction to mutation testing
How code coverage of 100% could mean only 60% is tested.
No time to run the example yourself? Don't worry. We did it for you. Open it right in your browser:
What is this?
The RoboBar is a small application to demonstrate mutation testing. It actually has a fair number of unit tests. When we wrote this application, we didn't even try our best to write bad tests. We just focussed on code coverage and didn't practice Test Driven Development. It turns out it's straightforward to write bad tests or forget a few essential test cases. The RoboBar even has a reasonably large bug. Finding it is pretty easy using the mutation report. Why don't you give it a try? 😁
Try it yourself
- Install git
- Install nodejs
- Open command prompt and clone this repository:
git clone https://github.com/stryker-mutator/robobar-example
- Change directory into the robobar and install the dependencies.
- Run tests with npm. This will generate a code coverage report.
- Review the 100% code coverage score. Open up the code coverage report located in the
- Run mutation testing with Stryker
npm run test:mutation
- Review the 50% mutation score. Open up the mutation report located in the
- Run the website with
npm start. Can you find the bug?
Try to install stryker yourself.
If you want to install stryker yourself, step back in history using git:
git reset --hard
git checkout e92b8d4
After that you can install stryker for yourself:
npm i -g stryker-cli
Choose the following options in the questionnaire:
- Install stryker?:
- Test runner:
- Test framework:
- Transformations: none
html, clear text, progress
After the plugins are installed, try it out: