Using JUnit on CircleCI 2.0 with Jest and ESLint
We're big believers in automated testing and deployment. However it can generate a staggering amount of information. Being able to quickly determine the source of an issue saves time and avoids headaches.
In this post I'll share how we use JUnit reporting to get concise feedback out of CircleCI. Instead of crawling through lengthy output, CircleCI tells us precisely what failed at the top of our build pages.
Here's what I mean:
If you're just looking for a CircleCI config, take a look here. Otherwise brace yourself for the wild and wonderful world of test reporting!
What is JUnit?
JUnit reports are XML files. They look like this:
<testsuites name="jest tests"> <testsuite name="My test suite" tests="7" errors="0" failures="0" skipped="0" timestamp="2017-09-05T23:56:38" time="2.534"> <testcase classname="My test" time="0.013"> </testcase> </testsuite> </testsuites>
Why is this so great?
When tests fail, CircleIC can use JUnit reports to give you concise feedback on what went wrong. Additionally, it fuels CircleCI's new Insights feature, helping you to identify flakey and slow tests and analyze overall project health:
Setting it up
For CircleCI 2.0 to know that we have a test report, first we have to generate it.
Generating JUnit Reports with Jest
jest --ci --testResultsProcessor="jest-junit"
Make sure to add this as a development dependency! I've also included the --ci flag, which improves the behavior of certain Jest operations like snapshot testing during continuous integration.
If you run this locally, you'll probably see a
test-results.xml document at the root of your project. However on CircleCI we'll put it in a consistent directory with all other reports.
.circleci/config.yml, our test command looks something like:
This configuration tells CircleCI to run the command we mentioned earlier, setting an environment variable for where
jest-junit should put the report.
store_tests_results tells CircleCI that there is a test report. I also like to include
store_artifacts to make the generated reports accessible later.
This concludes setting up Jest with JUnit on CircleCI 2.0.
Generating JUnit Reports with ESLint
While we lean on Prettier to rule out the possiblity of code formatting inconsistencies, we still use ESLint to catch common mistakes in our code, including bad variable references or incorrectly imported modules. ESLint also tends to give more specific feedback on the location of these issues that might otherwise by glossed over in a failed unit test.
Generating a JUnit report for ESLint is simple. It does this out of the box!
eslint --format junit -o reports/junit/js-lint-results.xml
Following our previous example, hooking this up in CircleCI 2 is just as easy:
That's it. We did it.
That's really all it takes! Here's the full CircleCI configuration for good measure:
Taking these extra measures on our projects has yielded tremendous improvements to our workflow. I'd love to hear what you are doing to improve your experience with continuous integration services as well!