testing

Testing tools, testing philosophy & methodology...
aaron51 2019-09-22T14:13:05.003600Z

@plexus Wondering about parallelization in Kaocha -- is significant restructuring still a prerequisite? (https://github.com/lambdaisland/kaocha/issues/81, you last commented in April) Can you summarize what that restructuring would be?

1➕
plexus 2019-10-21T08:30:10.010300Z

hi @aaron51, seems I missed this message earlier. There's a #kaocha channel that I monitor more actively. In short: nothing has changed, and things are unlikely to change unless I decide to seek funding for another round of Kaocha improvements.

plexus 2019-10-21T08:35:34.010500Z

There are two sides to this: parallelization in the kaocha runner, and support for parallelization on the test type level. The former is probably not that hard, but it will impact a bunch of things. Test runs are no longer deterministic, so randomization no longer makes sense. fail-fast will only work approximately. On the test type we have to see where there is an assumptions that things run consecutively. E.g. kaocha-cljs will require a lot of work, because we would have to spin up multiple JS environments and distribute work. Not sure what the assumptions are for Cucumber, but I wouldn't be surprised if it blows up when you start using it from multiple threads. For clojure.test tests things should be relatively straightforward.