Clojurians Log v2

Hi! I’m curious what you all are using for end-to-end-testing your mobile apps. We’re at the point that we want to start doing so (and also our web front-end). We don’t have the big bucks at this point to use something like Saucelabs. @borkdude mentioned #etaoin, so I’ll definitely look into that. (With end-to-end-testing I basically mean through the UI, black-box testing. Something that a tester who can do some programming but is not a professional software developer can do.) Thanks!!

@stefan.van.den.oord Our approach to that problem was to just use Appium, because we had a really good QA engineer on staff who could write Appium tests super fast. Well worth the overhead of gardening a Python ecosystem (mainly because I didn’t have to do most of it 😇 ). We also did some experiments with using AWS DeviceFarm to get those tests run on a bunch of real devices of different architectures, ages, screen sizes, etc. but I would say that went only okay and we recently discontinued it for budget reasons.

@chris_johnson did you use Python there just because that’s what the tester was comfortable with writing? Because Appium can be used from Java(Script) and therefore from Clojure(Script). Why didn’t you pursue that path? Thanks

Precisely as you say, because they already had experience using Appium with Python and they had no Clojure experience. We’ve had some real successes in taking engineers with no Clojure experience and getting them into Clojure, but in this case they were frankly super overworked (one QA engineer for a cross-platform product! I cower in shame) so it was better to just get moving with the tools they had ready to hand.

and for folks who are all-in on AWS, I did just go reconfirm my understanding that DeviceFarm supports Java, Javscript, Python, and even Ruby flavors of Appium.

Is it possible to use etoian to do react native end to end tests?

@stefan.van.den.oord I used Appium with the Java client, but only run the tests locally on different Android emulators. I'm not sure how difficult could be to run the same tests with something like Browserstack (I know they support Appium tests). If you want I can make the repository public so you can take a peek. Also, React Native's documentation suggests Detox, but I never tried it.

@chris_johnson @franquito it be really cool if you could fill in the questionnaire about your experience: https://clojurians.slack.com/archives/C0E1SN0NM/p1601901730061000 It be good to have a collection of answers all in one place. Thanks

Done - note that the “what is the link to your app” input forces URL validation on the entire response so I was only able to provide our App Store version, not the Play Store one.