onyx

FYI: alternative Onyx :onyx: chat is at <https://gitter.im/onyx-platform/onyx> ; log can be found at <https://clojurians-log.clojureverse.org/onyx/index.html>
sreekanth 2018-06-26T11:54:15.000386Z

Can i kill submit job pod in kubernetes after submitting the job?

2018-06-26T16:37:40.000729Z

I'm currently playing around with Onyx in the context of a small hobby project and I ran into an issue the other day, which I posted to SO: https://stackoverflow.com/questions/51038280/onyx-cant-pick-up-trigger-emit-results-in-the-next-task

2018-06-26T16:39:44.000193Z

Basically, I wanted to understand aggregate some data and hand it to the next task and thought :trigger/emit would be the way to go and then the next task never saw the emitted segments.

2018-06-26T16:40:33.000291Z

Now, I finally saw that there was a warning / error in the log file that pointed to a missing peer configuration of :onyx.peer/storage.zk.insanely-allow-windowing?

2018-06-26T16:41:14.000578Z

While this now makes my toy example working, this option (and the corresponding commit in Onyx) doesn't look like this is a good idea.

2018-06-26T16:41:20.000187Z

But what is it, then?

lucasbradstreet 2018-06-26T17:00:31.000910Z

If the only reason it didn’t work was :onyx.peer/storage.zk.insanely-allow-windowing?, then that means everything else around :trigger/emit was ok.

lucasbradstreet 2018-06-26T17:00:53.000884Z

I would just recommend switching to S3 checkpointing, as you will have trouble with ZK based window checkpoints.

👍 1
lucasbradstreet 2018-06-26T17:01:10.000610Z

@sreekanth if it’s just a pod that calls submit-job, then yes

👍 1
2018-06-26T17:02:42.000264Z

thanks @lucasbradstreet