Clojurians Log v2
Clojure programming
Channels
Apps
onyx
FYI: alternative Onyx :onyx: chat is at <https://gitter.im/onyx-platform/onyx> ; log can be found at <https://clojurians-log.clojureverse.org/onyx/index.html>
sparkofreason 2018-03-16T01:53:33.000020Z
I'm curious how onyx handles restart with stateful tasks. I understand why the number of peers assigned to a stateful task can't change while the job is running, but what happens when you kill and restart. Can it redistribute the tasks to a different number of peers?
lucasbradstreet 2018-03-16T01:59:22.000242Z
It does not currently have the ability to re-partition state. It’s been on our backlog for a while.
lucasbradstreet 2018-03-16T02:02:46.000123Z
It wouldn’t really be all that hard to implement a feature which would use the resume-point functionality to recover and repartition state.
sparkofreason 2018-03-16T02:17:59.000178Z
That would be a great feature.
lucasbradstreet 2018-03-16T02:23:25.000089Z
Agreed. Our current suggestion is to over-partition your stateful peers to begin with. We know it’s not great.