onyx

FYI: alternative Onyx :onyx: chat is at <https://gitter.im/onyx-platform/onyx> ; log can be found at <https://clojurians-log.clojureverse.org/onyx/index.html>
eelke 2017-12-11T16:26:23.000300Z

We are looking at optionally joining events in windows. Any idea what would be the upper bound of data size may be held in a single window?

michaeldrogalis 2017-12-11T16:31:04.000643Z

@eelke Depends on the memory limit of the boxes running Onyx. You can use the different windowing strategies to get pretty good performance by only writing out the deltas between checkpoints, even when the checkpoints are large.

michaeldrogalis 2017-12-11T16:52:52.000384Z

@eelke Particularly, you'd want to set :window/storage-strategy to :order-log

lucasbradstreet 2017-12-11T17:11:46.000424Z

^ that doesn’t help keep the checkpoints small. It does help only writing the deltas out to a state store if you use the disk backed store.

lucasbradstreet 2017-12-11T17:12:00.000362Z

Incremental checkpoints is still a feature for the future.

michaeldrogalis 2017-12-11T17:25:46.000370Z

Right, thanks for the clarification.