onyx

FYI: alternative Onyx :onyx: chat is at <https://gitter.im/onyx-platform/onyx> ; log can be found at <https://clojurians-log.clojureverse.org/onyx/index.html>
sparkofreason 2018-03-27T14:51:00.000746Z

What is the lifetime of aggregation (or other) state associated with windows?

michaeldrogalis 2018-03-27T15:05:58.000398Z

@dave.dixon Permanent until removed via eviction with a trigger.

dbernal 2018-03-27T15:28:32.000615Z

Is partitioning by multiple columns supported on onyx-sql yet? I'm referencing this issue https://github.com/onyx-platform/onyx-sql/issues/8 that says there was some work completed but it seems like it was around UUIDs. There's also another open issue https://github.com/onyx-platform/onyx-sql/issues/25 that says that partitioning by UUID is broken since 0.10.0 . Anyone know the current status of sql partitioning?

sparkofreason 2018-03-27T15:35:00.000439Z

Thanks. On implementation: are they all stored in memory, or in there a mechanism to swap in/out?

michaeldrogalis 2018-03-27T15:43:56.000799Z

Stored in memory temporarily, durably checkpointed to S3 for fault recovery. There's an incremental version to keep only some state in memory.

sparkofreason 2018-03-27T15:55:45.000860Z

Very cool, if I understand correctly, and is going on make my life really easy. Our system is being built around aggregating events over time windows for things like dashboard charts. with commands to retrieve the state for a given window. Sounds I should be able to keep that stuff for an extended time without filling up peer memory. Any other issues I might need to consider?

michaeldrogalis 2018-03-27T19:15:21.000512Z

Should be okay.