Clojurians Log v2
Clojure programming
Channels
Apps
clojure-europe
For people in Europe... or elsewhere... UGT https://indieweb.org/Universal_Greeting_Time
dharrigan 2020-11-18T06:38:01.459200Z
Good Morning!
javahippie 2020-11-18T07:33:29.459400Z
Guten Morgen!
thomas 2020-11-18T08:21:58.460Z
mogge
thomas 2020-11-18T08:22:12.460300Z
and welcome @jtkdvlp
jasonbell 2020-11-18T08:28:14.460500Z
Morning
ordnungswidrig 2020-11-18T08:59:42.460900Z
’good ’morning
slipset 2020-11-18T09:07:07.461100Z
good morning!
borkdude 2020-11-18T09:36:17.461500Z
Morning! New old babashka talk: https://twitter.com/ndj/status/1328826419086909440
agile_geek 2020-11-18T09:42:43.461900Z
Bore da :welsh_flag:
2020-11-18T21:20:16.462700Z
so, transit-clj seems to be fast and compact (when using :msgpack and GzipOutputStream) for my needs. i'm pretty happy with it
2020-11-18T21:21:08.463700Z
I'm using the reducibles library. I just need to figure out how to deal with a seq of reducibles and/or eductions. I'm not quite sure where to draw the line for using things like (take 2) and only getting part of the first file
2020-11-18T21:21:18.464Z
It is pretty easy for ingesting everything
2020-11-18T21:26:54.464400Z
yeah, just checked on all the data and it takes bout 20% of the time that nippy does
dominicm 2020-11-18T21:27:30.465100Z
I had some issues with transit doing too many tiny chunks completely defeating gzip
borkdude 2020-11-18T22:08:49.465500Z
*cough* https://github.com/cognitect/transit-clj/issues/43 *cough*
2020-11-18T23:02:28.466300Z
For my data structure it seems to be working atm
2020-11-18T23:03:00.467Z
I'm writing 50 largish vectors to a file getting gzipped
2020-11-18T23:03:21.467600Z
Each file ends up around 7MB