Clojurians Log v2

Morning

Good Morning!

mogge

We had a few queries that just broke it (nullpointer exception or something). And then we had to wait for aws support to tell us what was broken so we could stop doing that... But we kinda needed to do that.

morning

@joetague was it getting expensive with plain csv or json, or with parquet ?

i guess i'll try it out and see... i've got a kafka topic with telemetry data - it looks easy enough to dump that to parquet on s3 with kafka-connect, and if that turns out to lead to criminally expensive queries then i'll dump it to CSV and load into redshift

Bore da

Morning morning

månmån

Bore da :welsh_flag:

Mornin

Morning

Morning

Good morning

Just had a peek in the S3 bucket, we were coping GA/BigQuery data from GCS -> S3 as json and left it in Standard-IA class

Guesstimate/ballpark most of the files were about 600-800mb in size, they weren't well partitioned so we ended up having to load in a few GB of data a day

Do people perfer this:

(str "foo bar" baz "wibble")

or

(format "foo bar %s wibble" baz)

i do the former :woman-shrugging:

..mostly

+1 str... i find format quite hard to read as soon as there are a few args

I do the former, probably only out of habits formed many moons ago in other languages

I guess syntax highlighting will help with the first option

thanks 🙂

I would use format for that. But mostly I use str. I seem to keep answering questions against the grain.

Morning

I use the later, my eye finds it easier to find the variables being used.