Morning
1Good Morning!
mogge
We had a few queries that just broke it (nullpointer exception or something). And then we had to wait for aws support to tell us what was broken so we could stop doing that... But we kinda needed to do that.
morning
@joetague was it getting expensive with plain csv or json, or with parquet ?
i guess i'll try it out and see... i've got a kafka topic with telemetry data - it looks easy enough to dump that to parquet on s3 with kafka-connect, and if that turns out to lead to criminally expensive queries then i'll dump it to CSV and load into redshift
Bore da
Morning morning
månmån
Bore da :welsh_flag:
Mornin
Morning
Morning
Good morning
Just had a peek in the S3 bucket, we were coping GA/BigQuery data from GCS -> S3 as json
and left it in Standard-IA class
Guesstimate/ballpark most of the files were about 600-800mb in size, they weren't well partitioned so we ended up having to load in a few GB of data a day
Do people perfer this:
(str "foo bar" baz "wibble")
or
(format "foo bar %s wibble" baz)
i do the former :woman-shrugging:
1➕..mostly
+1 str
... i find format
quite hard to read as soon as there are a few args
I do the former, probably only out of habits formed many moons ago in other languages
I guess syntax highlighting will help with the first option
thanks 🙂
I would use format for that. But mostly I use str. I seem to keep answering questions against the grain.
Morning
I use the later, my eye finds it easier to find the variables being used.