there's definitely alearning curve
however, I'm converted, untangled is amazing
huh
Well once my librarying work is done, there’s no reason I or someone else can’t make an untangled template.
Anyone done dataflow work? Specifically into BigQuery?
Mobileink is already there: his stuff is already decomposed out of template land into libraries.
@domparry haven’t used dataflow for that. I did have a GAE entity post-put hook that added information into a JSON file in GCS that went into BQ at the end of the day.
Worked slick
I have Dataflow reading Pubsub into BQ. Works so well except for one very specific case.
The error I get is: failed_precondition: Record leaf types are not supported.
I’m using a clojure wrapper for dataflow called datasplash (It’s fantastic)