sql

All things SQL and JDBC...
seancorfield 2021-04-29T16:05:43.131400Z

Iā€™m not familiar with Metabase but reducing a plan onto a core.async channel and processing it that way sounds like a reasonable approach to me. Have you seen this @henrikheine https://www.grammarly.com/blog/engineering/building-etl-pipelines-with-clojure-and-transducers/ ā€” it ends up using core.async and pipelines and transducers. A quick Bing search suggests that most of the ETL talks around Clojure rely either on Spark/Hadoop etc or on Datomic.

lukasz 2021-04-29T16:07:55.132Z

Metabase is not going to help you here, it's just a RO interface to visualizing data stored in various data stores

lukasz 2021-04-29T16:08:03.132300Z

It doesn't do any data processing on its own

henrik42 2021-04-29T19:34:55.132400Z

Ja, I thought I could use it for exploring the database and may run some reports in order to find outliers and do sane checks, comparing the dest db to source db etc. Any suggestion for an alternative? Something in clojure or java would be cool.

lukasz 2021-04-29T19:36:37.132600Z

Oh, for that metabase is great - we've been using it basically since it launched few years ago. We use it for all sorts of reports, debugging and big-data-ish stuff for the data stored in BigQuery

šŸ‘ 1