Clojurians Log v2
Clojure programming
Channels
Apps
meander
All things about https://github.com/noprompt/meander
Need help and no one responded? Feel free to ping @U5K8NTHEZ
grounded_sage 2020-03-04T12:41:52.114300Z
Still have problems around joining the large datasets. Put the first transformation step side by side and meander simply blows the other option away.
grounded_sage 2020-03-05T10:47:10.118700Z
There is a slight error in the dataset one as I typed it out purely to see what the difference was side by side.
grounded_sage 2020-03-05T10:48:25.119300Z
With respect to code size, clarity and ability to change Meander is definitely my choice.
jimmy 2020-03-05T15:13:54.120100Z
If you ever want to pair on joining up some datasets I'd be happy to do that. Even if you can't share your stuff. I'm sure we could make some mock data and try things out.
grounded_sage 2020-03-10T19:51:02.130Z
Really appreciate it @jimmy. At the moment I am in datahike land as the datasets are too large to be done in memory with Meander. I also broke Tech.ml.dataset haha
grounded_sage 2020-03-10T19:51:40.130200Z
Though they are arguably still moderate in size. <500mb for the largest.
timothypratley 2020-03-11T00:14:09.162700Z
Hmmm FWIW it looks like the code on the right just needs to be changed slightly… IMO you should be doing something like:
(for [x (aws/get-data)]
(m/match x ~~~~ ~~~~~))timothypratley 2020-03-11T00:16:33.163100Z
search is intended for finding multiple logical matches (not sequential processing) I think! 🙂
grounded_sage 2020-03-11T08:28:05.166900Z
I’ve had search fail on me for some reason when I am doing a simple match. I think it might be due to m/pred or m/app. I’ll revisit at some point for now I just flatten the results