powderkeg

viesti 2017-03-26T10:07:16.906983Z

re-learning transducers (maybe I didn’t really learn them when they appeared :)), watching Rich’s strangeloop talk https://www.youtube.com/watch?v=6mTbuzafcII and discovered slides of Christophe’s ClojureD talk https://cdn.rawgit.com/cgrand/xforms/resources/Lost%20in%20Transduction.pdf

cgrand 2017-03-26T10:13:16.917052Z

@viesti re:cider it takes a loooong time or never finishes or fails?

viesti 2017-03-26T10:13:38.917678Z

didn’t have the patience to wait 🙂

viesti 2017-03-26T10:14:31.919315Z

should look at the dependencies that get pulled in, maybe some of them could be filtered out

cgrand 2017-03-26T10:18:38.926162Z

I believe counterclockwise embeds cider and while I don't see 10k classes it's way slower than plain lein repl. For about the same number of classes.

viesti 2017-03-26T10:21:52.932135Z

do all the classes on the classpath get instrumented or just the ones that belong to the project using them?

viesti 2017-03-26T10:22:19.933156Z

thinking if scope of work could be narrowed

viesti 2017-03-26T10:46:31.974099Z

hum, had [refactor-nrepl "2.2.0"] in addition to [cider/cider-nrepl "0.14.0"] in my leiningen profile

cgrand 2017-03-26T10:53:41.985489Z

I think it's a different issue as with recent counterclockwise I experienced nearly a 10x slowdown while the classes count stay almost identical.

cgrand 2017-03-26T12:47:31.185788Z

However looking at https://docs.oracle.com/javase/7/docs/api/java/lang/instrument/Instrumentation.html again I see a couple of ways of making ouroboros startup less brutal.

viesti 2017-03-26T18:33:46.023809Z

that would probably be neat, although nowadays I have cider in a separate profile that I enable only when needed to avoid startup time cost which it brings

viesti 2017-03-26T19:08:58.118207Z

hum, was thinking if SparkSession (of Spark SQL http://spark.apache.org/docs/latest/sql-programming-guide.html#starting-point-sparksession) should be wrapped somehow, at least for making Spark's own examples easier to translate to powderkeg

viesti 2017-03-26T19:10:26.121875Z

but browsing through the code of SparkSession, it looks more like a wrapper class for Spark’s own API evolution, which might not be our target

viesti 2017-03-26T19:14:30.132753Z

another thing that I’m thinking is should we be worried about Encoders or not 🙂 https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.Dataset

cgrand 2017-03-26T19:40:39.204385Z

Yeah not very open.