jackdaw

https://github.com/FundingCircle/jackdaw
dangercoder 2019-06-07T07:33:08.001600Z

There seems to be a breaking change from io.confluent

[io.confluent/kafka-schema-registry-client "5.1.2"
                  :exclusions [com.fasterxml.jackson.core/jackson-databind]]
                 [io.confluent/kafka-avro-serializer "5.1.2"]
is invalid in jackdaws project.clj since 5.1.2 does not exist on maven central anymore? I can't install Jackdaw anymore.

dangercoder 2019-06-07T07:33:58.001900Z

Looks like they decided to change the version number to "3.3.1"

2019-06-07T07:40:18.003300Z

wtf?! that would be a new and fun way of breaking users' applications. Looking into it. How did you determine 5.1.2 had changed to 3.3.1?

2019-06-07T07:41:29.003700Z

I think it can't be deliberate. The docs still reference 5.1.2

dangercoder 2019-06-07T07:43:38.004100Z

I looked at maven central

dangercoder 2019-06-07T07:43:40.004300Z

one sec

dangercoder 2019-06-07T07:45:16.005400Z

it's under Compile Dependencies of https://mvnrepository.com/artifact/fundingcircle/jackdaw/0.6.4

2019-06-07T07:45:28.005700Z

I wonder how that is populated. curl <http://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/5.1.2/kafka-schema-registry-client-5.1.2.jar> &gt; /tmp/kafka-schema-registry-client-5.1.2.jar seems to work fine.

dangercoder 2019-06-07T07:46:43.006100Z

Hmm. wierd, I got Error building classpath. Could not find artifact io.confluent:kafka-schema-registry-client:jar:5.1.2 in central (<https://repo1.maven.org/maven2/>) when trying to fetch jackdaw with deps.edn

2019-06-07T07:48:02.006900Z

Do you have their repo in your project.clj? :repositories [["confluent" {:url "<https://packages.confluent.io/maven/>"}]]

2019-06-07T07:48:36.007400Z

Ah sorry, you're using deps

2019-06-07T07:48:56.007800Z

I think deps has it's own way of doing this.

2019-06-07T07:49:22.008300Z

:mvn/repos
 {"confluent" {:url "<https://packages.confluent.io/maven/>"}}

dangercoder 2019-06-07T07:50:03.009200Z

Ah, very sorry if I gave you an heart attack. False alarm 😣

dangercoder 2019-06-07T07:50:16.009500Z

(Playing around with deps.edn for the first time.)

dharrigan 2019-06-07T07:50:33.009800Z

Yes, I use deps, you have to put the confluent repo in 😉

2019-06-07T07:51:18.010100Z

😅

dangercoder 2019-06-07T08:06:33.011400Z

I figured something out. If I want to see some nice examples of using jackdaw I can always look at the tests 😁

dangercoder 2019-06-07T08:34:42.013700Z

Has anyone gotten headers working in the produce! function? in the test-code there's an empty map as headers but if I pass in a non-empty map I get exceptions.

dangercoder 2019-06-07T08:37:01.013800Z

class clojure.lang.MapEntry cannot be cast to class org.apache.kafka.common.header.Header

dangercoder 2019-06-07T09:07:49.014Z

I found a solution