Clojurians Log v2
Clojure programming
Channels
Apps
jackdaw
https://github.com/FundingCircle/jackdaw
Daniel Stephens 2020-05-07T09:24:52.030200Z
hope it's okay to ask general kafka questions in here, sorry in advance if not 😬 does anyone know why my consumer lag often sticks at 1?
davewm 2020-05-11T14:35:35.031Z
@dstephens are you using exactly-once semantics? If so, the kafka console tools will report the lag as 1 even when all messages have been processed
Daniel Stephens 2020-05-11T20:39:58.031200Z
ahh, yes I am. Thanks, I guess just something I need to be aware of then, cheers!
gklijs 2020-05-13T18:38:18.031400Z
Not that I mind asking the question here, but you might also like the #apache-kafka channel.
Daniel Stephens 2020-05-07T09:27:40.030500Z
that's a little bit of the output from describing the consumer group, cmd.customer is a source and goes to 0, but customer is both a sink and a source, could that be the reason? I have basically two flows in the topology:
cmd.customer -> some internal topics -> customer
customer -> aggregation -> agg.customer