jackdaw

https://github.com/FundingCircle/jackdaw
2020-06-04T09:51:55.038500Z

Hello. I am new to jackdaw and I wonder if there is any throttling option when consuming streams and merging them. I am left-joining multiple ktables into one and I want to have the main stream to have highest priority (unconsumed events for that event needs to be as low as possible with the trade-off of joining other streams later on). Does jackdow have some utility for such a case ?

Daniel Stephens 2020-06-04T09:58:14.040700Z

You could do it rather manually with your own set of consumers but I don't think KafkaStreams supports it out of the box which means I don't think jackdaw would since it's (mostly) a wrapper

2020-06-04T10:00:06.041900Z

Yep. KafkaStreams does not support it https://cwiki.apache.org/confluence/display/KAFKA/KIP-349%3A+Priorities+for+Source+Topics . I was wondering if anyone needed this and made some tools using jackdaw. It sounds like quite a common problem.