observability

o11y, monitoring, logging, tracing, alerting and higher level discussions
sparkofreason 2020-08-07T17:20:03.126500Z

I'm about to write a bunch of log-line parsers for logs across the variety of languages/platforms we use. Any pointers to existing libraries that might handle this task?

lukasz 2020-08-07T18:31:04.127Z

instaparse or clj-antlr if you need the big guns, good old regexes are always there

lukasz 2020-08-07T18:31:42.127700Z

clj-antlr might be the most robust as you might find compatible grammar definitions around the internet

lukasz 2020-08-07T18:31:58.128100Z

(that's how we kick started our Lucene-like query interface in our product)

sparkofreason 2020-08-07T19:39:49.129100Z

Started with regex, too limiting, have moved on to instaparse. Thought about clj-antlr, but didn't have a lot of hope for finding open-sourced grammars. I guess I should actually look...

jumar 2020-08-07T20:07:23.129800Z

If care about speed ANTLR is much faster than instaparse

sparkofreason 2020-08-07T20:28:43.130500Z

Definitely. Instaparse is nice for REPL-driven development, but once I get the grammars nailed down I'll probably move to ANTLR.

2020-08-07T21:57:49.131200Z

i noticed that https://github.com/antlr/grammars-v4 had a variety of grammars -- is it possible one of them might already be close to what you might need?

sparkofreason 2020-08-08T12:48:11.133300Z

I did look in there, didn't find anything. Anyway, turning out to be pretty easy to define log parsers in instaparse.