data-science

Data science, data analysis, and machine learning in Clojure https://scicloj.github.io/pages/chat_streams/ for additional discussions
2020-03-29T09:40:34.023700Z

Yesterday, @jsa-aerial and I recorded a short conversation https://youtu.be/DqVh7VEzQaI about Saite, and how it can be used to visualize COVID-19 data.

gibb 2020-03-29T13:14:27.024900Z

Hey, total noob here! I'd like to create a simple visualization using clojure of peak loads on a system given a population of users.

gibb 2020-03-29T13:15:20.025700Z

I've been messing around with Incanter (just the first google hit i found) and just rendered some normal distributions there.

gibb 2020-03-29T13:16:39.027Z

I'm curious about a few things around this modelling and visualization. 1. Is it a decent assumption to make that usage somewhat fits a normal distribution?

gibb 2020-03-30T09:41:38.029100Z

Thanks @val_waeselynck! I watched the video and dived into some telecom whitepapers which uses Poisson distributions for modelling peak call volumes which seems reasonable

val_waeselynck 2020-03-30T11:30:03.030100Z

Note that the normal distribution is a limit of Poisson distributions, so it may be fine. If you want to do some prediction or interpolation, using normal distributions could give you the opportunity to do that with Gaussian Processes.

gibb 2020-03-30T11:31:36.030300Z

Yeah I think it's going to be mostly the same since we just pretty much want to prepare for a bunch of somewhat independent users using a service after it's announced avaliable

gibb 2020-03-30T11:31:59.030500Z

Or it's enough of a model to do what we have time to do to mitigate the peak traffic load anyway 😄

👌 1
gibb 2020-03-30T17:43:22.040500Z

Hm I want a nice chart to make a case for progressive rollout of my little service, and visualize it in a histogram with multiple poisson distributions showing cumulative load

val_waeselynck 2020-03-29T18:08:24.028500Z

I think Zach Tellman made better recommendations here: https://youtu.be/1bNOO3xxMc0

val_waeselynck 2020-03-29T18:09:26.028700Z

A Poisson distribution iirc