Clojurians Log v2
Clojure programming
Channels
Apps
data-science
Data science, data analysis, and machine learning in Clojure
https://scicloj.github.io/pages/chat_streams/ for additional discussions
awb99 2021-05-02T04:27:32.047400Z
can someone tell me how I can convert http://tech.ml dataset back to clojure? dataset->data gives me vectors, but I want a row by row representation.
2021-05-02T05:45:08.050200Z
@hoertlehner
tablecloth.api/rows has various output formats.
On a lower level, tech.v3.dataset/mapseq-reader returns a Reader (in the dtype-next sense) of rows as maps.
Santiago 2021-05-02T21:08:32.051600Z
I have a structure that looks like
{:UC48G7530085 [{:price 693.4965 :unixtimestamp 16893454}
{:price 700.3344 :unixtimestamp 16893455}
{:price 702.4444 :unixtimestamp 16893456}]}12:00:00, 12:01:00 and not 12:00:53, 12:01:53 from unix timestampsSantiago 2021-05-03T11:05:04.053300Z
Nice thanks!
2021-05-03T18:33:54.053500Z
@ezmiller77 might have something to say about this time-related thread.
Santiago 2021-05-04T08:42:32.053900Z
(defn candlestick-data
"Returns a vector of maps with the data to build a candlestick chart"
[price-quotes]
(->> price-quotes
(mapv #(assoc-in % [:truncated-dt] (t/truncate (:datetime %) :minutes)))
(group-by :truncated-dt)
(filter (fn [[_ v]] (> (count v) 1)))
(into {})
(reduce-kv
(fn [m k v]
(let [high-price (max-key-val :price v)
low-price (min-key-val :price v)
candle-start-unix (min-key-val :unixtimestamp v)
candle-end-unix (max-key-val :unixtimestamp v)
open-price (-> v
first
:price)
close-price (-> v
peek
:price)
n-quotes (count v)
res {:high-price high-price
:low-price low-price
:open-price open-price
:close-price close-price
:candle-start k
:candle-end (t/>> k (t/new-duration 1 :minutes))
:candle-start-unix candle-start-unix
:candle-end-unix candle-end-unix
:n-quotes n-quotes}]
(conj m res)))
[])))juxt/tick is dope! It’s exactly what I was looking for 🙂 let’s me work with unix timestamps as much as possible until the last minute
raspasov 2021-05-05T01:07:25.054600Z
@slack.jcpsantiago Very glad to hear!
raspasov 2021-05-02T23:18:18.051900Z
You can use a library like juxt/tick
(require '[tick.alpha.api :as t])
(let [now (t/now)
now' (t/truncate now :minutes)]
(t/range
(t/beginning now')
(t/end (t/instant (t/at (t/tomorrow) (t/midnight))))
(t/new-duration 1 :minutes)))raspasov 2021-05-02T23:18:53.052100Z
=> (#time/instant”2021-05-02T23:17:00Z” #time/instant”2021-05-02T23:18:00Z” #time/instant”2021-05-02T23:19:00Z” #time/instant”2021-05-02T23:20:00Z” #time/instant”2021-05-02T23:21:00Z” #time/instant”2021-05-02T23:22:00Z” …. )