aws

http://status.aws.amazon.com/ https://www.expeditedssl.com/aws-in-plain-english
agilecreativity 2020-02-14T16:20:16.116800Z

Hi I trying to stream the result from aws s3 and process it. What I am trying is something like

(def s3-result (aws/invoke client {:op :GetObject 
                    :request {:Bucket "my-bucket"
                              :Key "path/to/some/big-file.csv"
                              :Range "bytes=0-30000" ;; just an example
                              }))

;; I want to process the file as it come in line-by-line without holding the things in memory

(-> s3-result 
    :Body)
;;=&gt; this is of the type <http://java.io|java.io>.BufferedInputStream
I know that the result is available in the :Body after the request. Now does anyone know how to do this lazily?

2020-02-14T16:33:00.117700Z

aws-api doesn't support streaming yet. https://github.com/cognitect-labs/aws-api/issues/14

2020-02-14T16:35:28.120200Z

We do plan to support "bring your own http-client" in the future, but there is no timeline for that.

👍 1
agilecreativity 2020-02-14T16:40:45.120300Z

@dchelimsky Thanks for the clarification.

2020-02-14T16:41:14.120500Z

You're welcome.

2020-02-14T19:42:50.120900Z

[ANN] Cognitect Labs' aws-api 0.8.437 is now available! https://groups.google.com/forum/#!topic/clojure/AIQzOkhUDBU

souenzzo 2020-02-14T20:58:43.122500Z

!Ref "#off-topic"