Clojurians Log v2

When using aws-api, does :PutObject end up bringing :Body fully into memory?

yes

currently

Hmm, yeah I thought so. Getting OOMs. Any workarounds?

multipart uploads

are you uploading from a File source?

Is there an existing example for doing that? If not, will figure it out.

Yes

there is not an existing example

there's an API to start an upload, then to upload pieces, then to complete the upload

pieces parts can be uploaded concurrently

Somewhat amusingly, our system uses the -XX:+HeapDumpOnOutOfMemoryError jvm flag. When the app reboots, it will upload the heap dump to s3. The heap dumps are so large that they oom the app again while uploading 😆

heh, whoops

same feature implemented twice? 🙂

For those interested in an example for a multipart upload...