clojars

http://clojars.org discussion and “support”, see http://status.clojars.org for status.
juhoteperi 2017-01-05T10:17:53.000053Z

Any idea what could cause Broken Pipe Exception when deploying to Clojars?

juhoteperi 2017-01-05T10:18:03.000054Z

E.g. https://circleci.com/gh/cljsjs/packages/1443

juhoteperi 2017-01-05T10:18:48.000056Z

Interestingly build 1436 succeeded and I haven't changed configuration after that

2017-01-05T17:43:16.000057Z

@juhoteperi: I don't see any errors in the http://clojars.org logs. I do see entries for the files that were successful, but nothing for the failed jars

2017-01-05T17:44:10.000058Z

can you try against http://clojars.org/repo/ instead? http://repo.clojars.org 302's to http://clojars.org/repo/, but something may be causing that initial request to timeout for some reason

2017-01-05T17:44:23.000059Z

though you would think that would affect all the files, not just the jars

juhoteperi 2017-01-05T17:44:44.000060Z

Could the cdn have size limit?

juhoteperi 2017-01-05T17:45:03.000061Z

Though the jars shouldn't be particularly large, 700KB or something

2017-01-05T17:46:29.000062Z

hmm, I wonder. maybe there is a limitation there - the full file may be uploaded before the 302 is issued, which would mean 1) the cdn would need to accept the full size, and 2) aether will upload each file twice

2017-01-05T17:46:58.000063Z

302'ing may be a bad idea :(

juhoteperi 2017-01-05T17:47:34.000064Z

hmm not sure how http works in this case

juhoteperi 2017-01-05T17:47:38.000065Z

trying direct url now

juhoteperi 2017-01-05T17:50:00.000066Z

direct url works

juhoteperi 2017-01-05T17:53:12.000067Z

Could Fastly be configured to just proxy PUT requests to real server?

juhoteperi 2017-01-05T17:59:31.000069Z

Based on CDN announcement, there is currently one origin set up for Fastly, Rackspace Cloud Files

juhoteperi 2017-01-05T18:00:06.000070Z

I think it would be possible to set up http://clojars.org/repo/ as another origin, and add request rule to direct PUT requests to that and not cache them

juhoteperi 2017-01-05T18:00:25.000071Z

Then there wouldn't be need for redirect

2017-01-05T18:29:41.000072Z

@juhoteperi: I don't understand, what do you mean by "another origin"? http://clojars.org/repo/ is the canonical deploy url, and the legacy read url. The redir solution that is currently in place is just to support boot, since it doesn't have a concept of two different urls for the same repo

2017-01-05T18:30:12.000073Z

the CDN currently doesn't cache anything uploaded to it, it just tries to redirect to http://clojars.org/repo/

2017-01-05T18:30:43.000074Z

the http://clojars.org server then uploads to Cloud Files once the upload is complete, then it can be served by the CDN

2017-01-05T18:30:53.000075Z

I'll see if I can proxy from the CDN instead of redirect though

2017-01-05T18:31:04.000076Z

that may not be an option

juhoteperi 2017-01-05T18:34:51.000077Z

Is it normal for maven repos have different read and deploy urls?

juhoteperi 2017-01-05T18:35:23.000078Z

We talked about adding support for separate deploy urls on #boot but weren't sure how common this is

2017-01-05T18:36:53.000079Z

well, for nexus, you do have different urls, because deploys go to a staging repo first, so you are deploying to that

2017-01-05T18:37:39.000080Z

I'm not sure about archiva, but nexus is the primary repo implementation

danielcompton 2017-01-05T20:54:33.000081Z

@tcrawley the proxying should be fine, I'm pretty sure Fastly will stream it through without holding onto it all

2017-01-05T20:55:09.000082Z

cool, we just need to figure that out

juhoteperi 2017-01-05T22:45:41.000083Z

"origin" is the source for CDN, if I understand correctly, currently CDN loads files from Cloud Files

juhoteperi 2017-01-05T22:45:51.000084Z

But CDN probably can have several origins

danielcompton 2017-01-05T23:21:01.000085Z

@juhoteperi yep, that’s what we want to do I think. To clarify, this is probably what we want to happen: * GET/HEAD requests to Fastly are cacheable and go to Rackspace cloudfiles * POST requests to Fastly are passed straight through to the http://clojars.org webapp

juhoteperi 2017-01-05T23:57:25.000087Z

Yeah