What space do you get in circleci builds? > /usr/bin/ld: final link failed: No space left on device
Is there a good way to run a benchmark during CI on circleci? For Datahike we could use an instance that has a certain performance consistency to run a benchmark on.
@timok I've been told more than once that CI isn't a good environment to do this
unless you arrange your own bare metal probably
right. that is basically the requirement, to run a bare metal instance
https://circleci.com/docs/2.0/runner-overview/ is the only way I know of currently to run a CircleCI job on bare metal.
@timok using the machine executor is (currently) equivalent to getting an n2 instance on GCP, and will always be a dedicated VM
so that might be sufficient for you
the docker executor runs on a multi-tenant system, but we donβt overprovision, so in theory it should be fairly consistent. In practice this varies
Cool, thanks! π I will probably start with a machine and take a look on consistency there. maybe improving it with something self-hosted later.
i suspect the performance inconsistency is actually because we allow jobs to use spare CPU above their allocation if nothing else is using it, so if you land on a quiet machine you might go faster