Clojurians Log v2
aws
Does anyone know of a pre-built script, tool, or whatever that would let me spin up a specific ec2 instance, clone a github project, open a nrepl in that project, and allow me to connect to it locally? I can do all of that stuff myself, but, as usual, the devil is in the details. Was hoping to not lose a few hours if there's something pre-built to do that 😅 My use case is I have some huge batch jobs I want to run on a 64+ core machine and be able to interact with the results in the repl.
Technically you should be able to do all of the above with Clojure and cognitect-labs/aws-api: • create a VPC • define security group to allow connection via SSH • create an ec2 instance with user-data script which will clone your code, setup SSH keys necessary for opening a tunnel to to the nrepl server • destroys the VPC, security groups and the EC2 instance when you're done
The easiest option is to install an EC2 from an existing template in IOC, there should be plenty in Terraform or pulumi . Beware of the ones that use the NAT gateway, they can be expensive in case your need a lot of traffic for the batch data. You can the internet gateway. Once the ec2 is setup and patched, ssh to it, install lein and upload your data. I've done a similar setup on my Raspbery pi.
But you can consider running the jobs on the local machine overnight, persist the results and read them in repl the next day. it will save you a lot of hassle and let you focus on the problem instead of infrastructure