I have a Monte Carlo code (physical sciences) running on Linux. On my 8-CPU desktop I can run 8 jobs in parallel. (Perhaps it is more accurate to say that the overall problem is split into 8 jobs and the results are combined when all jobs complete).
I have also set up a Google Cloud c2d-112 instance and can run 112 jobs in parallel.
I have also created a container that runs successfully.
However, I am struggling with how to set up a cluster to run (let's say) 500 jobs in parallel. The new Batch option seems interesting but I'm not convinced it works for my case.
Any general guidance would be appreciated; there seems to be a steep learning curve.
Thanks, Carl R