I am trying to figure out how to write a proper job file for the Sun Grid Engine so I can run a parallel computation using Mathematica on multiple nodes. Unfortunately almost all tutorials on the topic assume using MPI, which is not the case here.
In order to get this working, I need to find the answer to a few very specific questions:
When I request multiple nodes, will the job file be run on all of them, or only on a single node? I need to run it only on a single node in this case, and start a single process which we can call controlling process.
How can I access the names / IP addresses of all the other nodes? I think I have the answer to this one: the
PE_HOSTFILEvariable should point to a file that lists the names of all nodes.
How can I let the controlling process start arbitrary processes at arbitrary times on any node that I can use? Should a simple
ssh nodename commandwork for this, or would this require a password in a typical setup?