3
$\begingroup$

I am looking for a tool to specify pipelines of arbitrary multiple jobs with dependencies for the Sun Grid Engine. I can wire things together myself but I am hoping for something more declarative and reusable.

Can anyone recommend such a tool or has anyone adapted an existing build system/dependency manager for compute jobs on SGE?

Improve this question
$\endgroup$

3 Answers 3

Reset to default
2
$\begingroup$

Makeflow describes dependencies using the Make syntax. It natively supports SGE as well.

Improve this answer
$\endgroup$
0
$\begingroup$

Have you considered the qmake command that comes with grid engine? A bit limited as the individual subjobs can't really be parallel but since you mentioned make...

Improve this answer
$\endgroup$
0
$\begingroup$

Starcluster uses SGE fairly intelligently. It is part of a suite of tools that make numpy/scipy installs/deploy operations really easy via EC2.

We have moved away from using SGE, as it is in developmental flux at the moment.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.