[maker-devel] Possible to redirect maker output?

Florian fdolze at students.uni-mainz.de
Thu Mar 3 04:01:06 MST 2016


Hello Carson,

May I ask on what kind of hardware setup you guys are running MAKER?

I cant seem to get this running performantly on our cluster. There are 
usually only 2-3 cores running on 100% and the rest is idle waiting (I 
THINK due to I/O blockage but I'm not sure). Any ideas how I could find 
the cause for this problem?

I attached a screenshot of the node status for the first hour of the 
last MAKER run if this is any help.

On 29.02.2016 20:09, Carson Holt wrote:
> You can try setting TMP= in the control files to a RAM disk location (You will need a lot of RAM though, perhaps 500Gb). Even then some components used by MAKER may not function properly with tmpfs, but you can try. If it doesn’t work you’ll get an error. The main output directory on the other hand must be globally accessible to all nodes if working with MPI, and a RAM disk will only exist and be accessible on a single node (even though a directory with the same name may exists on multiple nodes, they will actually be separate and distinct locations, i.e. /dev/shm).
>
> —Carson
>
>
>> On Feb 26, 2016, at 7:16 AM, Florian<fdolze at students.uni-mainz.de>  wrote:
>>
>> Hi all,
>>
>> I am trying to run maker on a cluster (2 nodes with 64 cores each), to speed things up I copied all input files to a ramdisk to reduce I/O time, but all subsequent results are still written to hdd.
>>
>> Is there a way I can tell maker to write the maker.results files to ramdisk (or generally any other directory than the current working dir) too? (are they actually used for the current run or are only files in the temp files location used?)
>>
>> Is anybody experienced with running maker on a similar setup and could tell me how you are handling this?
>>
>>
>> thanks,
>> Florian
>>
>> _______________________________________________
>> maker-devel mailing list
>> maker-devel at box290.bluehost.com
>> http://box290.bluehost.com/mailman/listinfo/maker-devel_yandell-lab.org

-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot from 2016-03-03 11:35:41.png
Type: image/png
Size: 149996 bytes
Desc: not available
URL: <http://yandell-lab.org/pipermail/maker-devel_yandell-lab.org/attachments/20160303/37ddf143/attachment-0002.png>


More information about the maker-devel mailing list