[maker-devel] maker mpi failed

[Dian "Oscar" Jiao]

See the attached files. The command I used "/work/02045/jiao/modules/Maker-GMOD/maker2.26/exe/mpich2/bin/mpiexec -n 12 /work/02045/jiao/modules/Maker-GMOD/maker2.26/bin/maker -debug maker_exe.ctl maker_opts.ctl maker_bopts.ctl 2> mpich-maker-debug.log"

I am still using Maker 2.26. These problems I had earlier with AnyDBM_File were resolved (manually), so I did not install the development version.

~Oscar

From: Carson Holt <carsonhh at gmail.com<mailto:carsonhh at gmail.com>>
Date: Friday, October 5, 2012 11:05 AM
To: Oscar Jiao <jiao at tacc.utexas.edu<mailto:jiao at tacc.utexas.edu>>, "maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>" <maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>>
Subject: Re: [maker-devel] maker mpi failed

Are you using the subversion version of MAKER I sent?

If so send me the following.  Run under MPI with the --debug flag set on maker.  When running, supply the full path to both the maker and mpiexec executables.  Capture the STDERR to a file.

Send me that STDERR file together with the maker_opts.ctl file you are using.

Thanks,
Carson



From: "Dian \"Oscar\" Jiao" <jiao at tacc.utexas.edu<mailto:jiao at tacc.utexas.edu>>
Date: Friday, 5 October, 2012 1:06 AM
To: Carson Holt <carsonhh at gmail.com<mailto:carsonhh at gmail.com>>, "maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>" <maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>>
Subject: Re: [maker-devel] maker mpi failed

I followed your instructions to compile Maker with MPICH2 (the one comes with Maker). But when I run maker with mpi, it terminates with the message:

STATUS: Parsing control files...
STATUS: Processing and indexing input FASTA files...
=========================================================================== ==========

=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   EXIT CODE: 11
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
=========================================================================== ==========

APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)

The serial version of Maker still works. I tried to install MPICH2 manually outside maker and got the same error.

--
Dian (Oscar) Jiao, Ph.D.,
Research Associate, Life Sciences Computing Group
Texas Advanced Computing Center
University of Texas at Austin
jiao at tacc.utexas.edu<mailto:jiao at tacc.utexas.edu> | (832) 303-1166

From: Carson Holt <carsonhh at gmail.com<mailto:carsonhh at gmail.com>>
Date: Thursday, October 4, 2012 3:53 PM
To: Oscar Jiao <jiao at tacc.utexas.edu<mailto:jiao at tacc.utexas.edu>>, "maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>" <maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>>
Subject: Re: [maker-devel] maker mpi failed

You either tried to run with the -dsindex option before the log file existed or you tried to launch via MPI when not compiled for MPI or not compiled correctly.  It's as if you called MAKER serially multiple times in a row which you can do, but if you start too many before one of them gets a chance to get the log file started a race condition exists.

Which MPI flavor are you using?  MVAPICH2 won't work with MAKER, MPICH2 will, and OpenMPI may or may not (non-robust shared library behavior).

You may have to reinstall MPICH2.

MAKER can try and do this for you using necessary flags to make it easier
To do this -->
cd ./maker/src
./Build mpich2

Then reinstall maker
cd ./maker/src
perl Build.PL
<say yes to mpi question>
./Build clean
./Build install

Then use this executable to launch --> ./maker/exe/mpich2/bin/mpiexec

Note you cannot use other launchers.  You have to use the one you compiled with.

--Carson



From: "Dian \"Oscar\" Jiao" <jiao at tacc.utexas.edu<mailto:jiao at tacc.utexas.edu>>
Date: Thursday, 4 October, 2012 4:42 PM
To: "maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>" <maker-devel at yandell-lab.org<mailto:maker-devel at yandell-lab.org>>
Subject: [maker-devel] maker mpi failed

Hi, I was trying to run maker 2.26. It was compiled with MPI. The non-mpi executable works just fine. But I got the error below while running mpirun –n maker ……

What is this Iterator::Fasta::skip_file? Any idea what is going on here?

Oscar

STATUS: Processing and indexing input FASTA files...
STATUS: Setting up database for any GFF3 input...
A data structure will be created for you at:
/work/02045/jiao/modules/Maker-GMOD/maker2.26/data/dpp_contig.maker.output/dpp_contig_datastore

To access files for individual sequences use the datastore index:
/work/02045/jiao/modules/Maker-GMOD/maker2.26/data/dpp_contig.maker.output/dpp_contig_master_datastore_index.log

ERROR: Log file does not exist in Iterator::Fasta::skip_file
MPI process (rank: 8) terminated unexpectedly on c341-213.ls4.tacc.utexas.edu
Exit code -5 signaled from c341-213

_______________________________________________ maker-devel mailing list maker-devel at box290.bluehost.com<mailto:maker-devel at box290.bluehost.com> http://box290.bluehost.com/mailman/listinfo/maker-devel_yandell-lab.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://yandell-lab.org/pipermail/maker-devel_yandell-lab.org/attachments/20121005/3cc51f5e/attachment-0002.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: maker_opts.ctl
Type: application/octet-stream
Size: 4468 bytes
Desc: maker_opts.ctl
URL: <http://yandell-lab.org/pipermail/maker-devel_yandell-lab.org/attachments/20121005/3cc51f5e/attachment-0004.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mpich-maker-debug.log
Type: application/octet-stream
Size: 315735 bytes
Desc: mpich-maker-debug.log
URL: <http://yandell-lab.org/pipermail/maker-devel_yandell-lab.org/attachments/20121005/3cc51f5e/attachment-0005.obj>