[maker-devel] Strange error at blastn step
Carson Holt
carsonhh at gmail.com
Fri Oct 26 12:56:30 MDT 2012
Yes. That is correct. Also I've made one more update to the development
release with respect to indexes for your test run. Could you run 'svn
update' inside the devel maker directory.
Thanks,
Carson
From: Daniel Standage <daniel.standage at gmail.com>
Date: Friday, 26 October, 2012 2:47 PM
To: Carson Holt <carsonhh at gmail.com>
Cc: "maker-devel at yandell-lab.org" <maker-devel at yandell-lab.org>
Subject: Re: [maker-devel] Strange error at blastn step
I've got a test run (with the dev version) waiting in the queue. But just
to be clear, if the temp directory is indeed the problem, I'm assuming that
would that be fixed by setting a different temp directory on the same disk
as the scratch disk?
--
Daniel S. Standage
Ph.D. Candidate
Bioinformatics and Computational Biology Program
Department of Genetics, Development, and Cell Biology
Iowa State University
On Fri, Oct 26, 2012 at 2:32 PM, Carson Holt <carsonhh at gmail.com> wrote:
> If running './Build install_deps' to get the prereqs automatically, you can
> say yes to the local version question if you want those prereqs to be
> installed just for MAKER rather than globally to whatever perl you are using.
>
> Thanks,
> Carson
>
>
>
> From: Daniel Standage <daniel.standage at gmail.com>
> Date: Friday, 26 October, 2012 2:29 PM
>
> To: Carson Holt <carsonhh at gmail.com>
> Cc: "maker-devel at yandell-lab.org" <maker-devel at yandell-lab.org>
> Subject: Re: [maker-devel] Strange error at blastn step
>
> Got this from the compute node. Looks like native disk space to me.
>
> [dstandag at mason ~] df /tmp
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/sda1 478573472 12319684 441943620 3% /tmp
>
> Installing a bundle of Perl prereqs for development version, will try that
> soon.
>
> --
> Daniel S. Standage
> Ph.D. Candidate
> Bioinformatics and Computational Biology Program
> Department of Genetics, Development, and Cell Biology
> Iowa State University
>
>
>
> On Fri, Oct 26, 2012 at 2:24 PM, Carson Holt <carsonhh at gmail.com> wrote:
>> Ok. Try the developer release and see if it still happens.
>>
>> Thanks,
>> Carson
>>
>>
>> From: Daniel Standage <daniel.standage at gmail.com>
>> Date: Friday, 26 October, 2012 2:19 PM
>>
>> To: Carson Holt <carsonhh at gmail.com>
>> Cc: "maker-devel at yandell-lab.org" <maker-devel at yandell-lab.org>
>> Subject: Re: [maker-devel] Strange error at blastn step
>>
>> Unfortunately, the job is no longer running and as a result I cannot connect
>> to the compute nodes as I could while it was running. On the interactive
>> node, it looks like it's real disk, although it looks like there are some
>> tmpfs mounts.
>>
>> [dstandag at mason src] df /tmp
>> Filesystem 1K-blocks Used Available Use% Mounted on
>> /dev/sdb2 462824304 180235660 259078476 42% /tmp
>> [dstandag at mason src] df
>> Filesystem 1K-blocks Used Available Use% Mounted on
>> login_x86_64 16497564 3077352 13420212 19% /
>> tmpfs 16497564 0 16497564 0% /dev/shm
>> tmpfs 10240 0 10240 0% /var/tmp
>> /dev/sdb2 462824304 180235660 259078476 42% /tmp
>> AFS 9000000 0 9000000 0% /afs
>> bl-nas1:/vol/hd00 3435973856 1775658144 1660315712 52% /N/hd00
>> bl-nas1:/vol/hd01 3435973856 1684116928 1751856928 50% /N/hd01
>> bl-nas2:/vol/hd02 3435973856 1856598656 1579375200 55% /N/hd02
>> bl-nas2:/vol/hd03 3435973856 2747626240 688347616 80% /N/hd03
>> bl-nas1:/vol/hdln 81920 3424 78496 5% /N/u
>> bl-nas2:/vol/soft 1258291200 837003424 421287776 67% /N/soft
>> bl-nas1:/vol/logs 419430400 67163328 352267072 17% /N/logs
>> ...
>> ...
>>
>> I'll see if I can launch another short job and verify this on the compute
>> nodes.
>>
>> --
>> Daniel S. Standage
>> Ph.D. Candidate
>> Bioinformatics and Computational Biology Program
>> Department of Genetics, Development, and Cell Biology
>> Iowa State University
>>
>>
>>
>> On Fri, Oct 26, 2012 at 2:14 PM, Carson Holt <carsonhh at gmail.com> wrote:
>>> The command 'df /tmp' will tell you whether /tmp is a tmpfs mount
>>>
>>> Thanks,
>>> Carson
>>>
>>>
>>> From: Daniel Standage <daniel.standage at gmail.com>
>>> Date: Friday, 26 October, 2012 2:12 PM
>>> To: Carson Holt <carsonhh at gmail.com>
>>> Cc: "maker-devel at yandell-lab.org" <maker-devel at yandell-lab.org>
>>>
>>> Subject: Re: [maker-devel] Strange error at blastn step
>>>
>>> It looks like /tmp is indeed being used: the files I played with were under
>>> /tmp/maker_1YQF9o.
>>>
>>> --
>>> Daniel S. Standage
>>> Ph.D. Candidate
>>> Bioinformatics and Computational Biology Program
>>> Department of Genetics, Development, and Cell Biology
>>> Iowa State University
>>>
>>>
>>>
>>> On Fri, Oct 26, 2012 at 2:09 PM, Carson Holt <carsonhh at gmail.com> wrote:
>>>> Check to see where /tmp is located? Some clusters have it set up as a
>>>> tmpfs directory and I have had problems with fasta indexes running from
>>>> tmpfs mounts in the past.
>>>>
>>>> --Carson
>>>>
>>>>
>>>> From: Daniel Standage <daniel.standage at gmail.com>
>>>> Date: Friday, 26 October, 2012 2:05 PM
>>>> To: Carson Holt <carsonhh at gmail.com>
>>>>
>>>> Subject: Re: [maker-devel] Strange error at blastn step
>>>>
>>>> The maker working directory is in a cluster environment with shared scratch
>>>> space (I'm guessing NFS-mounted). I didn't change the temp directory
>>>> setting, so it should be the local default (/tmp).
>>>>
>>>> I'll give the dev version a shot. Thanks.
>>>>
>>>> --
>>>> Daniel S. Standage
>>>> Ph.D. Candidate
>>>> Bioinformatics and Computational Biology Program
>>>> Department of Genetics, Development, and Cell Biology
>>>> Iowa State University
>>>>
>>>>
>>>>
>>>> On Fri, Oct 26, 2012 at 1:57 PM, Carson Holt <carsonhh at gmail.com> wrote:
>>>>> Could you try this development version and tell me if the error still
>>>>> happens?
>>>>>
>>>>> Use this command to download -->
>>>>> <<blanked out from the mailing list>>
>>>>>
>>>>> Username: <<blanked out from the mailing list>>
>>>>> Password: <<blanked out from the mailing list>>
>>>>>
>>>>> Are you running in an NFS mounted directory or are you resetting TMP to a
>>>>> different location?
>>>>>
>>>>> Thanks,
>>>>> Carson
>>>>>
>>>>>
>>>>> From: Daniel Standage <daniel.standage at gmail.com>
>>>>> Date: Friday, 26 October, 2012 1:52 PM
>>>>> To: Maker Mailing List <maker-devel at yandell-lab.org>
>>>>> Subject: Re: [maker-devel] Strange error at blastn step
>>>>>
>>>>> I have since installed Maker on a different machine and tried it out. The
>>>>> test run completed successfully, but as I commenced with the full genome
>>>>> annotation, I have noticed the following error popping up frequently.
>>>>>
>>>>>> formating database...
>>>>>> #--------- command -------------#
>>>>>> Widget::formater:
>>>>>> /N/u/dstandag/Mason/local/bin/makeblastdb -dbtype prot -in
>>>>>> /tmp/maker_1YQF9o/Amel3%2E2_Dmel5%2E47%2Efaa.mpi.10.8
>>>>>> #-------------------------------#
>>>>>> running blast search.
>>>>>> #--------- command -------------#
>>>>>> Widget::blastx:
>>>>>> /N/u/dstandag/Mason/local/bin/blastx -db
>>>>>> /tmp/maker_1YQF9o/Amel3%2E2_Dmel5%2E47%2Efaa.mpi.10.8 -query
>>>>>> /tmp/maker_1YQF9o/rank0/scaffold_0.0 -num_alignments 100000
>>>>>> -num_descriptions 100000 -evalue 1e-06 -dbsize 300 -searchsp 500000000
>>>>>> -num_threads 16 -seg yes -soft_masking true -lcase_masking -show_gis -out
>>>>>> /N/dc/scratch/dstandag/PdomGenomic/Annotation/output/maker.pdom.1.mason.m
>>>>>> aker.output/maker.pdom.1.mason_datastore/scaffold_0/theVoid.scaffold_0/sc
>>>>>> affold_0.0.Amel3%2E2_Dmel5%2E47%2Efaa.blastx.temp_dir/Amel3%2E2_Dmel5%2E4
>>>>>> 7%2Efaa.mpi.10.8.blastx
>>>>>> #-------------------------------#
>>>>>> deleted:-10 hits
>>>>>> formating database...
>>>>>> #--------- command -------------#
>>>>>> Widget::formater:
>>>>>> /N/u/dstandag/Mason/local/bin/makeblastdb -dbtype prot -in
>>>>>> /tmp/maker_1YQF9o/Amel3%2E2_Dmel5%2E47%2Efaa.mpi.10.9
>>>>>> #-------------------------------#
>>>>>> running blast search.
>>>>>> #--------- command -------------#
>>>>>> Widget::blastx:
>>>>>> /N/u/dstandag/Mason/local/bin/blastx -db
>>>>>> /tmp/maker_1YQF9o/Amel3%2E2_Dmel5%2E47%2Efaa.mpi.10.9 -query
>>>>>> /tmp/maker_1YQF9o/rank0/scaffold_0.0 -num_alignments 100000
>>>>>> -num_descriptions 100000 -evalue 1e-06 -dbsize 300 -searchsp 500000000
>>>>>> -num_threads 16 -seg yes -soft_masking true -lcase_masking -show_gis -out
>>>>>> /N/dc/scratch/dstandag/PdomGenomic/Annotation/output/maker.pdom.1.mason.m
>>>>>> aker.output/maker.pdom.1.mason_datastore/scaffold_0/theVoid.scaffold_0/sc
>>>>>> affold_0.0.Amel3%2E2_Dmel5%2E47%2Efaa.blastx.temp_dir/Amel3%2E2_Dmel5%2E4
>>>>>> 7%2Efaa.mpi.10.9.blastx
>>>>>> #-------------------------------#
>>>>>> deleted:-6 hits
>>>>>> WARNING: Cannot find> comp59088_c1_seq7, trying to re-index the fasta.
>>>>>> stop here:comp59088_c1_seq7
>>>>>> ERROR: Fasta index error
>>>>>>
>>>>>> FATAL ERROR
>>>>>> ERROR: Failed while polishig ESTs!!
>>>>>>
>>>>>> ERROR: Chunk failed at level 14
>>>>>> !!
>>>>>> FAILED CONTIG:scaffold_0
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --Next Contig--
>>>>>>
>>>>>> #---------------------------------------------------------------------
>>>>>> Now starting the contig!!
>>>>>> SeqID: scaffold_1
>>>>>> Length: 5805686
>>>>>> #---------------------------------------------------------------------
>>>>>
>>>>> My first thought based on the message is that blastdbcmd could not find
>>>>> the sequence in the database. I verified this was the case--I could not
>>>>> extract sequence comp59088_c1_seq7 from the database Maker had created
>>>>> under /tmp. However, after removing the index files and re-running
>>>>> makeblastdb with the -parse_seqids option set, blastdbcmd successfully
>>>>> extracted the sequence.
>>>>>
>>>>> I was initially happy with this finding, but upon closer inspection it
>>>>> looks like Maker does not use blastdbcmd to extract sequences, but rather
>>>>> its own internal code. Therefore I'm still not sure where the problem is
>>>>> and how I might fix it. Any insights?
>>>>>
>>>>> Thanks!
>>>>>
>>>>> --
>>>>> Daniel S. Standage
>>>>> Ph.D. Candidate
>>>>> Bioinformatics and Computational Biology Program
>>>>> Department of Genetics, Development, and Cell Biology
>>>>> Iowa State University
>>>>>
>>>>>
>>>>>
>>>>> On Thu, Oct 25, 2012 at 3:30 PM, Daniel Standage
>>>>> <daniel.standage at gmail.com> wrote:
>>>>>> Greetings!
>>>>>>
>>>>>> I am doing a test run of my Maker setup on a new machine, annotating a
>>>>>> pretty short contig (about 3kb). However, there seems to be a hiccup
>>>>>> during the blastn stage. This is the terminal message.
>>>>>>
>>>>>>> #--------- command -------------#
>>>>>>> Widget::blastn:
>>>>>>> /share/home/01854/standage/local/bin/blastn -db
>>>>>>> /tmp/2881473.1.development/maker_i6ZSJi/Pdom%2ETrinity%2ETrimmomatic%2Ef
>>>>>>> asta.mpi.10.7 -query
>>>>>>> /tmp/2881473.1.development/maker_i6ZSJi/rank0/scaffold_866.0
>>>>>>> -num_alignments 100000 -num_descriptions 100000 -evalue 1e-10 -gapextend
>>>>>>> 3 -word_size 15 -reward 1 -penalty -3 -gapopen 3 -dbsize 1000 -searchsp
>>>>>>> 500000000 -num_threads 16 -lcase_masking -dust yes -soft_masking true
>>>>>>> -show_gis -out
>>>>>>> /scratch/01854/standage/PdomGenomic/Annotation/scripts/maker.bogus.maker
>>>>>>> .output/maker.bogus_datastore/scaffold_866/theVoid.scaffold_866/scaffold
>>>>>>> _866.0.Pdom%2ETrinity%2ETrimmomatic%2Efasta.blastn.temp_dir/Pdom%2ETrini
>>>>>>> ty%2ETrimmomatic%2Efasta.mpi.10.7.blastn
>>>>>>> #-------------------------------#
>>>>>>> deleted:0 hits
>>>>>>> ERROR: Could not obtain lock to format database
>>>>>>>
>>>>>>>
>>>>>>> FATAL ERROR
>>>>>>> ERROR: Failed while doing blastn of ESTs!!
>>>>>>>
>>>>>>> ERROR: Chunk failed at level 8
>>>>>>> !!
>>>>>>> FAILED CONTIG:scaffold_866
>>>>>>
>>>>>> Several blastn steps appeared to have completed successfully to this one
>>>>>> failing. Any ideas what could be causing this?
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>> --
>>>>>> Daniel S. Standage
>>>>>> Ph.D. Candidate
>>>>>> Bioinformatics and Computational Biology Program
>>>>>> Department of Genetics, Development, and Cell Biology
>>>>>> Iowa State University
>>>>>>
>>>>>
>>>>> _______________________________________________ maker-devel mailing list
>>>>> maker-devel at box290.bluehost.comhttp://box290.bluehost.com/mailman/listinfo
>>>>> /maker-devel_yandell-lab.org
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://yandell-lab.org/pipermail/maker-devel_yandell-lab.org/attachments/20121026/f3ac6316/attachment-0003.html>
More information about the maker-devel
mailing list