[maker-devel] ERROR: Failed while processing the chunk divide!!

Wed Feb 12 13:42:03 MST 2014

Hi Hossein, 

So, those problems with passing through MAKER-derived gff3 have been addressed in newer versions of MAKER. The current version is 2.31 and is available for download now on our website. Try installing that version and trying the same controls file you started out using, and let me know if that fixes the problems. 

Thanks,
Daniel

Daniel Ence
Graduate Student
Eccles Institute of Human Genetics
University of Utah
15 North 2030 East, Room 2100
Salt Lake City, UT 84112-5330
________________________________________
From: Borhan, Hossein [Hossein.Borhan at AGR.GC.CA]
Sent: Wednesday, February 12, 2014 12:55 PM
To: Daniel Ence
Subject: Re: ERROR: Failed while processing the chunk divide!!

Hi Daniel

I am using maker 2.10
 I also checked the naming of the scaffold in the genome file and the gff
file for the failed example. Naming is the same

Thanks

Hossein

M. Hossein Borhan, Ph.D.
Research Scientist/ Chercheur Scientifique
Saskatoon Research Centre/Centre de Recherches de Saskatoon
Agriculture and Agri-Food Canada/Agriculture et Agroalimentaire Canada
107 Science Place, Saskatoon, SK.,S7N 0X2
Telephone/Téléphone: (306) 385-9441
Facsimile/Télécopieur: (306) 385-9482
Hossein.borhan at agr.gc.ca

On 14-02-12 1:30 PM, "Daniel Ence" <dence at genetics.utah.edu> wrote:

>Hi Hossein,
>
>And which version of MAKER are you using?
>
>Thanks,
>Daniel
>
>
>Daniel Ence
>Graduate Student
>Eccles Institute of Human Genetics
>University of Utah
>15 North 2030 East, Room 2100
>Salt Lake City, UT 84112-5330
>________________________________________
>From: Borhan, Hossein [Hossein.Borhan at AGR.GC.CA]
>Sent: Wednesday, February 12, 2014 12:25 PM
>To: Daniel Ence
>Subject: Re: ERROR: Failed while processing the chunk divide!!
>
>Hi Daniel
>
>Gff file was generated by the 1st run of maker
>
>
>
>HB
>
>
>
>
>
>
>
>On 14-02-12 1:15 PM, "Daniel Ence" <dence at genetics.utah.edu> wrote:
>
>>Hi Hossein,
>>
>>One more question. How did you make the gff3 that you're passing through
>>here?
>>
>>Thanks,
>>Daniel
>>
>>
>>Daniel Ence
>>Graduate Student
>>Eccles Institute of Human Genetics
>>University of Utah
>>15 North 2030 East, Room 2100
>>Salt Lake City, UT 84112-5330
>>________________________________________
>>From: maker-devel [maker-devel-bounces at yandell-lab.org] on behalf of
>>Daniel Ence [dence at genetics.utah.edu]
>>Sent: Wednesday, February 12, 2014 11:59 AM
>>To: Borhan, Hossein
>>Cc: maker-devel at yandell-lab.org
>>Subject: Re: [maker-devel] ERROR: Failed while processing the chunk
>>divide!!
>>
>>Hi Hossein,
>>
>>So, after looking at the gff3 and your control files, I had an idea.
>>There's the part of the control file called "Re-annotation Using MAKER
>>Derived GFF3", but you can also passthrough features from a gff3 using
>>the "est_gff", "protein_gff", "rm_gff", "pred_gff", "model_gff" lines.
>>
>>Sometimes we encounter problems with the MAKER passthrough. Could you try
>>dividing the gff3 file into the different feature sources and passing it
>>through the "est_gff" etc options and not with the MAKER passthrough?
>>That will tell us if the problem is with the gff3 file or with how MAKER
>>is processing it.
>>
>>Another also to check is to make sure that the contig names in the gff3
>>file match the contig names in the fasta file that you're annotating.
>>
>>Thanks,
>>Daniel
>>
>>
>>
>>Graduate Student
>>Eccles Institute of Human Genetics
>>University of Utah
>>15 North 2030 East, Room 2100
>>Salt Lake City, UT 84112-5330
>>________________________________________
>>From: Borhan, Hossein [Hossein.Borhan at AGR.GC.CA]
>>Sent: Wednesday, February 12, 2014 8:49 AM
>>To: Daniel Ence
>>Subject: Re: ERROR: Failed while processing the chunk divide!!
>>
>>Dear Daniel
>>
>>
>>I have generated the files that you requested. I choose Sc00009 from my
>>genome which is 30 kb and was one of the scaffolds coming up with error.
>>In addition to Ctl files and error output file I also attached a part of
>>the gff file related to SC00009 that is indicated in the error message.
>>
>>
>>Thanks for helping with this
>>
>>
>>
>>Regards
>>
>>
>>HB
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>On 14-02-11 4:59 PM, "Daniel Ence" <dence at genetics.utah.edu> wrote:
>>
>>>Hi Hossen,
>>>
>>>I think that what would be the most help right now is if you ran MAKER
>>>on
>>>only one of those contigs that are failing and send me the entire error
>>>output along with the maker control files that you are using. It looks
>>>like the error is coming from the gff3 files that you are using as
>>>input.
>>>
>>>Thanks,
>>>Daniel
>>>
>>>
>>>
>>>Daniel Ence
>>>Graduate Student
>>>Eccles Institute of Human Genetics
>>>University of Utah
>>>15 North 2030 East, Room 2100
>>>Salt Lake City, UT 84112-5330
>>>________________________________________
>>>From: Borhan, Hossein [Hossein.Borhan at AGR.GC.CA]
>>>Sent: Tuesday, February 11, 2014 3:51 PM
>>>To: Daniel Ence
>>>Subject: ERROR: Failed while processing the chunk divide!!
>>>
>>>Dear Daniel
>>>
>>>I re-started maker and it is still running. But in error our file that
>>>has
>>>been generated so far it seems that smaller conitgs are affected. There
>>>are contigs of 2-4 kb with this error but also I noticed a contig of
>>>30kb
>>>length having this error
>>>
>>>I was wondering if I need to change the setting in the maker_opt file
>>>
>>>#-----MAKER Behavior Options
>>>max_dna_len=100000 #length for dividing up contigs into chunks
>>>(increases/decreases  memory usage)
>>>min_contig=1 #skip genome contigs below this length (under 10kb are
>>>often
>>>useless)
>>>
>>>
>>>If I understand correctly max_dna_len   divide conitgs  of over 100kb to
>>>smaller chucks. However it is not clear to me that for the min_contig
>>>option if the default contig length is 10kb or less, then why I have
>>>error
>>>message for 30kb long contigs. Should I change this to 0
>>>
>>>Here is an example of the error message for one of the contigs
>>>
>>>
>>>#--------- command -------------#
>>>Widget::exonerate::est2genome:
>>>/usr/local/exonerate-2.2.0-x86_64/bin/exonerate  -q
>>>/raid01/projects/Plasmodiophora/brassicae/PT3/version2/Maker-config/P.br
>>>a
>>>s
>>>s
>>>icae.PT3.v1.genome.maker.output/P.brassicae.PT3.v1.genome_datastore/35
>>>/17/PbPT3Sc00001//theVoid.PbPT3Sc00001/comp14545_c0_seq1.fasta
>>>-t
>>>/raid01/projects/Plasmodiophora/brassicae/PT3/version2/Maker-config/P.br
>>>a
>>>s
>>>s
>>>icae.PT3.v1.genome.maker.output/P.brassicae.PT3.v1.genom
>>>e_datastore/35/17/PbPT3Sc00001//theVoid.PbPT3Sc00001/PbPT3Sc00001.235-11
>>>3
>>>6
>>>.
>>>fasta
>>>-Q dna -T dna --model est2genome
>>>--minintron 20 --showcigar --percent 20 >
>>>/raid01/projects/Plasmodiophora/brassica
>>>e/PT3/version2/Maker-config/P.brassicae.PT3.v1.genome.maker.output/P.bra
>>>s
>>>s
>>>i
>>>cae.PT3.v1.genome_datastore/35/17/PbPT3Sc00001//theVoid.PbPT3Sc00001/PbP
>>>T
>>>3
>>>S
>>>c00001.235-1136.comp14545_c0_seq1.est_exonerate
>>>#-------------------------------#
>>>cleaning blastn...
>>>cleaning tblastx...
>>>cleaning blastx...
>>>ERROR: Failed on
>>>PbPT3Sc00001_S_0.8_1-mRNA-1
>>>Check your input GFF3 file for errors!
>>>(from GFFDB)
>>>
>>>FATAL ERROR
>>>ERROR: Failed while processing the chunk
>>>divide!!
>>>
>>>ERROR: Chunk failed at level 17
>>>!!
>>>FAILED CONTIG:PbPT3Sc00001
>>>
>>>
>>>
>>>
>>>--Next Contig--
>>>
>>>
>>>
>>>
>>>
>>>
>>>Regards
>>>
>>>
>>>HB
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>On 14-02-11 12:37 PM, "Daniel Ence" <dence at genetics.utah.edu> wrote:
>>>
>>>>Hossein,
>>>>
>>>>Ok. So since this error came up on a local install, I'm going to need
>>>>some more information to understand what went wrong. Is it the same
>>>>contig that always causes this error? If it is, then is the the only
>>>>error or warning that MAKER encounters while running on this contig?
>>>>Or,
>>>>if multiple contigs fail, then is it always the same error?
>>>>
>>>>If you can narrow it down to the smallest possible dataset that
>>>>consistently gives the same error, then we canb egin to understand
>>>>what's
>>>>wrong.
>>>>
>>>>Thanks,
>>>>Daniel
>>>>
>>>>
>>>>Daniel Ence
>>>>Graduate Student
>>>>Eccles Institute of Human Genetics
>>>>University of Utah
>>>>15 North 2030 East, Room 2100
>>>>Salt Lake City, UT 84112-5330
>>>>________________________________________
>>>>From: Borhan, Hossein [Hossein.Borhan at AGR.GC.CA]
>>>>Sent: Tuesday, February 11, 2014 11:20 AM
>>>>To: Daniel Ence
>>>>Subject: Re: [maker-devel] Falied to create new account
>>>>
>>>>Hi Daniel
>>>>
>>>>I running it through the local server at my work
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>M. Hossein Borhan, Ph.D.
>>>>Research Scientist/ Chercheur Scientifique
>>>>Saskatoon Research Centre/Centre de Recherches de Saskatoon
>>>>Agriculture and Agri-Food Canada/Agriculture et Agroalimentaire Canada
>>>>107 Science Place, Saskatoon, SK.,S7N 0X2
>>>>Telephone/Téléphone: (306) 385-9441
>>>>Facsimile/Télécopieur: (306) 385-9482
>>>>Hossein.borhan at agr.gc.ca
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>On 14-02-11 12:16 PM, "Daniel Ence" <dence at genetics.utah.edu> wrote:
>>>>
>>>>>Hi Hossein,
>>>>>
>>>>>Did you encounter this error while you were running MAKER on your
>>>>>local
>>>>>machine or through the MAKER web annotation service?
>>>>>
>>>>>Thanks,
>>>>>Daniel
>>>>>
>>>>>
>>>>>Daniel Ence
>>>>>Graduate Student
>>>>>Eccles Institute of Human Genetics
>>>>>University of Utah
>>>>>15 North 2030 East, Room 2100
>>>>>Salt Lake City, UT 84112-5330
>>>>>________________________________________
>>>>>From: Carson Holt [carsonhh at gmail.com]
>>>>>Sent: Tuesday, February 11, 2014 10:18 AM
>>>>>To: Daniel Ence
>>>>>Cc: Mark Yandell
>>>>>Subject: FW: [maker-devel] Falied to create new account
>>>>>
>>>>>Hey Daniel could you download his dataset, and see if you can
>>>>>replicate
>>>>>the error.  Also check if this was an MWAS job or a local maker run
>>>>>(his
>>>>>dataset will already be there for MWAS, you just need the job ID).
>>>>>
>>>>>Thanks,
>>>>>Carson
>>>>>
>>>>>On 2/11/14, 10:16 AM, "Borhan, Hossein" <Hossein.Borhan at AGR.GC.CA>
>>>>>wrote:
>>>>>
>>>>>>Hi Carson
>>>>>>
>>>>>>
>>>>>>I encountered this error while running maker
>>>>>>
>>>>>>FATAL ERROR
>>>>>>ERROR: Failed while processing the chunk divide!!
>>>>>>
>>>>>>ERROR: Chunk failed at level 17
>>>>>>!!
>>>>>>FAILED CONTIG:PbPT3Sc00006
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>HB
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>>
>>_______________________________________________
>>maker-devel mailing list
>>maker-devel at box290.bluehost.com
>>http://box290.bluehost.com/mailman/listinfo/maker-devel_yandell-lab.org
>