order of options to ngram-count

[ilya oparin]

Hi,

It looks like in your first "run forever" line you
forgot to put "-" right before "order" option, so
ngram-count just skips this invalid option and build
default trigrams instead of unigrams. In case you have
large data, that would take long.

--- Alexy Khrabrov <deliverable at gmail.com> wrote:

> My impression is that ngram-count is sensitive to
> the order of  
> options (1.5.4b from yesterday).
> 
> ngram-count -text - order 1 -write unigrams.count #
> takes up all  
> memory, runs forever
> 
> ngram-count -order 1 -text - write unigrams.count #
> finishes up  
> quickly in a fraction of memory
> 
> Does the former honor -order 1?  What's the rule
> here -- trailing - 
> write is honored anyways?  I now stick other flags,
> such as -tolower,  
> in front of -text - .
> 
> Cheers,
> Alexy
> 


best regards,
Ilya


      ___________________________________________________________
Yahoo! Answers - Got a question? Someone out there knows the answer. Try it
now.
http://uk.answers.yahoo.com/