parallel ngram-count

[Andreas Stolcke]

In message <E9F47D5E-8138-49AA-9A7A-1101C276347F at gmail.com>you wrote:
> I see one quick way to parallelize ngram-count on a N-core box:
> 
> -- split file list into N sublists
> -- launch N ngram-count instances, giving each its own sublist
> -- merge counts
> 
> Is there any better way?

That's what I would do.  Make sure you are not i/o bound when running
many ngram-count in parallel, and watch for memory usage.

Andreas