Memory problems

Nuno Souto souto at weenie.inesc.pt
Tue May 22 05:26:20 PDT 2001


Hi!
I'm trying to use SRLIM toolkit to create a language model. As i'm using
large amounts of text and i'm creating 4-grams language models the
counts files (created using make-batch-counts/merge-batch-counts
scripts)  gets to big - 1.3 Gb gziped. When i try to create the language
model using ngram-count  or make-big-lm the programs abort because there
isn't enough memory (500 Mb). How can i solve this problem.
Regards

Souto




More information about the SRILM-User mailing list