format error in kncounts.gz

[Alexy Khrabrov]

Hmm -- I've run make-big-lm, and got a few small files, a .kndir, and  
that kncounts.gz -- which looks just like counts and is a few  
gigabytes, so I thought that's my model.  I've posted my command line  
earlier when figuring out exactly the way to get a Kneser-Ney  
model...  The kncounts.gz looks just like a counts file.

The counts I fed to make-big-lm with -read are the ones I got with  
make/merge-batch-counts -order 5 for 5-grams.  Should I have done  
anything extra before or after?

Cheers,
Alexy

On Jun 5, 2008, at 5:46 AM, ilya oparin wrote:

> That usually means you're loading something else than a LM in the  
> ARPA format. Have you visually checked your model.kncounts.gz?