[SRILM User List] How do you calculate perplexity given a test sentence?
Burkay Gur
burkay at mit.edu
Thu May 17 10:59:29 PDT 2012
Hi,
I was wondering how the perplexity is calculated given different test
sentences to a single language model.
1) For example, does SRI calculate 2^-H(p) no matter what the input
sentence is ?
2) Or does it calculate the perplexity based on the cross-entropy
between the model and the input sentence? ie 2^-H(p,q) where p is the
language model and q is (not sure what it would be)
Best,
Burkay
More information about the SRILM-User
mailing list