[SRILM User List] class perplexity -debug 2 output

Fabian - fabian_in_hongkong at hotmail.com
Tue May 24 13:26:44 PDT 2011


Hello,
I used the "-debug 2" during the perplexity computation of a word language model and a class language model, and don't understand the output.
I start with:ngram -lm lm.3g -order 3 -mix-lm lm300 -lambda 0.518735 -bayes 0 -classes classes300 -ppl dev.text -debug 2lm.3g: word lmlm300: class lm
and get:她 还在 读 她的 ...        p( 她 | <s> )   = [OOV][2gram][2gram][OOV] 0.00193608 [ -2.71308 ]        p( 还在 | 她 ...)       = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 7.96669e-05 [ -4.09872 ]        p( 读 | 还在 ...)       = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 0.00486257 [ -2.31313 ]        p( 她的 | 读 ...)       = [OOV][1gram][OOV][2gram][1gram][OOV][1gram][OOV] 0.000237892 [ -3.62362 ]        p( 对 | 她的 ...)       = [OOV][1gram][OOV][2gram][2gram][OOV][1gram][OOV] 0.00242938 [ -2.6145 ]...are the words covered by 1-grams/2-grams or OOV?
Thank you!!!
-Fabian 		 	   		  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20110524/0f291cc6/attachment.html>


More information about the SRILM-User mailing list