[SRILM User List] Calculate perplexity

Laatar Rim rimlaatar at yahoo.fr
Thu Mar 27 07:38:10 PDT 2014


Dear Andreas , 

to calculate perplexity i do this : 

lenovo at ubuntu:~/Documents/srilm$ ngram -lm class_based_model '/home/lenovo/Documents/srilm/ML_N_Class/IN_SRILM' -ppl '/home/lenovo/Documents/srilm/ML_N_Class/titi.txt'  

titi.txt is my training data 

1- i should calculate perplexity elso in my test data ? 

2- how can i interpretate this result : 
file /home/lenovo/Documents/srilm/ML_N_Class/titi.txt: 18657 sentences, 66817 words, 5285 OOVs
0 zeroprobs, logprob= -259950 ppl= 1744.69 ppl1= 16773.8
 what is the difference between ppl and ppl1 ??

----
Cordialement


Rim LAATAR 
Ingénieur  Informatique, de l'École Nationale d’Ingénieurs de Sfax(ENIS)
Étudiante en mastère de recherche, Système d'Information & Nouvelles Technologies à laFSEGS --Option TALN
Site web:Rim LAATAR BEN SAID
Tel: (+216) 99 64 74 98 
----
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20140327/76ab3c50/attachment.html>


More information about the SRILM-User mailing list