[SRILM User List] Calculate perplexity
Laatar Rim
rimlaatar at yahoo.fr
Thu Mar 27 07:38:10 PDT 2014
Dear Andreas ,
to calculate perplexity i do this :
lenovo at ubuntu:~/Documents/srilm$ ngram -lm class_based_model '/home/lenovo/Documents/srilm/ML_N_Class/IN_SRILM' -ppl '/home/lenovo/Documents/srilm/ML_N_Class/titi.txt'
titi.txt is my training data
1- i should calculate perplexity elso in my test data ?
2- how can i interpretate this result :
file /home/lenovo/Documents/srilm/ML_N_Class/titi.txt: 18657 sentences, 66817 words, 5285 OOVs
0 zeroprobs, logprob= -259950 ppl= 1744.69 ppl1= 16773.8
what is the difference between ppl and ppl1 ??
----
Cordialement
Rim LAATAR
Ingénieur Informatique, de l'École Nationale d’Ingénieurs de Sfax(ENIS)
Étudiante en mastère de recherche, Système d'Information & Nouvelles Technologies à laFSEGS --Option TALN
Site web:Rim LAATAR BEN SAID
Tel: (+216) 99 64 74 98
----
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20140327/76ab3c50/attachment.html>
More information about the SRILM-User
mailing list