[SRILM User List] About wbdiscount and meta-tag options

[Meng CHEN]

Hi, in make-big-lm command, it specifies -read-with-mincounts and -meta-tag by default. In the help page, it says "if -meta-tag is defined, these low-count N-grams will be converted to count-of-count N-grams, so that smoothing methods that need this information still work correctly". However, for wbdiscount, we don't need the count-of-count infomation to compute the discounting parameters. So, why does make-big-lm specify -meta-tag option for wbdiscount by default? Is that necessary? Can I remove it?(I tried that, and find the ngrams are the same in model, but the probability is different.)
Thanks!


Meng CHEN



发送自魅族MX
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20130613/10bba795/attachment.html>