[SRILM User List] [External Sender] Renormalising probabilities to 1

[Van der Merwe, W, Mnr [20076223@sun.ac.za]]

Hi,

I am a student at Stellenbosch University currently using the SRILM toolkit for one of my projects. I would like to know if the toolkit is able to renormalize the probabilities, given an ARPA file, so that they sum to 1. I've read the documentation and am aware of the -renorm parameter option, however, I am not seeking to renormalize backoff weights, only the probabilities.

The reason I ask this is that I am writing an ARPA file myself, taking probabilities produced by a neural network. Because these probabilities are estimated by a neural net, they tend not to sum not 1 perfectly. I am hoping that SRILM can correct this. Otherwise, I will have to write a script to brute force it.

Werner

[https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcdn.sun.ac.za%2F100%2FProductionFooter.jpg&data=01%7C01%7Csrilm-user%40speech.sri.com%7Cee116d5a06254481184a08d728da72ff%7C40779d3379c44626b8bf140c4d5e9075%7C1&sdata=Eo0qwcSonmci3xzmsFrXEXOn2dTJrTi%2F2UJ75suIXLQ%3D&reserved=0]<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.sun.ac.za%2Fenglish%2Fabout-us%2Fstrategic-documents&data=01%7C01%7Csrilm-user%40speech.sri.com%7Cee116d5a06254481184a08d728da72ff%7C40779d3379c44626b8bf140c4d5e9075%7C1&sdata=yx%2Fn3v7YRO2k4pelcdOpsX1NEEMIFtOAsthqDeh%2Ftag%3D&reserved=0>

The integrity and confidentiality of this email are governed by these terms. Disclaimer<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.sun.ac.za%2Femaildisclaimer&data=01%7C01%7Csrilm-user%40speech.sri.com%7Cee116d5a06254481184a08d728da72ff%7C40779d3379c44626b8bf140c4d5e9075%7C1&sdata=bHKKa7itMnxlmIMsY2lv%2ByFdeGsKTqLTlD0%2FarnP%2BeM%3D&reserved=0>
Die integriteit en vertroulikheid van hierdie e-pos word deur die volgende bepalings bereël. Vrywaringsklousule<https://gcc02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.sun.ac.za%2Femaildisclaimer&data=01%7C01%7Csrilm-user%40speech.sri.com%7Cee116d5a06254481184a08d728da72ff%7C40779d3379c44626b8bf140c4d5e9075%7C1&sdata=bHKKa7itMnxlmIMsY2lv%2ByFdeGsKTqLTlD0%2FarnP%2BeM%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.speech.sri.com/pipermail/srilm-user/attachments/20190824/a4417244/attachment.html>