Log-linear interpolation

Andreas Stolcke stolcke at speech.sri.com
Mon Jul 18 07:28:40 PDT 2005

In message <32809. at mail.crb.ucp.pt>you wrote:
> Hi!
> Does anyone know a program or toolkit allowing to do log-linear
> interpolation of different language models? since SRILM only permit to do
> linear interpolation.
> Thanks for your help,
> Ciro Martins


sorry for the late response ;-)

There is now, in the current development version of SRILM, an
implementation of log-linear interpolation.    The class name is
LoglinearMix, and the ngram -loglinear-mix option triggers its use.
Note that log-linear interpolation is much slower to evaluate than
linear interpolation, due to the need to normalize the combined LM.
This is done somewhat efficiently in SRILM by caching the normalizers
for previously seen contexts.

You might also want to try using log-linear combination of LM scores
without normalization.  This can be done in the nbest or lattice
rescoring framework implemented by the toolkit, simply by computing
scores from multiple LMs.

The latest version of the toolkit can by downloaded in the usual way
by choosing the "1.4.5 (Beta)" version in the web form.


More information about the SRILM-User mailing list