[SRILM User List] all tests differ but only minimally

[Andreas Stolcke]

On 4/12/2012 1:42 AM, Julia Hancke wrote:
> Hi,
>
> I'm new to SRILM after installation I ran the tests. The stdout and 
> stderr differed for all files. I checked on a few files with the nix 
> diff command and found out, some numbers are off by small amounts 
> likie this:
>
> < 0 zeroprobs, logprob= -4.23739 ppl= 25.8501ppl1= 131.43
> > 0 zeroprobs, logprob= -4.23739 ppl= 25.8502 ppl1= 131.43
>
> Is this normal? What else could I do, or should I just live with it? 
> This is my machine: i686 athlon i386 GNU/Linux. Any help is apprechiated.
Yes, this is normal, and shouldn't cause the tests to fail.

The outputs of test runs are not compared using diff.  Instead, the 
script $SRILM/sbin/compare-outputs is used.
Try
     compare-outputs REFERENCE OUTPUT
and that should not complain about small numerical differences as what 
you show above.
If not, there is some kind of bug.

Andreas

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20120412/3b4d36e3/attachment.html>