[SRILM User List] all tests differ but only minimally

[Julia Hancke]

Hi Andreas,

thank you very much! The problem was this: I had run the 

     make test
which gave me a DIFFER for every test. Then, I used the command line diff to take a look at things. 


After you explained which script should be used, I took a look at it and noticed that it uses gawk and trying to run it, found out that I had neglected to install gawk. Running the test again after installing gawk gives me IDENTICALS everywhere :)

Regards,
Julia



________________________________
 From: Andreas Stolcke <stolcke at icsi.berkeley.edu>
To: Julia Hancke <julia_hancke at yahoo.com> 
Cc: "srilm-user at speech.sri.com" <srilm-user at speech.sri.com> 
Sent: Thursday, April 12, 2012 8:11 PM
Subject: Re: [SRILM User List] all tests differ but only minimally
 

On 4/12/2012 1:42 AM, Julia Hancke wrote: 
Hi,
>
>
>I'm new to SRILM after installation I ran the tests. The stdout and stderr differed for all files. I checked on a few files with the nix diff command and found out, some numbers are off by small amounts likie this:
>
>
>< 0 zeroprobs, logprob= -4.23739 ppl= 25.8501ppl1= 131.43
>> 0 zeroprobs, logprob= -4.23739 ppl= 25.8502 ppl1= 131.43
>
>
>Is this normal? What else could I do, or should I just live with it? This is my machine: i686 athlon i386 GNU/Linux. Any help is apprechiated.
Yes, this is normal, and shouldn't cause the tests to fail.

The outputs of test runs are not compared using diff.  Instead, the
    script $SRILM/sbin/compare-outputs is used.
Try 
    compare-outputs REFERENCE OUTPUT
and that should not complain about small numerical differences as
    what you show above.
If not, there is some kind of bug.

Andreas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20120412/263609e8/attachment.html>