1.5.7 test failure in nbest-optimize-bleu

Ken Basye kbasye1 at jhu.edu
Wed Oct 29 08:09:22 PDT 2008


Hi,
  I didn't see anything about this in the mailing-list archive.  I just 
installed 1.5.7 and ran the
tests.  I saw one failure, in nbest-optimize-bleu.   I looked at the 
code briefly; the output is coming from nbest-optimize.cc:1179, but 
that's about as far as I got.  I built on Mac OS 10.4.11 using
this compiler version:

~/work/srilm--$ c++ --version
i686-apple-darwin8-g++-4.0.1 (GCC) 4.0.1 (Apple Computer, Inc. build 5370)

I can try another system if that will help, or let me know if anyone 
wants more information.
    Thanks,
        Ken Basye



Here are the differences in the output (note that diff got a bit 
confused in the first block; all three blocks are really showing the 
same thing, with the reference lambdas going from 0 to 6 but the output 
lambdas going from 1 to 7 - in the first block both sides had the same 
line for lambda_4)
Only the indices are off; the values are all identical.

~/work/srilm/test/output--$ diff nbest-optimize-bleu.unknown.stderr 
../reference/nbest-optimize-bleu.stderr
87,89c87,90
< lambda_1 0
< lambda_2 1
< lambda_3 0
---
 > lambda_0 0
 > lambda_1 1
 > lambda_2 0
 > lambda_3 0.2
91,93c92,93
< lambda_5 0.2
< lambda_6 0.7
< lambda_7 0.2
---
 > lambda_5 0.7
 > lambda_6 0.2
113,119c113,119
< lambda_1 -0.462891
< lambda_2 1.16211
< lambda_3 0.162109
< lambda_4 0.362109
< lambda_5 0.0703125
< lambda_6 0.362109
< lambda_7 0.319922
---
 > lambda_0 -0.462891
 > lambda_1 1.16211
 > lambda_2 0.162109
 > lambda_3 0.362109
 > lambda_4 0.0703125
 > lambda_5 0.362109
 > lambda_6 0.319922
157,163c157,163
< lambda_1 -0.098284
< lambda_2 1.1704
< lambda_3 0.149144
< lambda_4 0.41325
< lambda_5 0.0652597
< lambda_6 0.41325
< lambda_7 0.354837
---
 > lambda_0 -0.098284
 > lambda_1 1.1704
 > lambda_2 0.149144
 > lambda_3 0.41325
 > lambda_4 0.0652597
 > lambda_5 0.41325
 > lambda_6 0.354837



More information about the SRILM-User mailing list