1.5.7 test failure in nbest-optimize-bleu
Ken Basye
kbasye1 at jhu.edu
Wed Oct 29 08:09:22 PDT 2008
Hi,
I didn't see anything about this in the mailing-list archive. I just
installed 1.5.7 and ran the
tests. I saw one failure, in nbest-optimize-bleu. I looked at the
code briefly; the output is coming from nbest-optimize.cc:1179, but
that's about as far as I got. I built on Mac OS 10.4.11 using
this compiler version:
~/work/srilm--$ c++ --version
i686-apple-darwin8-g++-4.0.1 (GCC) 4.0.1 (Apple Computer, Inc. build 5370)
I can try another system if that will help, or let me know if anyone
wants more information.
Thanks,
Ken Basye
Here are the differences in the output (note that diff got a bit
confused in the first block; all three blocks are really showing the
same thing, with the reference lambdas going from 0 to 6 but the output
lambdas going from 1 to 7 - in the first block both sides had the same
line for lambda_4)
Only the indices are off; the values are all identical.
~/work/srilm/test/output--$ diff nbest-optimize-bleu.unknown.stderr
../reference/nbest-optimize-bleu.stderr
87,89c87,90
< lambda_1 0
< lambda_2 1
< lambda_3 0
---
> lambda_0 0
> lambda_1 1
> lambda_2 0
> lambda_3 0.2
91,93c92,93
< lambda_5 0.2
< lambda_6 0.7
< lambda_7 0.2
---
> lambda_5 0.7
> lambda_6 0.2
113,119c113,119
< lambda_1 -0.462891
< lambda_2 1.16211
< lambda_3 0.162109
< lambda_4 0.362109
< lambda_5 0.0703125
< lambda_6 0.362109
< lambda_7 0.319922
---
> lambda_0 -0.462891
> lambda_1 1.16211
> lambda_2 0.162109
> lambda_3 0.362109
> lambda_4 0.0703125
> lambda_5 0.362109
> lambda_6 0.319922
157,163c157,163
< lambda_1 -0.098284
< lambda_2 1.1704
< lambda_3 0.149144
< lambda_4 0.41325
< lambda_5 0.0652597
< lambda_6 0.41325
< lambda_7 0.354837
---
> lambda_0 -0.098284
> lambda_1 1.1704
> lambda_2 0.149144
> lambda_3 0.41325
> lambda_4 0.0652597
> lambda_5 0.41325
> lambda_6 0.354837
More information about the SRILM-User
mailing list