1.5.7 test failure in nbest-optimize-bleu
Andreas Stolcke
stolcke at speech.sri.com
Fri Nov 7 10:59:25 PST 2008
It cannot replicate this bug since I don't have the kind of
system you use. I find it hard to believe that the code would
produce output that is so different from what it is on all other systems
I've seen. I suggest trying a more recent version of the compiler
(gcc 4.3.2 is the latest!).
--Andreas
In message <49087CA2.3030504 at jhu.edu>you wrote:
> Hi,
> I didn't see anything about this in the mailing-list archive. I just
> installed 1.5.7 and ran the
> tests. I saw one failure, in nbest-optimize-bleu. I looked at the
> code briefly; the output is coming from nbest-optimize.cc:1179, but
> that's about as far as I got. I built on Mac OS 10.4.11 using
> this compiler version:
>
> ~/work/srilm--$ c++ --version
> i686-apple-darwin8-g++-4.0.1 (GCC) 4.0.1 (Apple Computer, Inc. build 5370)
>
> I can try another system if that will help, or let me know if anyone
> wants more information.
> Thanks,
> Ken Basye
>
>
>
> Here are the differences in the output (note that diff got a bit
> confused in the first block; all three blocks are really showing the
> same thing, with the reference lambdas going from 0 to 6 but the output
> lambdas going from 1 to 7 - in the first block both sides had the same
> line for lambda_4)
> Only the indices are off; the values are all identical.
>
> ~/work/srilm/test/output--$ diff nbest-optimize-bleu.unknown.stderr
> ../reference/nbest-optimize-bleu.stderr
> 87,89c87,90
> < lambda_1 0
> < lambda_2 1
> < lambda_3 0
> ---
> > lambda_0 0
> > lambda_1 1
> > lambda_2 0
> > lambda_3 0.2
> 91,93c92,93
> < lambda_5 0.2
> < lambda_6 0.7
> < lambda_7 0.2
> ---
> > lambda_5 0.7
> > lambda_6 0.2
> 113,119c113,119
> < lambda_1 -0.462891
> < lambda_2 1.16211
> < lambda_3 0.162109
> < lambda_4 0.362109
> < lambda_5 0.0703125
> < lambda_6 0.362109
> < lambda_7 0.319922
> ---
> > lambda_0 -0.462891
> > lambda_1 1.16211
> > lambda_2 0.162109
> > lambda_3 0.362109
> > lambda_4 0.0703125
> > lambda_5 0.362109
> > lambda_6 0.319922
> 157,163c157,163
> < lambda_1 -0.098284
> < lambda_2 1.1704
> < lambda_3 0.149144
> < lambda_4 0.41325
> < lambda_5 0.0652597
> < lambda_6 0.41325
> < lambda_7 0.354837
> ---
> > lambda_0 -0.098284
> > lambda_1 1.1704
> > lambda_2 0.149144
> > lambda_3 0.41325
> > lambda_4 0.0652597
> > lambda_5 0.41325
> > lambda_6 0.354837
More information about the SRILM-User
mailing list