[SRILM User List] Fw: nbest-error option

[Md. Akmal Haidar]

Hi ,

Thanks.

I used NIST sclite  command:
./sclite -r refs -i wsj -h hyps -o dtl
but I got the same scoring result for the baseline 1-best hypothesis and updated 1-best hypothesis obtained by updated LM using rescore-decipher and rescore-reweight.

I tried with compute-sclite of SRILM with command:  compute-sclite -r refs -h hyps -i wsj -o dtl
but it shows line 247: sclite: command not found.

Can anyone tell me where is the problem?

Thanks
Best Regards 

Akmal




________________________________
 From: Andreas Stolcke <stolcke at icsi.berkeley.edu>
To: Md. Akmal Haidar <akmalcuet00 at yahoo.com> 
Cc: Anand Venkataraman <venkataraman.anand at gmail.com>; "srilm-user at speech.sri.com" <srilm-user at speech.sri.com> 
Sent: Sunday, November 4, 2012 7:02:38 PM
Subject: Re: [SRILM User List] Fw: nbest-error option
 

On 11/4/2012 12:52 PM, Md. Akmal Haidar wrote:

Thanks Anand,
>It works now.
>
>But I found the same WER for the original n-best list and the rescored nbest list.
>
>
>For rescoring, I use the following command:
>rescore-decipher nbestfilelist new_rescored_nbestlist_dir -lm updated_lm
nbest-error computes the "N-best error rate", meaning the best
    possible error rate that can be achieved by picking a hypothesis
    from anywhere among the N best.   This is sometimes called the
    "oracle" error.  It doesn't changed as a result of rescoring.

What you probably want is the error rate of the highest-scoring
    hypothesis.  For this, you first extract the highest-scoring hyps
    using the "rescore-reweight" command (see nbest-scripts(1) man
    page), then you using your favorite WER scoring program.   If you
    have NIST sclite installed, you could use the compute-sclite
    wrapper, which takes care of format differences.

Andreas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.speech.sri.com/pipermail/srilm-user/attachments/20121105/e9060479/attachment.html>