can a cache LM be loaded in disambig?

Andreas Stolcke stolcke at speech.sri.com
Sat Apr 10 22:50:15 PDT 2004


The linking problem can be solved by removing the instantiation
of LHash<unsigned,double> in CacheLM.cc.  

However, it probably won't work as intended.   CacheLM is not Markovian
(is does not use a finite history).  This will cause the DP algorithm in
disambig to degenerate into keeping all histories as distinct states,
which is not feasible except for very short sentences.

--Andreas

In message <20040411053012.75383.qmail at web41601.mail.yahoo.com>you wrote:
> --0-1533885807-1081661412=:75154
> Content-Type: text/plain; charset=us-ascii
> 
> I'm trying to load a cache LM in disambig tool by adding several lines of cod
> e according to ngram.cc.  Everything is fine except the linking, where I had 
> a problem:
>  
> /usr3/Test/sri-1.4/lm/src/CacheLM.cc:50: multiple definition of `LHash<unsign
> ed, double>::removedData'
> ../obj/i686/liboolm.a(VocabMap.o):/usr3/Test/sri-1.4/lm/src/VocabMap.cc:39: f
> irst defined here
> collect2: ld returned 1 exit status
>  
> Does that mean duplicate definations of "removeData" originally from LHash.cc
> ?  How to fix it? Or is there an way to load a cache model in disambig?
>  
>  
>  
> 
> 
> ---------------------------------
> Do you Yahoo!?
> Yahoo! Tax Center - File online by April 15th
> --0-1533885807-1081661412=:75154
> Content-Type: text/html; charset=us-ascii
> 
> <DIV>I'm trying to load a cache LM in disambig tool by&nbsp;adding&nbsp;sever
> al lines of&nbsp;code according to ngram.cc.&nbsp;&nbsp;Everything&nbsp;is fi
> ne except&nbsp;the linking, where I had a problem:</DIV>
> <DIV>&nbsp;</DIV>
> <DIV>/usr3/Test/sri-1.4/lm/src/CacheLM.cc:50: multiple definition of `LHash&l
> t;unsigned, double&gt;::removedData'</DIV>
> <DIV>../obj/i686/liboolm.a(VocabMap.o):/usr3/Test/sri-1.4/lm/src/VocabMap.cc:
> 39: first defined here</DIV>
> <DIV>collect2: ld returned 1 exit status</DIV>
> <DIV>&nbsp;</DIV>
> <DIV>Does that mean duplicate definations of "removeData" originally from LHa
> sh.cc?&nbsp; How to fix it? Or is there an way to load a cache model in disam
> big?</DIV>
> <DIV>&nbsp;</DIV>
> <DIV>&nbsp;</DIV>
> <DIV>&nbsp;</DIV><p><hr size=1><font face=arial size=-1>Do you Yahoo!?<br>
> Yahoo! Tax Center - <a href="http://taxes.yahoo.com/filing.html">File online 
> by April 15th</a>
> --0-1533885807-1081661412=:75154--




More information about the SRILM-User mailing list