7z as a much better archiver than gz/bz2
deliverable at gmail.com
Sat Nov 10 13:10:46 PST 2007
(Kamadev -- I think you misunderstood my message.) I was wondering
whether folks manage use 7z to speed up their access to their LMs.
By default, ngram would read the gzipped files as well as the
originals. Yet gzipped versions are still much larger than the
7z'ipped. 7z is an Open Source package with which I have no
By looking over 7z options, I found that one can extract a file to
stdout with it too, e.g.
7z e archive.7z -so
It would be possible to do that for a huge LM and feed that to it by
ngram -lm -
-- yet the problem is, I use
ngram -ppl -
already to serve perplexities.
Would appreciate other folks' experiences with speeding up loading of
huge LM. Same could be applied to bz2 as well, and any other
archiver better than gz.
On Nov 10, 2007, at 11:59 PM, Kamadev Bhanuprasad wrote:
More information about the SRILM-User