“DataBase”版本间的差异
来自cslt Wiki
| 第3行： | 第3行： | ||
! name !! size !! dir !! description | ! name !! size !! dir !! description | ||
|- | |- | ||
| − | |SogouQ.full.3gram.gz | + | |SogouQ.full.train.3gram.gz || 132M || /work/lxs/nlphome/lm/SogouQ-500M || trainData=SougouQ(800M);dict=11w-tecent |
|- | |- | ||
| − | + | |SogouT-11w-merge2-1.3gram.gz || 4.1G ||/work/lxs/nlphome/lm/SogouT-140G || trainData=SougouT(140G);dict=11w-tencent | |
| − | + | ||
| − | |SogouT-11w-merge2-1.3gram.gz || 4.1G ||/work/lxs/nlphome/lm/SogouT-140G || | + | |
|- | |- | ||
|SogouT-11w-merge2-2.3gram.gz || 3.9G || /work/lxs/nlphome/lm/SogouT-140G || | |SogouT-11w-merge2-2.3gram.gz || 3.9G || /work/lxs/nlphome/lm/SogouT-140G || | ||
| 第21行： | 第19行： | ||
|mix-corp1_0.5-corp2_0.5.3gram.gz||1.4G||/work/lxs/nlphome/lm/TencentQ/qa15w-singer-song||use qa15w-singer-song.wordlist | |mix-corp1_0.5-corp2_0.5.3gram.gz||1.4G||/work/lxs/nlphome/lm/TencentQ/qa15w-singer-song||use qa15w-singer-song.wordlist | ||
|- | |- | ||
| − | |11w_merge6_kn.3gram.gz||4.3G||/work/lxs/nlphome/lm/TencentQA-100G|| | + | |11w_merge6_kn.3gram.gz||4.3G||/work/lxs/nlphome/lm/TencentQA-100G|| trainData=qa(100G),dict=11w-tencent |
|- | |- | ||
| − | |8w8_new_merge6_kn.3gram0.gz||4.5G||/work/lxs/nlphome/lm/TencentQA-100G|| | + | |8w8_new_merge6_kn.3gram0.gz||4.5G||/work/lxs/nlphome/lm/TencentQA-100G||trainData=qa(100G),dict=8w8-tencent |
|- | |- | ||
|Hunhe_zhongzi_and_add_and_PPL_5yuan_3e9.lm.utf8.1e-5.3gram.gz||1.4M||/work/lxs/nlphome/lm/jietong|| | |Hunhe_zhongzi_and_add_and_PPL_5yuan_3e9.lm.utf8.1e-5.3gram.gz||1.4M||/work/lxs/nlphome/lm/jietong|| | ||
2014年2月19日 (三) 07:29的版本
lm
| name | size | dir | description |
|---|---|---|---|
| SogouQ.full.train.3gram.gz | 132M | /work/lxs/nlphome/lm/SogouQ-500M | trainData=SougouQ(800M);dict=11w-tecent |
| SogouT-11w-merge2-1.3gram.gz | 4.1G | /work/lxs/nlphome/lm/SogouT-140G | trainData=SougouT(140G);dict=11w-tencent |
| SogouT-11w-merge2-2.3gram.gz | 3.9G | /work/lxs/nlphome/lm/SogouT-140G | |
| 8w8.3gram.tencent.gz | 452M | /work/lxs/nlphome/lm/Tencent | |
| musicQuery-ltc.3gram.gz | 28M | /work/lxs/nlphome/lm/TencentQ/musicQuery | use qa15w-singer-songs.wordlist |
| TencentQ.3gram.gz | 1.4G | /work/lxs/nlphome/lm/TencentQ/qa15w | use qa15w.lexicion |
| mix-corp1-corp2.3gram.gz | 1.3G | /work/lxs/nlphome/lm/TencentQ/qa15w-nosinger-song | use qa15w-nosinger-song.wordlist |
| mix-corp1_0.5-corp2_0.5.3gram.gz | 1.4G | /work/lxs/nlphome/lm/TencentQ/qa15w-singer-song | use qa15w-singer-song.wordlist |
| 11w_merge6_kn.3gram.gz | 4.3G | /work/lxs/nlphome/lm/TencentQA-100G | trainData=qa(100G),dict=11w-tencent |
| 8w8_new_merge6_kn.3gram0.gz | 4.5G | /work/lxs/nlphome/lm/TencentQA-100G | trainData=qa(100G),dict=8w8-tencent |
| Hunhe_zhongzi_and_add_and_PPL_5yuan_3e9.lm.utf8.1e-5.3gram.gz | 1.4M | /work/lxs/nlphome/lm/jietong | |
| Hunhe_zhongzi_and_add_and_PPL_5yuan_3e9.lm.utf8.1e-9.5gram.gz | 389M | /work/lxs/nlphome/lm/jietong |
lexicion wordlist
| name | size | dir | description |
|---|---|---|---|
| singer.lexicion | 74k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| singer.low.lexicion | 74k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| singer.pinyin | 44k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| song.lexicion | 255k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| song.low.lexicion | 255k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| song.pinyin | 167k | /work/lxs/nlphome/dict/lex-wordlist/music/lr | |
| qa15w-ch-sinovoice.lexicion | 2.9M | /work/lxs/nlphome/dict/lex-wordlist/qa-check | |
| qa15w-ch.pinyin | 1.7M | /work/lxs/nlphome/dict/lex-wordlist/qa-check | |
| qa15w.lexicion | 4.9M | /work/lxs/nlphome/dict/lex-wordlist/qa-check | |
| 11w.lexicion | 3.8M | /work/lxs/nlphome/dict/lex-wordlist/tencent | |
| 8w8.lexicion | 2.5M | /work/lxs/nlphome/dict/lex-wordlist/tencent |
nolexicion wordlist
| name | size | dir | description |
|---|---|---|---|
| singer.wordlist | 19k | /work/lxs/nlphome/dict/nolex-wordlist/music/lr | |
| song.wordlist | 68k | /work/lxs/nlphome/dict/nolex-wordlist/music/lr | |
| album.txt | 227k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| area.txt | 32bit | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| chart.txt | 336bit | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| drama.txt | 7.2k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| language.txt | 343bit | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| singer.txt | 42k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| stopwords.txt | 6.1k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| song.txt | 408k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| style.txt | 6.6k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| type.txt | 18bit | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | |
| entity.txt | 590k | /work/lxs/nlphome/dict/nolex-wordlist/music/ltc | merge album area chart drama language singer song stopwords style type |
| qa15w.wordlist | 1.2M | /work/lxs/nlphome/dict/nolex-wordlist/qa-check | |
| 11w.wordlist | 888k | /work/lxs/nlphome/dict/nolex-wordlist/tencent | |
| 8w8.wordlist | 666k | /work/lxs/nlphome/dict/nolex-wordlist/tencent | |
| scws20w-utf8.wordlist | 6.5M | /work/lxs/nlphome/dict/nolex-wordlist |
