“2014-10-27”版本间的差异
来自cslt Wiki
（→LM development） |
（→Domain specific LM） |
||
| 第127行： | 第127行： | ||
====Domain specific LM==== | ====Domain specific LM==== | ||
| − | * am: .result: baiduzhidao- | + | * domain lm |
| − | * need to check the xiaomin-lm method and result. | + | :* am:1400h(2.0.b) .result: xiaomi-29.43%,baiduzhidao-43.46%,baiduHi-30.02%, test-set:8ksentence(16k=>8k) |
| + | :* need to check the xiaomin-lm method and result. | ||
* new dict. | * new dict. | ||
2014年10月27日 (一) 02:39的版本
Speech Processing
AM development
Contour
- NAN problem
- nan recurrence
------------------------------------------------------------ grid/atr. | Reproducible | add. ------------------------------------------------------------ grid-10 | yes | ------------------------------------------------------------ grid-12 | no | "nan" in different position ------------------------------------------------------------ grid-14 | yes | ------------------------------------------------------------
Sparse DNN
- Performance improvement found when pruned slightly
- Experiments show that
- Suggest to use TIMIT / AURORA 4 for training
RNN AM
- Initial test on WSJ , leads to out-memory.
- Using AURORA 4 short-sentence with a smaller number of targets.
Noise training
- First draft of the noisy training journal paper
- Paper Correction (Yinshi, Liuchao, Lin Yiye), be going.
Drop out & Rectification & convolutive network
- Drop out
- dataset:wsj, testset:eval92
std | dropout0.4 | dropout0.5 | dropout0.7 | dropout0.8
-------------------------------------------------------------
4.5 | 5.39 | 4.80 | 4.36 | -
- Test on noisy AURORA4 dataset
std | dropout0.4 | dropout0.5 | dropout0.7 | dropout0.8
-------------------------------------------------------------
6.05 | - | - | - | -
- Continue the droptout on normal trained XEnt NNET , eg wsj. (+)
- Draft the dropout-DNN weight distribution. (+)
- Rectification
- Still NAN error, need to debug. (+)
- MaxOut (+)
- Convolutive network
- Test more configurations
- Yiye will work on CNN
- Reading CNN tutorial
Denoising & Farfield ASR
- ICASSP paper submitted.
VAD
- Add more silence tag "#" in pure-silence utterance text(train).
- xEntropy model be training
- need to test baseline.
- Sum all sil-pdf as the silence posterior probability.
- Program done, to tune the threshold
Speech rate training
- Seems ROS model is superior to the normal one with faster speech
- Suggest to extract speech data of different ROS, construct a new test set(+)
- Suggest to use Tencent training data(+)
low resource language AM training
- Use Chinese NN as initial NN, change the last layer
- Various the used Chinese trained DNN layer numbers.
- feature_transform = 6000h_transform + 6000_N*hidden-layers
- Various the used Chinese trained DNN layer numbers.
nnet.init = random (4-N)*hidden-layers + output-layer | N / learn_rate | 0.008 | 0.001 | 0.0001 | | baseline | 17.00(14*2h) | | | | 4 | 17.75(9*0.6h) | 18.64 | | | 3 | 16.85 | | | | 2 | 16.69 | | | | 1 | 16.87 | | | | 0 | 16.88 | | |
- feature_transform = uyghur_transform + 6000_N*hidden-layers
nnet.init = random (4-N)*hidden-layers + output-layer Note: This is reproduced Yinshi's experiment | N / learn_rate | 0.008 | 0.001 | 0.0001 | | baseline | 17.00 | | | | 4 | 28.23 | 30.72 | 37.32 | | 3 | 22.40 | | | | 2 | 19.76 | | | | 1 | 17.41 | | | | 0 | | | |
- feature_transform = 6000_transform + 6000_N*hidden-layers
nnet.init = uyghur (4-N)*hidden-layers + output-layer | N / learn_rate | 0.008 | 0.001 | 0.0001 | | baseline | 17.00 | | | | 4 | 17.80 | 18.55 | 21.06 | | 3 | 16.89 | 17.64 | | | 2 | | | | | 1 | | | | | 0 | | | |
Scoring
- global scoring done.
- Pitch & rhythm done, need testing
- Harmonics program done, experiment to be done.
Confidence
- Reproduce the experiments on fisher dataset.
- Use the fisher DNN model to decode all-wsj dataset
Speaker ID
- Preparing GMM-based server.
Emotion detection
- Sinovoice is implementing the server
Text Processing
LM development
Domain specific LM
- domain lm
- am:1400h(2.0.b) .result: xiaomi-29.43%,baiduzhidao-43.46%,baiduHi-30.02%, test-set:8ksentence(16k=>8k)
- need to check the xiaomin-lm method and result.
- new dict.
- weibo-data : Tencent-segment and count. get 16k words to segment again.
- new toolkit:find method to update the new dict. can get new wordlist from sougou and get word information from baidu.
tag LM
- set new test
- 1k address from dianxin. prepare to test.
- insert the new unknown-address to test set.
- record test set 15-sentence/person on dianxin txt.
RNN LM
- rnn
- get baseline on nbest rescore of wer.
- lstm+rnn
- get baseline on nbest rescore of wer.
- more detail on LSTM
Word2Vector
W2V based doc classification
- Initial results variable Bayesian GMM obtained. Performance is not as good as the conventional GMM.
- Non-linear inter-language transform: English-Spanish-Czch: wv model training done, transform model on investigation
- SSA-based local linear mapping still on running.
- k-means classes change to 2.
- Knowledge vector started
- format the data
- yuanbin will continue this work with help of xingchao.
- Character to word conversion
- prepare the task: word similarity
- prepare the dict.
- Google word vector train
- some ideal will discuss on weekly report.
Translation
- v3.0 demo released
- still slow
- re-segment the word using new dictionary.will use the tencent-dic about 11w.
- check new data.
QA
- search method:
- add the vsm and BM25 to improve the search. and the strategy of selecting the answer.
- spell check
- get ngram tool and make a simple demo.
- get domain word list and pingyin tool from huilan.
- new inter will install SEMPRE
