Xiangyu Zeng 2016-04-25
来自cslt Wiki
Last week:
1.debug the code of natural gradient and made it converged, and the result of NG seems good.
model | clean | airport | babble | restaurant | street
adam-max-lr-0.008-c | 8.13 | 29.86 | 29.23 | 31.04 | 30.35
adam-max-lr-0.008-c-a | 7.46 | 12.19 | 16.47 | 18.34 | 21.44
adam-max-lr-0.008-c-a-b | 7.79 | 14.58 | 10.36 | 15.37 | 18.62
adam-max-lr-0.008-c-a-b-r | 7.33 | 12.20 | 11.27 | 9.77 | 14.93
adam-max-lr-0.008-c-a-b-r-s | 7.48 | 13.46 | 12.34 | 13.65 | 10.49
sgd-lr-0.008-c | 8.47 | 36.06 | 35.28 | 37.83 | 35.95
sgd-lr-0.008-c-a | 8.02 | 13.88 | 18.28 | 20.16 | 23.17
sgd-lr-0.008-c-a-b | 8.09 | 15.77 | 11.56 | 15.96 | 19.88
sgd-lr-0.008-c-a-b-r | 6.82 | 11.84 | 10.70 | 10.22 | 15.78
sgd-lr-0.008-c-a-b-r-s | 7.33 | 15.12 | 12.97 | 13.65 | 10.53
ng-lr-0.008-c | 7.58 | 34.22 | 33.23 | 35.26 | 34.73
ng-lr-0.008-c-a | 7.56 | 11.86 | 15.78 | 17.73 | 21.59
ng-lr-0.008-c-a-b | 7.29 | 14.01 | 9.98 | 14.09 | 18.07
ng-lr-0.008-c-a-b-r | 6.70 | 11.46 | 10.05 | 9.50 | 14.93
ng-lr-0.008-c-a-b-r-s | 6.91 | 14.09 | 12.38 | 13.33 | 9.88
Next week:
1.Add the experiments of NG into the technical report
