“Unsuperivsed Mixup”版本间的差异

来自cslt Wiki
跳转至: 导航搜索
(以“* MNIST 0-7 binary cross entropy * Test with data mixture * Equal Accuracy as metric ===baseline=== Epoch=46: crput=0 test-loss=0.00 test-acc=1.00 Epoch=46: crput=...”为内容创建页面)
 
 
第5行: 第5行:
 
===baseline===
 
===baseline===
  
Epoch=46: crput=0 test-loss=0.00 test-acc=1.00
+
* Epoch=46: crput=0 test-loss=0.00 test-acc=1.00
Epoch=46: crput=1 test-loss=0.65 test-acc=0.87
+
* Epoch=46: crput=1 test-loss=0.65 test-acc=0.87
Epoch=46: crput=2 test-loss=1.61 test-acc=0.76
+
* Epoch=46: crput=2 test-loss=1.61 test-acc=0.76
Epoch=46: crput=3 test-loss=2.56 test-acc=0.66
+
* Epoch=46: crput=3 test-loss=2.56 test-acc=0.66
  
 
===data aug===
 
===data aug===
  
Epoch=46: crput=0 test-loss=0.03 test-acc=0.99
+
* Epoch=46: crput=0 test-loss=0.03 test-acc=0.99
Epoch=46: crput=1 test-loss=0.07 test-acc=0.98
+
* Epoch=46: crput=1 test-loss=0.07 test-acc=0.98
Epoch=46: crput=2 test-loss=0.23 test-acc=0.92
+
* Epoch=46: crput=2 test-loss=0.23 test-acc=0.92
Epoch=46: crput=3 test-loss=0.53 test-acc=0.83
+
* Epoch=46: crput=3 test-loss=0.53 test-acc=0.83
  
  
 
===mix-up===
 
===mix-up===
  
Epoch=46: crput=0 test-loss=0.01 test-acc=1.00
+
* Epoch=46: crput=0 test-loss=0.01 test-acc=1.00
Epoch=46: crput=1 test-loss=0.20 test-acc=0.97
+
* Epoch=46: crput=1 test-loss=0.20 test-acc=0.97
Epoch=46: crput=2 test-loss=0.58 test-acc=0.91
+
* Epoch=46: crput=2 test-loss=0.58 test-acc=0.91
Epoch=46: crput=3 test-loss=0.85 test-acc=0.86
+
* Epoch=46: crput=3 test-loss=0.85 test-acc=0.86
  
 
===unsupervised mix-up===
 
===unsupervised mix-up===
  
Epoch=46: crput=0 test-loss=0.07 test-acc=0.99
+
* Epoch=46: crput=0 test-loss=0.07 test-acc=0.99
Epoch=46: crput=1 test-loss=0.29 test-acc=0.96
+
* Epoch=46: crput=1 test-loss=0.29 test-acc=0.96
Epoch=46: crput=2 test-loss=0.71 test-acc=0.90
+
* Epoch=46: crput=2 test-loss=0.71 test-acc=0.90
Epoch=46: crput=3 test-loss=0.91 test-acc=0.85
+
* Epoch=46: crput=3 test-loss=0.91 test-acc=0.85
  
 
===prob weighted addition===
 
===prob weighted addition===
  
Epoch=46: crput=0 test-loss=0.25 test-acc=1.00
+
* Epoch=46: crput=0 test-loss=0.25 test-acc=1.00
Epoch=46: crput=1 test-loss=0.45 test-acc=0.97
+
* Epoch=46: crput=1 test-loss=0.45 test-acc=0.97
Epoch=46: crput=2 test-loss=0.80 test-acc=0.91
+
* Epoch=46: crput=2 test-loss=0.80 test-acc=0.91
Epoch=46: crput=3 test-loss=0.76 test-acc=0.87
+
* Epoch=46: crput=3 test-loss=0.76 test-acc=0.87
  
  
 
===linear logit linear addition===
 
===linear logit linear addition===
  
Epoch=46: crput=0 test-loss=0.15 test-acc=0.97
+
* Epoch=46: crput=0 test-loss=0.15 test-acc=0.97
Epoch=46: crput=1 test-loss=0.38 test-acc=0.89
+
* Epoch=46: crput=1 test-loss=0.38 test-acc=0.89
Epoch=46: crput=2 test-loss=0.84 test-acc=0.83
+
* Epoch=46: crput=2 test-loss=0.84 test-acc=0.83
Epoch=46: crput=3 test-loss=1.64 test-acc=0.79
+
* Epoch=46: crput=3 test-loss=1.64 test-acc=0.79

2023年1月16日 (一) 10:47的最后版本

  • MNIST 0-7 binary cross entropy
  • Test with data mixture
  • Equal Accuracy as metric

baseline

  • Epoch=46: crput=0 test-loss=0.00 test-acc=1.00
  • Epoch=46: crput=1 test-loss=0.65 test-acc=0.87
  • Epoch=46: crput=2 test-loss=1.61 test-acc=0.76
  • Epoch=46: crput=3 test-loss=2.56 test-acc=0.66

data aug

  • Epoch=46: crput=0 test-loss=0.03 test-acc=0.99
  • Epoch=46: crput=1 test-loss=0.07 test-acc=0.98
  • Epoch=46: crput=2 test-loss=0.23 test-acc=0.92
  • Epoch=46: crput=3 test-loss=0.53 test-acc=0.83


mix-up

  • Epoch=46: crput=0 test-loss=0.01 test-acc=1.00
  • Epoch=46: crput=1 test-loss=0.20 test-acc=0.97
  • Epoch=46: crput=2 test-loss=0.58 test-acc=0.91
  • Epoch=46: crput=3 test-loss=0.85 test-acc=0.86

unsupervised mix-up

  • Epoch=46: crput=0 test-loss=0.07 test-acc=0.99
  • Epoch=46: crput=1 test-loss=0.29 test-acc=0.96
  • Epoch=46: crput=2 test-loss=0.71 test-acc=0.90
  • Epoch=46: crput=3 test-loss=0.91 test-acc=0.85

prob weighted addition

  • Epoch=46: crput=0 test-loss=0.25 test-acc=1.00
  • Epoch=46: crput=1 test-loss=0.45 test-acc=0.97
  • Epoch=46: crput=2 test-loss=0.80 test-acc=0.91
  • Epoch=46: crput=3 test-loss=0.76 test-acc=0.87


linear logit linear addition

  • Epoch=46: crput=0 test-loss=0.15 test-acc=0.97
  • Epoch=46: crput=1 test-loss=0.38 test-acc=0.89
  • Epoch=46: crput=2 test-loss=0.84 test-acc=0.83
  • Epoch=46: crput=3 test-loss=1.64 test-acc=0.79