Unsuperivsed Mixup

• MNIST 0-7 binary cross entropy
• Test with data mixture
• Equal Accuracy as metric

baseline

• Epoch=46: crput=0 test-loss=0.00 test-acc=1.00
• Epoch=46: crput=1 test-loss=0.65 test-acc=0.87
• Epoch=46: crput=2 test-loss=1.61 test-acc=0.76
• Epoch=46: crput=3 test-loss=2.56 test-acc=0.66

data aug

• Epoch=46: crput=0 test-loss=0.03 test-acc=0.99
• Epoch=46: crput=1 test-loss=0.07 test-acc=0.98
• Epoch=46: crput=2 test-loss=0.23 test-acc=0.92
• Epoch=46: crput=3 test-loss=0.53 test-acc=0.83

mix-up

• Epoch=46: crput=0 test-loss=0.01 test-acc=1.00
• Epoch=46: crput=1 test-loss=0.20 test-acc=0.97
• Epoch=46: crput=2 test-loss=0.58 test-acc=0.91
• Epoch=46: crput=3 test-loss=0.85 test-acc=0.86

unsupervised mix-up

• Epoch=46: crput=0 test-loss=0.07 test-acc=0.99
• Epoch=46: crput=1 test-loss=0.29 test-acc=0.96
• Epoch=46: crput=2 test-loss=0.71 test-acc=0.90
• Epoch=46: crput=3 test-loss=0.91 test-acc=0.85

prob weighted addition

• Epoch=46: crput=0 test-loss=0.25 test-acc=1.00
• Epoch=46: crput=1 test-loss=0.45 test-acc=0.97
• Epoch=46: crput=2 test-loss=0.80 test-acc=0.91
• Epoch=46: crput=3 test-loss=0.76 test-acc=0.87

linear logit linear addition

• Epoch=46: crput=0 test-loss=0.15 test-acc=0.97
• Epoch=46: crput=1 test-loss=0.38 test-acc=0.89
• Epoch=46: crput=2 test-loss=0.84 test-acc=0.83
• Epoch=46: crput=3 test-loss=1.64 test-acc=0.79