Dataset Waveform 1

Basic characteristics Waveform 1

300

target objects

The Waveform Data Generator from UCI, originally from the Classification and Regression Trees book. Class 1 is used as target class. Download mat-file with Prtools dataset.

600

outlier objects

21

features

Unsupervised PCA Waveform 1

On the left, the PCA scatterplot is shown, on the right the retained variance for varying number of features.
On the left, the PCA scatterplot is shown of data rescaled to unit variance, on the right the retained variance.

Supervised Fisher Waveform 1

On the left, the Fisher scatterplot is shown, on the right the ROC curve along this direction.

Results Waveform 1

The experiments are performed using dd_tools. A rudimentary explanation of the classifiers is given in the classifier section.

599, 0 outliers, AUC (x100) 5x strat. 10-fold
Classifiers Preproc
none unit var PCA 95\%
Gauss 89.9 ( 0.0) 89.9 ( 0.0) 90.3 ( 0.0)
Min.Cov.Determinant 89.9 ( 0.0) 89.9 ( 0.0) 90.3 ( 0.0)
Mixture of Gaussians 89.7 ( 0.3) 89.6 ( 0.3) 89.8 ( 0.4)
Naive Parzen 93.0 ( 0.0) 93.0 ( 0.0) 89.6 ( 0.0)
Parzen 90.1 ( 0.0) 90.0 ( 0.0) 89.9 ( 0.0)
k-means 89.6 ( 0.2) 89.4 ( 0.2) 89.6 ( 0.4)
1-Nearest Neighbors 89.2 ( 0.0) 89.2 ( 0.0) 88.7 ( 0.0)
k-Nearest Neighbors 89.2 ( 0.0) 89.2 ( 0.0) 88.7 ( 0.0)
knn, opt-AUC 91.1 ( 0.4) 91.1 ( 0.3) 91.0 ( 0.4)
Nearest-neighbor dist 82.5 ( 0.0) 81.8 ( 0.0) 83.4 ( 0.0)
Principal comp. 85.5 ( 0.0) 84.1 ( 0.0) 86.6 ( 0.0)
Self-Organ. Map 89.0 ( 0.2) 89.1 ( 0.4) 88.8 ( 0.2)
Auto-enc network 87.9 ( 0.0) 87.6 ( 0.1) 88.1 ( 0.1)
Spanning Tree 89.0 ( 0.0) NaN ( 0.0) 88.8 ( 0.0)
L_1-ball 90.2 ( 0.0) 91.2 ( 0.0) 86.4 ( 0.0)
k-center 79.3 (18.1) 87.8 ( 1.8) 87.5 ( 1.7)
Support vector DD 37.4 ( 0.8) 41.7 ( 0.0) 39.7 ( 0.0)
Minimax Prob. DD 89.4 ( 0.0) 89.5 ( 0.0) 88.9 ( 0.0)
LinProg DD 92.4 ( 0.0) 92.6 ( 0.0) 92.6 ( 0.0)

Classifier projection spaces The first classifier projection spaces are obtained by computing the classifier label disagreements (setting the threshold on 10% target error) and applying an MDS on the resulting distance matrix between classifiers:



Original



Unit variance



PCA mapped

Classifier projection spaces The second versions of the classifier projection spaces are obtained by computing the classifier ranking disagreements and applying an MDS on the resulting distance matrix between classifiers:



Original



Unit variance



PCA mapped