Instance Selection + C4.5 on Statlog Heart

# 20/11/2009 21:11

Test description:

Crosvalidation test 10x10
Normalization [-1,1]
Vector Selection
Classification=C45

C45 Configuration:

BinarySplits=False
ConfidenceFactor=0.25
MinNumObj=2
NumFolds=3
ReducedErrorPruning=False
Unpruned=False

Statlog heart

Accuracy	Compression	Rules
mean	std.	mean | std. | mean | std. |	C4.5	77.37	7.66	100.00	0.00	17.99	2.53
EkPs60p1	55.56	9.03	0.82	0.00	1.00	0.00
EkPs60p3	72.48	8.92	2.47	0.00	2.00	0.00
EkPs60p5	71.70	8.66	4.12	0.00	2.53	0.54
EkPs60p10	79.15	7.78	8.23	0.00	3.66	0.54
CNN	71.74	9.17	43.39	2.42	14.02	2.06
DROP3	73.37	9.10	12.00	1.58	3.64	1.02
DROP5	74.26	10.48	12.21	2.62	4.18	1.10
ENRBF	71.85	9.40	7.16	1.21	3.35	1.06
ENN	79.26	6.60	89.67	1.01	12.32	1.93
ICF	73.22	9.19	24.72	2.50	8.33	1.49
GE	77.89	7.99	98.45	0.65	17.96	2.55
RNGE	73.41	8.88	51.95	2.11	15.81	2.24
RMHC	55.56	9.03	0.82	0.00	1.00	0.00
MC	55.56	9.03	0.82	0.00	1.00	0.00

statistically significant improvement, significant degradation

EkPs60p1 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=1
NumSimplexPoints=60

EkPs60p3 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=3
NumSimplexPoints=60

EkPs60p5 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=5
NumSimplexPoints=60

EkPs60p10 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=10
NumSimplexPoints=60

CNN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean

DROP3 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistance
ENN=True
IncludePruned=True

DROP5 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistanceAndReverse
ENN=False
IncludePruned=True

ENRBF Configuration:

Sigma=0.5
Strenght=0.05
RemoveNoise=True
Tolerance=0.95
Metric=Intemi.Metric.SquareEuclidean

ENN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Repeated=False

ICF Configuration:

Metric=Intemi.Metric.SquareEuclidean
Filter=(ENN using kNN k=3)

GE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Gabriel

RNGE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Relative

RMHC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=randomMutation
Mutations=1000

MC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=monteCarlo
Mutations=1000