Instance Selection + C4.5 on Statlog Heart

# 20/11/2009 21:11

Test description:

Crosvalidation test 10x10
Normalization [-1,1]
Vector Selection
Classification=C45

C45 Configuration:

BinarySplits=False
ConfidenceFactor=0.25
MinNumObj=2
NumFolds=3
ReducedErrorPruning=False
Unpruned=False
Accuracy Compression Rules
mean std.
    mean   |  std.  |       mean   |  std.  |
C4.5 77.37 7.66 100.00 0.00 17.99 2.53
EkPs60p1 55.56 :-( 9.03 0.82 :-( 0.00 1.00 :-( 0.00
EkPs60p3 72.48 8.92 2.47 :-( 0.00 2.00 :-( 0.00
EkPs60p5 71.70 8.66 4.12 :-( 0.00 2.53 :-( 0.54
EkPs60p10 79.15 7.78 8.23 :-( 0.00 3.66 :-( 0.54
CNN 71.74 9.17 43.39 :-( 2.42 14.02 :-( 2.06
DROP3 73.37 9.10 12.00 :-( 1.58 3.64 :-( 1.02
DROP5 74.26 10.48 12.21 :-( 2.62 4.18 :-( 1.10
ENRBF 71.85 9.40 7.16 :-( 1.21 3.35 :-( 1.06
ENN 79.26 6.60 89.67 :-( 1.01 12.32 :-( 1.93
ICF 73.22 9.19 24.72 :-( 2.50 8.33 :-( 1.49
GE 77.89 7.99 98.45 :-( 0.65 17.96 2.55
RNGE 73.41 8.88 51.95 :-( 2.11 15.81 :-( 2.24
RMHC 55.56 :-( 9.03 0.82 :-( 0.00 1.00 :-( 0.00
MC 55.56 :-( 9.03 0.82 :-( 0.00 1.00 :-( 0.00

:-) statistically significant improvement, :-( significant degradation

EkPs60p1 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=1
NumSimplexPoints=60

EkPs60p3 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=3
NumSimplexPoints=60

EkPs60p5 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=5
NumSimplexPoints=60

EkPs60p10 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=10
NumSimplexPoints=60

CNN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean

DROP3 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistance
ENN=True
IncludePruned=True

DROP5 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistanceAndReverse
ENN=False
IncludePruned=True

ENRBF Configuration:

Sigma=0.5
Strenght=0.05
RemoveNoise=True
Tolerance=0.95
Metric=Intemi.Metric.SquareEuclidean

ENN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Repeated=False

ICF Configuration:

Metric=Intemi.Metric.SquareEuclidean
Filter=(ENN using kNN k=3)

GE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Gabriel

RNGE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Relative

RMHC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=randomMutation
Mutations=1000

MC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=monteCarlo
Mutations=1000