Instance Selection + C4.5 on Credit rating
# 17/11/2009 18:11
Test description:
Crosvalidation test 10x10 Normalization [-1,1] Vector Selection Classification=C45
C45 Configuration:
BinarySplits=False ConfidenceFactor=0.25 MinNumObj=2 NumFolds=3 ReducedErrorPruning=False Unpruned=False
Credit rating
Accuracy | Compression | Rules | ||||
---|---|---|---|---|---|---|
mean | std. | mean | std. | mean | std. | |
C4.5 | 84.16 | 3.99 | 100.00 | 0.00 | 29.96 | 3.43 |
EkPs60p1 | 55.51 ![]() | 5.68 | 0.32 ![]() | 0.00 | 1.00 ![]() | 0.00 |
EkPs60p3 | 85.51 | 3.80 | 0.97 ![]() | 0.00 | 2.00 ![]() | 0.00 |
EkPs60p5 | 85.36 | 3.86 | 1.61 ![]() | 0.00 | 2.11 ![]() | 0.35 |
EkPs60p10 | 85.20 | 4.31 | 3.22 ![]() | 0.00 | 3.65 ![]() | 0.74 |
CNN | 73.83 ![]() | 5.37 | 33.85 ![]() | 1.36 | 24.35 ![]() | 2.83 |
DROP3 | 80.97 | 5.96 | 5.91 ![]() | 0.89 | 3.90 ![]() | 1.46 |
DROP5 | 78.64 | 8.34 | 7.50 ![]() | 1.19 | 6.53 ![]() | 1.92 |
ENRBF | 71.17 ![]() | 11.51 | 4.32 ![]() | 0.71 | 4.22 ![]() | 1.12 |
ENN | 85.38 | 3.99 | 90.43 ![]() | 0.49 | 14.70 ![]() | 2.04 |
ICF | 83.16 | 4.62 | 22.19 ![]() | 2.10 | 11.36 ![]() | 1.71 |
GE | 84.29 | 4.08 | 99.23 ![]() | 0.30 | 30.26 | 3.24 |
RNGE | 80.93 ![]() | 4.49 | 47.66 ![]() | 1.25 | 25.18 ![]() | 3.58 |
RMHC | 55.51 ![]() | 5.68 | 0.32 ![]() | 0.00 | 1.00 ![]() | 0.00 |
MC | 55.51 ![]() | 5.68 | 0.32 ![]() | 0.00 | 1.00 ![]() | 0.00 |
statistically significant improvement,
significant degradation
EkPs60p1 Configuration:
Classifier=C45 PostClassifier=C45 CostTolerance=1E-16 MaxNumCostCalls=300 MaxSimplexIters=200 NumFolds=-1 NumProtoPerClass=1 NumSimplexPoints=60
EkPs60p3 Configuration:
Classifier=C45 PostClassifier=C45 CostTolerance=1E-16 MaxNumCostCalls=300 MaxSimplexIters=200 NumFolds=-1 NumProtoPerClass=3 NumSimplexPoints=60
EkPs60p5 Configuration:
Classifier=C45 PostClassifier=C45 CostTolerance=1E-16 MaxNumCostCalls=300 MaxSimplexIters=200 NumFolds=-1 NumProtoPerClass=5 NumSimplexPoints=60
EkPs60p10 Configuration:
Classifier=C45 PostClassifier=C45 CostTolerance=1E-16 MaxNumCostCalls=300 MaxSimplexIters=200 NumFolds=-1 NumProtoPerClass=10 NumSimplexPoints=60
CNN Configuration:
Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
DROP3 Configuration:
Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean Order=EnemyDistance ENN=True IncludePruned=True
DROP5 Configuration:
Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean Order=EnemyDistanceAndReverse ENN=False IncludePruned=True
ENRBF Configuration:
Sigma=0.5 Strenght=0.05 RemoveNoise=True Tolerance=0.95 Metric=Intemi.Metric.SquareEuclidean
ENN Configuration:
Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean Repeated=False
ICF Configuration:
Metric=Intemi.Metric.SquareEuclidean Filter=(ENN using kNN k=3)
GE Configuration:
Metric=Intemi.Metric.SquareEuclidean MeighboursType=Gabriel
RNGE Configuration:
Metric=Intemi.Metric.SquareEuclidean MeighboursType=Relative
RMHC Configuration:
Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean Search=randomMutation Mutations=1000
MC Configuration:
Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean Search=monteCarlo Mutations=1000