Spis treści

Instance Selection + C4.5 on Credit rating

17/11/2009 18:11

Test description: 

Crosvalidation test 10x10
Normalization [-1,1]
Vector Selection
Classification=C45

C45 Configuration: 

BinarySplits=False
ConfidenceFactor=0.25
MinNumObj=2
NumFolds=3
ReducedErrorPruning=False
Unpruned=False

Credit rating

Accuracy Compression Rules
mean std. mean std. mean std.
** C4.5** ** 84.16** 3.99 100.00 0.00 ** 29.96** 3.43
EkPs60p1 ** 55.51** :-( 5.68 ** 0.32** :-( 0.00 ** 1.00** :-( 0.00
EkPs60p3 ** 85.51** 3.80 ** 0.97** :-( 0.00 ** 2.00** :-( 0.00
EkPs60p5 ** 85.36** 3.86 ** 1.61** :-( 0.00 ** 2.11** :-( 0.35
EkPs60p10 ** 85.20** 4.31 ** 3.22** :-( 0.00 ** 3.65** :-( 0.74
** CNN** ** 73.83** :-( 5.37 ** 33.85** :-( 1.36 ** 24.35** :-( 2.83
** DROP3** ** 80.97** 5.96 ** 5.91** :-( 0.89 ** 3.90** :-( 1.46
** DROP5** ** 78.64** 8.34 ** 7.50** :-( 1.19 ** 6.53** :-( 1.92
** ENRBF** ** 71.17** :-( 11.51 ** 4.32** :-( 0.71 ** 4.22** :-( 1.12
** ENN** ** 85.38** 3.99 ** 90.43** :-( 0.49 ** 14.70** :-( 2.04
** ICF** ** 83.16** 4.62 ** 22.19** :-( 2.10 ** 11.36** :-( 1.71
** GE** ** 84.29** 4.08 ** 99.23** :-( 0.30 ** 30.26** 3.24
** RNGE** ** 80.93** :-( 4.49 ** 47.66** :-( 1.25 ** 25.18** :-( 3.58
** RMHC** ** 55.51** :-( 5.68 ** 0.32** :-( 0.00 ** 1.00** :-( 0.00
** MC** ** 55.51** :-( 5.68 ** 0.32** :-( 0.00 ** 1.00** :-( 0.00

:-) statistically significant improvement, :-( significant degradation

EkPs60p1 Configuration: 

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=1
NumSimplexPoints=60

EkPs60p3 Configuration: 

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=3
NumSimplexPoints=60

EkPs60p5 Configuration: 

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=5
NumSimplexPoints=60

EkPs60p10 Configuration: 

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=10
NumSimplexPoints=60

CNN Configuration: 

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean

DROP3 Configuration: 

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistance
ENN=True
IncludePruned=True

DROP5 Configuration: 

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistanceAndReverse
ENN=False
IncludePruned=True

ENRBF Configuration: 

Sigma=0.5
Strenght=0.05
RemoveNoise=True
Tolerance=0.95
Metric=Intemi.Metric.SquareEuclidean

ENN Configuration: 

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Repeated=False

ICF Configuration: 

Metric=Intemi.Metric.SquareEuclidean
Filter=(ENN using kNN k=3)

GE Configuration: 

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Gabriel

RNGE Configuration: 

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Relative

RMHC Configuration: 

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=randomMutation
Mutations=1000

MC Configuration: 

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=monteCarlo
Mutations=1000