Instance Selection + C4.5 on Sonar

21/11/2009 15:11

Test description:

Crosvalidation test 10x10
Normalization [-1,1]
Vector Selection
Classification=C45

C45 Configuration:

BinarySplits=False
ConfidenceFactor=0.25
MinNumObj=2
NumFolds=3
ReducedErrorPruning=False
Unpruned=False

	Accuracy ^^ Compression ^^ Rules ^^ \| \| mean \| std. \| mean \| std. \| mean \| std. \| \| C4.5	74.83	10.70	100.00	0.00	7.29	1.07
EkPs60p1	53.40	9.83	1.07	0.00	1.00	0.00
EkPs60p3	72.33	8.72	3.21	0.01	2.00	0.00
EkPs60p5	71.99	9.15	5.34	0.01	2.00	0.00
EkPs60p10	69.07	10.88	10.68	0.02	2.38	0.53
CNN	67.36	11.61	40.97	2.60	5.41	0.99
DROP3	66.92	10.60	24.87	2.65	3.17	0.65
DROP5	67.05	10.74	26.91	2.23	3.51	0.64
ENRBF	60.22	11.49	13.54	1.61	2.75	0.76
ENN	76.50	9.47	92.04	1.27	6.38	0.90
ICF	71.70	11.27	37.54	2.11	4.43	0.59
GE	74.74	10.90	99.99	0.05	7.27	1.07
RNGE	68.41	10.82	45.50	1.81	5.42	0.85
RMHC	46.60	9.83	1.07	0.00	1.00	0.00
MC	46.60	9.83	1.07	0.00	1.00	0.00

statistically significant improvement, significant degradation

EkPs60p1 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=1
NumSimplexPoints=60

EkPs60p3 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=3
NumSimplexPoints=60

EkPs60p5 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=5
NumSimplexPoints=60

EkPs60p10 Configuration:

Classifier=C45
PostClassifier=C45
CostTolerance=1E-16
MaxNumCostCalls=300
MaxSimplexIters=200
NumFolds=-1
NumProtoPerClass=10
NumSimplexPoints=60

CNN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean

DROP3 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistance
ENN=True
IncludePruned=True

DROP5 Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Order=EnemyDistanceAndReverse
ENN=False
IncludePruned=True

ENRBF Configuration:

Sigma=0.5
Strenght=0.05
RemoveNoise=True
Tolerance=0.95
Metric=Intemi.Metric.SquareEuclidean

ENN Configuration:

Classifier=kNN k=3, Metric=Intemi.Metric.SquareEuclidean
Repeated=False

ICF Configuration:

Metric=Intemi.Metric.SquareEuclidean
Filter=(ENN using kNN k=3)

GE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Gabriel

RNGE Configuration:

Metric=Intemi.Metric.SquareEuclidean
MeighboursType=Relative

RMHC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=randomMutation
Mutations=1000

MC Configuration:

Classifier=kNN k=1, Metric=Intemi.Metric.SquareEuclidean
Search=monteCarlo
Mutations=1000

	Accuracy ^^ Compression ^^ Rules ^^ \| \| mean \| std. \| mean \| std. \| mean \| std. \| \| C4.5	74.83	10.70	100.00	0.00	7.29	1.07
EkPs60p1	53.40	9.83	1.07	0.00	1.00	0.00
EkPs60p3	72.33	8.72	3.21	0.01	2.00	0.00
EkPs60p5	71.99	9.15	5.34	0.01	2.00	0.00
EkPs60p10	69.07	10.88	10.68	0.02	2.38	0.53
CNN	67.36	11.61	40.97	2.60	5.41	0.99
DROP3	66.92	10.60	24.87	2.65	3.17	0.65
DROP5	67.05	10.74	26.91	2.23	3.51	0.64
ENRBF	60.22	11.49	13.54	1.61	2.75	0.76
ENN	76.50	9.47	92.04	1.27	6.38	0.90
ICF	71.70	11.27	37.54	2.11	4.43	0.59
GE	74.74	10.90	99.99	0.05	7.27	1.07
RNGE	68.41	10.82	45.50	1.81	5.42	0.85
RMHC	46.60	9.83	1.07	0.00	1.00	0.00
MC	46.60	9.83	1.07	0.00	1.00	0.00