Elsevier

Information Sciences

Volume 325, 20 December 2015, Pages 466-483
Information Sciences

A direct measure of discriminant and characteristic capability for classifier building and assessment

https://doi.org/10.1016/j.ins.2015.07.028Get rights and content
Under a Creative Commons license
open access

Abstract

Performance measures are used in various stages of the process aimed at solving a classification problem. Unfortunately, most of these measures are in fact biased, meaning that they strictly depend on the class ratio – i.e. on the imbalance between negative and positive samples. After pointing to the source of bias for the best known measures, novel unbiased measures are defined which are able to capture the concepts of discriminant and characteristic capability. The combined use of these measures can give important information to researchers involved in machine learning or pattern recognition tasks, in particular for classifier performance assessment and feature selection.

Keywords

Classifier performance measures
Feature ranking/selection
Confusion matrices

Cited by (0)