Abstract
In this paper, we present a review of feature selection methods based on an analysis of the training set which have been applied to neural networks. This type of methods uses information theory concepts, interclass and intraclass distances or an analysis of fuzzy regions. Furthermore, a methodology that allows evaluating and comparing feature selection methods is carefully described. This methodology is applied to the 7 reviewed methods in a total of 15 different real world classification problems. We present an ordination of methods according to its performance and it is clearly concluded which method performs better and should be used. We also discuss the applicability and computational complexity of the methods.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Devena, L.: Automatic selection of the most relevant features to recognize objects. Proc. of the Int. Conf. on Artificial NNs, vol. 2, pp. 1113–1116, 1994.
Thawonmas, R., Abe, S.: Feature reduction based on analysis of fuzzy regions. Proc. of the 1995 Int. Conf. on Neural Networks, vol. 4, pp. 2130–2133, 1995.
Kira, K., Rendell, L.A.: The feature selection problem: Traditional methods and a new algorithm. Proc. of 10th Nat. Conf. on Artif. Intellig., pp. 129–134, 1992.
Battiti, R.: Using mutual information for selecting features in supervised neural net learning. IEEE Trans. on Neural Networks, vol. 5, n. 4, pp. 537–550, 1994.
Scherf,.: A new approach to feature selection. Proc. of the 6th Conf. on Artificial Intelligence in Medicine, (AIME'97), pp. 181–184, 1997.
Setiono, R., Liu, H.: Improving Backpropagation learning with feature selection. Applied Intellig.: The Int. Journal of Artif. Intellig., NNs, and Complex Problem-Solving Technologies, vol. 6, n. 2, pp. 129–139, 1996.
Chi, Jabri: An entropy based feature evaluation and selection technique. Proc. of 4th Australian Conf. on NNs, (ACNN'93), pp. 193–196, 1993.
Lorenzo, Hernández, Méndez: Attribute selection through a measurement based on information theory (in Spanish). 7a Conferencia de la Asociación Española para la Inteligencia Artificial, (CAEPIA 1997), pp. 469–478, 1997.
Tetko, I.V., Villa, A.E.P., Livingstone, D.J.: Neural network studies 2. Variable selection. Journal of Chem. Inf. Comput. Sci., vol. 36, n. 4, pp. 794–803, 1996.
Watzel, R., Meyer-Bäse, A., Meyer-Bäse, U., Hilberg, H., Scheich, H.: Identification of irrelevant features in phoneme recognition with radial basis classifiers. Proc. of 1994 Int. Symp. on Artificial NNs, pp. 507–512, 1994.
Bronshtein, I., Semandiavev, K.: Mathematics Handbook for engineers and studients (in Spanish). MIR, Moscow, 1977.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández Redondo, M., Hernández Espinosa, C. (1999). How to select the inputs for a multilayer feedforward network by using the training set. In: Mira, J., Sánchez-Andrés, J.V. (eds) Engineering Applications of Bio-Inspired Artificial Neural Networks. IWANN 1999. Lecture Notes in Computer Science, vol 1607. Springer, Berlin, Heidelberg . https://doi.org/10.1007/BFb0100515
Download citation
DOI: https://doi.org/10.1007/BFb0100515
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66068-2
Online ISBN: 978-3-540-48772-2
eBook Packages: Springer Book Archive