ReviewNeural networks in wireless networks: Techniques, applications and guidelines
Introduction
While computers are typically utilized in a problem solving capacity, traditionally this capacity has been restricted to the cases where the solution can be explicitly programmed. There are many problems in wireless networks where general programming techniques do not provide optimal or generalizable solutions. For example, it is very difficult to write programs that could allow cognitive radios to learn and adapt, or predict user mobility to optimize wireless network resources. Advances in artificial intelligence (AI) and machine learning (ML) allow computers to overcome this restrictive constraint by enabling inference and complex decision making (attributes that are typically associated with human intelligence). In particular, computer systems can use machine learning algorithms and techniques to learn from data allowing these systems to classify and predict (Mitchell, 1997, Mitchell, 2006). Broadly speaking, ML involves detecting patterns and learning correlations between input and output from past data. This knowledge is then used to extrapolate outputs, or infer, on future input data. ML is a vast field encompassing many different kinds of systems which themselves use many different models.
Artificial Neural Networks (ANNs), or simply Neural Networks (NNs) (Haykin and Network, 2004)—the focus of this survey paper—constitute one of the most popular ML models in the literature. ANNs are composed of artificial ‘neurons’ interconnected together in a structure that aims to mimic the neural processing (organization and learning) of biological neurons and its behavior. NNs seek to emulate the learning system of the human brain that itself consists of a large number of biological neurons interconnected in networks that govern all aspects of human behavior. ANNs are modeled on human brain and use a network of nodes called artificial neurons to form complex systems. The ways in which these nodes are placed and are connected lead to different kinds of NN models.
Broadly speaking, ML systems can be categorized into three kinds of learning systems: (i) supervised learning; (ii) unsupervised learning; and (iii) reinforcement learning. Using these learning systems, NNs can predict outputs for a set of given inputs.
Historically speaking, starting from the work on perceptrons, NNs were devised in a model that involved supervised learning. This means that the NNs learned using a labeled data set, for which correct outputs are given for inputs. NNs continued to evolve and mostly found applications in supervised learning settings. Techniques were introduced over time that allowed NNs to learn in unsupervised settings in which no labeled data was available. Most of the modern day advancements in NNs such as deep NNs make the use of unsupervised learning. This is better suited for real-world problems where labeled data set is not available. The applications of such deep NNs in wireless networks are yet to be seen. Such applications, however, may be dominant in the future. NNs have found applications in vast variety of engineering fields including image processing (Egmont-Petersen et al., 2002), control theory (Hunt et al., 1992), data analytics, digital communications (Ibnkahla, 2000) among various applications.
The strength of NNs lies in their ability to provide generalized solutions through an architecture that is able to learn to improve its performance. NNs comprise of a number of elements called nodes that are configured in layers and connected to other nodes by links with a certain weight. The behavior of NNs is determined through (i) the way nodes are connected together into a network, and (ii) the adaptive link weights between these nodes that are tuned by a learning algorithm. Simply speaking, NNs are essentially a network of weighted, additive values with “nonlinear transfer functions”.
In this paper, the applications of NNs in wireless networks are discussed. NNs have been used in various types of wireless networks ranging from wireless sensor networks (WSNs) to cognitive radio networks (CRNs) for a wide variety of applications such as signal classification, parameter optimization, and network management. NNs have diverse implementations and a particular kind of a NN may be appropriate for a particular wireless networking functionality. In the next section, the different types of NNs, along with their architectures and learning mechanisms, will be discussed followed by the wide applications of these NNs in wireless networks.
Contributions of this paper: This survey, to the best of our knowledge, is the first paper that has focused on a comprehensive survey of the applications of NNs in wireless networks in general. Previous papers have either focused on general wired networks (Frank et al., 1999, Yuhas and Ansari, 2012), or have focused only on specific wireless networking configuration such as WSNs (Kulkarni et al., 2011), MANETs (Forster, 2007), or CRNs (Pattanayak et al., 2012).
Organization of this paper: This survey is organized in the following way. To facilitate the reader, acronyms used in this paper are collected in Table 1 for convenient reference. In Section 2, necessary background about machine learning and NNs is provided. In Section 3, a broad survey of applications of NN technology in wireless domain is provided. In Section 4, the categorization of applications of NN is provided according to the type of the wireless network. Guidelines for using NNs in wireless networks are given in Section 5. The limitations and challenges associated with implementing NN in wireless networks are provided in Section 6. Finally, this paper is summarized with concluding remarks in Section 7.
Section snippets
Background: machine learning and NNs
In the following sections, the aforementioned different machine learning methods will be described along with the NN models that utilize these learning methodologies. An overview of the different kinds of NNs and the relationship between them can be seen in Fig. 1.
Neural network applications in wireless networks
Wireless networking encompasses a vast field and it is difficult to restrict its scope. Any paradigm that employs a wireless medium for communication can be considered a wireless network (Table 2).
Cognitive radios
Cognitive radios (CRs) (Mitola, 2000, Mitola, 2006) are intelligent communication systems that are able to sense their environment so that they could accordingly configure themselves to meet set goals. These set goals can vary from increasing throughput to energy efficiency to reliable communication (Table 3).
The motivation which has driven research in cognitive radios is the promise to allow communication devices to use idle frequency bands within the frequency spectrum allotted to other users
Guide to using NNs in wireless networks
In this section, we will provide some implementation guidelines to successfully use NNs (in supervised and unsupervised configurations) in wireless networks. In particular, we will discuss the relevance and suitability of different NN techniques for different tasks. We will discuss pitfalls and will highlight limitations and challenges in Section 6.
Pitfalls, limitations, and challenges
Though NNs are capable of modeling complex non-linear problems, they do have some drawbacks. One of the main criticisms of NNs is that they are a black box approach and do not provide any domain specific insights about the model/network has been developed (Karlaftis and Vlahogianni, 2011). In practice, one typically requires modeling techniques that will provide insight into how the features are correlated with the objective function. For instance, Classification and Regression Trees (C&RT) can
Conclusion
We have provided a survey of the applications of NNs in wireless networks. Due to the generality of the NN technique, it has been extensively applied in wireless networks. In addition to providing a self-contained introduction to common models and configurations of NNs, we have also provided a detailed survey of applications of NNs in wireless networks. We have categorized the applications of NN in wireless networks both according to the wireless networking configuration, and according to the
References (163)
- et al.
Wireless sensor networksa survey
Comput. Netw.
(2002) - et al.
Using artificial intelligence in routing schemes for wireless networks
Comput. Commun.
(2007) - et al.
Constructive training of probabilistic neural networks
Neurocomputing
(1998) - et al.
Image processing with neural networks—a review
Pattern Recognit.
(2002) - et al.
Approximation of dynamical systems by continuous time recurrent neural networks
Neural Netw.
(1993) - et al.
Applying data mining to telecom churn management
Expert Syst. Appl.
(2006) - et al.
Neural networks for control systems—a survey
Automatica
(1992) Applications of neural networks to digital communicationsa survey
Signal Process.
(2000)- et al.
Statistical methods versus neural networks in transportation researchdifferences, similarities and some insights
Transp. Res. Part C: Emerg. Technol.
(2011) - et al.
Performance evaluation of artificial neural network-based learning schemes for cognitive radio systems
Comput. Electr. Eng.
(2010)
Localization performance evaluation of extended Kalman filter in wireless sensors network
Proc. Comput. Sci.
Comparison of neofuzzy and rough neural networks
Inf. Sci.
Survey of clustering algorithms for MANET
Int. J. Comput. Sci. Eng.
Improving life time of wireless sensor networks using neural network based classification techniques with cooperative routing
Int. J. Commun.
Dynamic self-organizing maps with controlled growth for knowledge discovery
IEEE Trans. Neural Netw.
Neural networks for error detection and data aggregation in wireless sensor network
Int. J. Comput. Sci. Issues
Learning long-term dependencies with gradient descent is difficult
IEEE Trans. Neural Netw.
Greedy layer-wise training of deep networks
Adv. Neural Inf. Process. Syst.
Latent Dirichlet allocation
J. Mach. Learn. Res.
Variational inference for Dirichlet process mixtures
Bayesian Anal.
Radial basis functions
Acta Numer. 2000
The art of adaptive pattern recognition by a self-organizing neural network
Computer
Energy based clustering self organizing map protocol for extending wireless sensor networks lifetime and coverage
Can. J. Multimed. Wirel. Netw.
Neural network based energy efficiency in wireless sensor networksa survey
Int. J. Comput. Sci. Eng. Surv.
Unsupervised learning of finite mixture models
IEEE Trans. Pattern Anal. Mach. Intell.
Use of time-frequency analysis and neural networks for mode identification in a wireless software-defined radio approach
EURASIP J. Appl. Signal Process.
Improving the performance of dynamic source routing protocol by optimization of neural networks
Int. J. Comput. Sci. Issues
Cited by (68)
AI/ML for beyond 5G systems: Concepts, technology enablers & solutions
2023, Computer NetworksDeep Reinforcement Learning for QoS provisioning at the MAC layer: A Survey
2021, Engineering Applications of Artificial IntelligenceCitation Excerpt :However, the paper focuses only on old DL models as it was published three years ago. Ahad et al. introduced Neural Networks (NN) as a way to tackle challenges related to decision making or parameter optimization in wireless networks, e.g., the highly dynamic and unknown network environments (Ahad et al., 2016). One of the paper’s severe disadvantages is that it focuses on traditional Neural Network (NN) systems.
Role of Neural Networks in Improving Communication Performance During Black-Hole Attack in MANET
2024, AIP Conference ProceedingsAssessing Wireless Communication Systems Performance Metrics Using Artificial Neural Networks: A Modelling and Simulation Approach
2023, Instrumentation Mesure Metrologie