Abstract
LTE-unlicensed (LTE-U) technology is a promising innovation to extend the capacity of cellular networks. The primary challenge for LTE-U is the fair coexistence between LTE systems and the incumbent WiFi systems. In this paper, we aim to maximize the long-term average per-user LTE throughput with long-term fairness guarantee by jointly considering resource allocation and user association on the unlicensed spectrum within a prediction window. We first formulate the problem as an NP-hard combinatorial optimization problem, then reformulate it as a non-cooperative game by applying the penalty function method. To solve the game, a novel reinforcement learning approach based on Bi-directional LSTM neural network is proposed, which enables small base stations (SBSs) to predict a sequence of future actions over the next prediction window based on the historical network information. It is shown that the proposed approach can converge to a mixed-strategy Nash equilibrium of the studied game and ensure the long-term fair coexistence between different access technologies. Finally, the effectiveness of the proposed algorithm is demonstrated by numerical simulation.
Similar content being viewed by others
References
Cisco. (2017). Cisco visual networking index: Global mobile data traffic forecast update 2016-2021, Whitepaper.
Nokia. (2014). Nokia LTE for unlicensed spectrum.
Ko, H., Lee, J., & Pack, S. (2016). A fair listen-before-talk algorithm for coexistence of LTE-U and WiFi. IEEE Transactions on Vehicular Technology, 65(12), 10116–10120.
Qualcomm research. (2014). LTE in unlicensed spectrum: Harmonious coexistence with Wi-Fi.
Chen, M., Saad, W., & Yin, C. (2017). Echo state networks for self-organizing resource allocation in LTE-U with uplink-downlink decoupling. IEEE Transactions on Wireless Communications, 16(1), 3–16.
Chen, Q., Yu, G., Shan, H., & Maaref, A. (2016). Cellular meets WiFi: Traffic offloading or resource sharing? IEEE Transactions on Wireless Communications, 15(5), 3354–3367.
Chen, Q., Yu, G., & Ding, Z. (2016). Optimizing unlicensed spectrum sharing for LTE-U and WiFi network coexistence. IEEE Journal on Selected Areas in Communications, 34(10), 2562–2574.
Challita, U., Dong, L., & Saad, W. (2017). Deep learning for proactive resource allocation in LTE-U networks. In 23th European wireless conference, Dresden, Germany (pp. 1–6).
Liu, R., Chen, Q., & Yu, G. (2018). Joint user association and resource optimization for unlicensed LTE systems. In IEEE international conference on communications (pp. 1–6). Kansas, MO, USA.
Lopez-Perez, D., Guvenc, I., de la Roche, G., Kountouris, M., Quek, T. Q. S., & Zhang, J. (2011). Enhanced intercell interference coordination challenges in heterogeneous networks. IEEE Wireless Communications, 18(3), 22–30.
Bianchi, G. (2000). Performance analysis of IEEE 802.11 distributed coordination function. IEEE Journal on Selected Areas in Communications, 18(3), 535–547.
Schuster, M., & Paliwal, K. (1997). Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11), 2673–2681.
Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning representations by back-propagating errors. Nature, 323, 533–536.
Sutton, R., McAllester, D., Singh, S., & Mansour, Y. (2000). Policy gradient methods for reinforcement learning with function approximation. Neural Information Processing Systems, 12, 1057–1063.
Balazinska, M., & Castro, P. (2003). IBM Watson Research Center. CRAWCAD.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Luo, Z., Yu, G. BiLSTM Based Reinforcement Learning for Resource Allocation and User Association in LTE-U Networks. Wireless Pers Commun 114, 2629–2641 (2020). https://doi.org/10.1007/s11277-020-07493-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-020-07493-x