Skip Abstract Section
Abstract
The integration of small cell architecture and edge intelligence is expected to make high-grade mobile connectivity accessible and thus provide smart and efficient services for various aspects of urban life. It is well known that small cell architecture will cause high inter-cell interference since the adjacent cells share the same frequency band. One of the most promising techniques to mitigate inter-cell interference is beamforming, however, how to coordinate the beamformers in a multicell dynamic network to reach a global optimum is an extremely challenging problem. In this paper, we consider analog beamforming with low-resolution phase shifters, and propose a distributed learning and multicell coordination based energy efficient beamforming approach for multiple-input and single-output (MISO) small cell system. The goal is to maximize the energy efficiency (EE) of the whole system by jointly optimizing the beamformer and transmit power. We perform extensive simulations in both static and dynamic scenarios, and validate the performance of the proposed approach by comparing with baseline and existing schemes. The simulation results demonstrate that the proposed approach outperforms the baseline and existing schemes with an significant improvement in terms of EE for both static and dynamic network settings.
- Xiaoyan Wang, Masahiro Umehira, Mina Akimoto, Biao Han, and Hao Zhou. Green spectrum sharing framework in b5g era by exploiting crowdsensing. IEEE Transactions on Green Communications and Networking, pages 1–1, 2022.Google Scholar
- Xiaoyan Wang, Yuto Teraki, Masahiro Umehira, Hao Zhou, and Yusheng Ji. A usage aware dynamic spectrum access scheme for interweave cognitive radio network by exploiting deep reinforcement learning. Sensors, 22(18), 2022.Google Scholar
- Xiaokang Zhou, Xiang Yang, Jianhua Ma, and Kevin I-Kai Wang. Energy-efficient smart routing based on link correlation mining for wireless edge computing in iot. IEEE Internet of Things Journal, 9(16):14988–14997, 2022.Google ScholarCross Ref
- A Lee Swindlehurst, Ender Ayanoglu, Payam Heydari, and Filippo Capolino. Millimeter-wave massive mimo: The next wireless revolution? IEEE Communications Magazine, 52(9):56–62, 2014.Google ScholarCross Ref
- Robert W Heath, Nuria Gonzalez-Prelcic, Sundeep Rangan, Wonil Roh, and Akbar M Sayeed. An overview of signal processing techniques for millimeter wave mimo systems. IEEE journal of selected topics in signal processing, 10(3):436–453, 2016.Google ScholarCross Ref
- Ya-Feng Liu, Yu-Hong Dai, and Zhi-Quan Luo. Coordinated beamforming for miso interference channel: Complexity analysis and efficient algorithms. IEEE Transactions on Signal Processing, 59(3):1142–1157, 2010.Google ScholarDigital Library
- Kaiming Shen and Wei Yu. Fractional programming for communication systems—part i: Power control and beamforming. IEEE Transactions on Signal Processing, 66(10):2616–2630, 2018.Google ScholarCross Ref
- Qingjiang Shi, Meisam Razaviyayn, Zhi-Quan Luo, and Chen He. An iteratively weighted mmse approach to distributed sum-utility maximization for a mimo interfering broadcast channel. IEEE Transactions on Signal Processing, 59(9):4331–4340, 2011.Google ScholarDigital Library
- Xiaokang Zhou, Yiyong Hu, Jiayi Wu, Wei Liang, Jianhua Ma, and Qun Jin. Distribution bias aware collaborative generative adversarial network for imbalanced deep learning in industrial iot. IEEE Transactions on Industrial Informatics, 19(1):570–580, 2023.Google Scholar
- Xiaokang Zhou, Wei Liang, Kevin I-Kai Wang, and Laurence T. Yang. Deep correlation mining based on hierarchical hybrid networks for heterogeneous big data recommendations. IEEE Transactions on Computational Social Systems, 8(1):171–178, 2021.Google ScholarCross Ref
- Wenchao Xia, Gan Zheng, Yongxu Zhu, Jun Zhang, Jiangzhou Wang, and Athina P. Petropulu. A deep learning framework for optimization of miso downlink beamforming. IEEE Transactions on Communications, 68(3):1866–1880, 2020.Google ScholarCross Ref
- Faris B. Mismar, Brian L. Evans, and Ahmed Alkhateeb. Deep reinforcement learning for 5g networks: Joint beamforming, power control, and interference coordination. IEEE Transactions on Communications, 68(3):1581–1592, 2020.Google ScholarCross Ref
- Jungang Ge, Ying-Chang Liang, Jingon Joung, and Sumei Sun. Deep reinforcement learning for distributed dynamic miso downlink-beamforming coordination. IEEE Transactions on Communications, 68(10):6070–6085, 2020.Google ScholarCross Ref
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature, 518(7540):529–533, February 2015.Google ScholarCross Ref
- Xiaokang Zhou, Wei Liang, Ke Yan, Weimin Li, Kevin I-Kai Wang, Jianhua Ma, and Qun Jin. Edge-enabled two-stage scheduling based on deep reinforcement learning for internet of everything. IEEE Internet of Things Journal, 10(4):3295–3304, 2023.Google ScholarCross Ref
- Daewon Lee, Hanbyul Seo, Bruno Clerckx, Eric Hardouin, David Mazzarese, Satoshi Nagata, and Krishna Sayana. Coordinated multipoint transmission and reception in lte-advanced: deployment scenarios and operational challenges. IEEE Communications Magazine, 50(2):148–155, 2012.Google ScholarCross Ref
- Mu Yan, Jian Yang, Keyu Chen, Yao Sun, and Gang Feng. Self-imitation learning-based inter-cell interference coordination in autonomous hetnets. IEEE Transactions on Network and Service Management, 18(4):4589–4601, 2021.Google ScholarCross Ref
- Michael Lin, Novella Bartolini, Michael Giallorenzo, and Thomas F. La Porta. On interference aware power adjustment and scheduling in femtocell networks. IEEE/ACM Trans. Netw., 28(2):736–749, apr 2020.Google ScholarDigital Library
- Yong Niu, Ziqi Feng, Min Chen, Yong Li, Zhangdui Zhong, and Bo Ai. Low complexity and robust codebook-based analog beamforming for millimeter wave mimo systems. IEEE Access, 5:19824–19834, 2017.Google ScholarCross Ref
- Ian P. Roberts, Hardik B. Jain, Sriram Vishwanath, and Jeffrey G. Andrews. Millimeter wave analog beamforming codebooks robust to self-interference. In 2021 IEEE Global Communications Conference (GLOBECOM), pages 1–6, 2021.Google ScholarCross Ref
- Zhenyu Xiao, Tong He, Pengfei Xia, and Xiang-Gen Xia. Hierarchical codebook design for beamforming training in millimeter-wave communication. IEEE Transactions on Wireless Communications, 15(5):3380–3392, 2016.Google ScholarDigital Library
- Sung-En Chiu, Nancy Ronquillo, and Tara Javidi. Active learning and csi acquisition for mmwave initial alignment. IEEE Journal on Selected Areas in Communications, 37(11):2474–2489, 2019.Google ScholarDigital Library
- P. Raviteja, Yi Hong, and Emanuele Viterbo. Analog beamforming with low resolution phase shifters. IEEE Wireless Communications Letters, 6(4):502–505, 2017.Google ScholarCross Ref
- Hongyu Li, Qian Liu, Zihuan Wang, and Ming Li. Transmit antenna selection and analog beamforming with low-resolution phase shifters in mmwave miso systems. IEEE Communications Letters, 22(9):1878–1881, 2018.Google ScholarCross Ref
- Foad Sohrabi, Zhilin Chen, and Wei Yu. Deep active learning approach to adaptive beamforming for mmwave initial alignment. IEEE Journal on Selected Areas in Communications, 39(8):2347–2360, 2021.Google ScholarCross Ref
- Xiaokang Zhou, Wei Liang, Kevin I-Kai Wang, Zheng Yan, Laurence T. Yang, Wei Wei, Jianhua Ma, and Qun Jin. Decentralized p2p federated learning for privacy-preserving and resilient mobile robotic systems. IEEE Wireless Communications, 30(2):82–89, 2023.Google ScholarDigital Library
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al. Human-level control through deep reinforcement learning. nature, 518(7540):529–533, 2015.Google Scholar
- Christopher JCH Watkins and Peter Dayan. Q-learning. Machine learning, 8(3):279–292, 1992.Google Scholar
- Yuto Teraki, Xiaoyan Wang, Masahiro Umehira, and Yusheng Ji. Deep reinforcement learning based usage aware spectrum access scheme. In 2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC), pages 1–6. IEEE, 2021.Google Scholar
- Hang Zhou, Xiaoyan Wang, Masahiro Umehira, Xianfu Chen, Celimuge Wu, and Yusheng Ji. Wireless access control in edge-aided disaster response: A deep reinforcement learning-based approach. IEEE Access, 9:46600–46611, 2021.Google ScholarCross Ref
- Ruijin Ding, Feifei Gao, and Xuemin Sherman Shen. 3d uav trajectory design and frequency band allocation for energy-efficient and fair communication: A deep reinforcement learning approach. IEEE Transactions on Wireless Communications, 19(12):7796–7809, 2020.Google ScholarCross Ref
- Nguyen Cong Luong, Dinh Thai Hoang, Shimin Gong, Dusit Niyato, Ping Wang, Ying-Chang Liang, and Dong In Kim. Applications of deep reinforcement learning in communications and networking: A survey. IEEE Communications Surveys & Tutorials, 21(4):3133–3174, 2019.Google ScholarDigital Library
- Faisal Naeem, Sattar Seifollahi, Zhenyu Zhou, and Muhammad Tariq. A generative adversarial network enabled deep distributional reinforcement learning for transmission scheduling in internet of vehicles. IEEE Transactions on Intelligent Transportation Systems, 22(7):4550–4559, 2021.Google ScholarDigital Library
- Yujie Yao, Hao Zhou, and Melike Erol-Kantarci. Deep reinforcement learning-based radio resource allocation and beam management under location uncertainty in 5g mmwave networks. arXiv preprint arXiv:2204.10984, 2022.Google Scholar
- Firas Fredj, Yasser Al-Eryani, Setareh Maghsudi, Mohamed Akrout, and Ekram Hossain. Distributed beamforming techniques for cell-free wireless networks using deep reinforcement learning. IEEE Transactions on Cognitive Communications and Networking, 8(2):1186–1201, 2022.Google ScholarCross Ref
- Qisheng Wang, Xiao Li, Shi Jin, and Yijian Chen. Hybrid beamforming for mmwave mu-miso systems exploiting multi-agent deep reinforcement learning. IEEE Wireless Communications Letters, 10(5):1046–1050, 2021.Google ScholarCross Ref
- Hang Zhou, Xiaoyan Wang, Masahiro Umehira, and Yusheng Ji. A deep reinforcement learning based analog beamforming approach in downlink miso systems. In 2022 IEEE 95th Vehicular Technology Conference:(VTC2022-Spring), pages 1–6. IEEE, 2022.Google Scholar
- James Adu Ansere, Mohsin Kamal, Eric Gyamfi, Frederick Sam, Muhammad Tariq, and Abbas Mohammed. Energy efficient resource optimization in cooperative internet of things networks. Internet of Things, 12:100302, 2020.Google ScholarCross Ref
- Faisal Naeem, Muhammad Tariq, and H. Vincent Poor. Sdn-enabled energy-efficient routing optimization framework for industrial internet of things. IEEE Transactions on Industrial Informatics, 17(8):5660–5667, 2021.Google ScholarCross Ref
- Min Dong, Lang Tong, and B.M. Sadler. Optimal insertion of pilot symbols for transmissions over time-varying flat fading channels. IEEE Transactions on Signal Processing, 52(5):1403–1418, 2004.Google ScholarDigital Library
- Jordi Borras, Francesc Molina, Roberto López-Valcarce, and Josep Sala-Álvarez. Energy-efficient analog beamforming with short packets in millimeter-wave mimo systems. In 2020 54th Asilomar Conference on Signals, Systems, and Computers, pages 439–444. IEEE, 2020.Google Scholar
- Geoffrey Hinton, Nitish Srivastava, and Kevin Swersky. Neural networks for machine learning lecture 6a overview of mini-batch gradient descent. Cited on, 14(8):2, 2012.Google Scholar
Recommendations
Coordinated beamforming for the multicell multi-antenna wireless system
In a conventional wireless cellular system, signal processing is performed on a per-cell basis; out-of-cell interference is treated as background noise. This paper considers the benefit of coordinating base-stations across multiple cells in a multi-...
Distributed Multicell Beamforming With Limited Intercell Coordination
This paper studies distributed optimization schemes for multicell joint beamforming and power allocation in time-division-duplex (TDD) multicell downlink systems where only limited-capacity intercell information exchange is permitted. With an aim to ...
Multi-Cell Random Beamforming: Achievable Rate and Degrees of Freedom Region
Random beamforming (RBF) is a practically favorable transmission scheme for multiuser multiantenna downlink systems since it requires only partial channel state information (CSI) at the transmitter. Under the conventional single-cell setup, RBF is known ...
Comments