Skip to main content

DRL-Based Optimization Algorithm for Wireless Powered IoT Network

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14491))

  • 107 Accesses

Abstract

The extensive applications of Internet of Things (IoT) bring development and prosperity to multiple industries and greatly influent all aspects of human lives, which rely on the timely computation and communication. However, the limited battery and computing capacity of the common IoT units cannot satisfy the need of processing computation intensive and time sensitive tasks. As a result, the combination of wireless power transmission (WPT) and mobile edge computing (MEC) provides a promising approach of dealing with aforementioned problems. The Hybrid Access Point (HAP) transmits radio frequency (RF) energy to provide power transmission for wireless devices (WDs), and processes tasks offloaded from WDs with the equipped edge computing servers (ECSs). In this paper, we consider a wireless powered mobile edge computing network containing an HAP, multiple WDs. By jointly optimizing energy transmission time duration, partial offloading decisions and transmission power allocation strategy, we obtain the maximum of the sum computation rate (SCR). Firstly, we formulate this as a non-convex problem which is hard to address. Secondly, we decompose the problem into a top-problem of optimizing the energy transmission time duration and a sub-problem of optimizing the partial offloading decisions and transmission power allocation strategy. Finally, we design a DRL-based offloading algorithm, which applies a DNN network with exploring and updating strategy, to address the top-problem and propose an effective optimizing algorithm to address the sub-problem. Extensive numerical results reveal that the proposed algorithm reaches near-optimal SCR and greatly reduces time latency and complexity compared to benchmark algorithms.

Supported by organization x.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zeng, M., Du, R., Fodor, V., Fischione, C.: Computation rate maximization for wireless powered mobile edge computing with Noma. In: IEEE 20th International Symposium on" A World of Wireless, Mobile and Multimedia Networks (WoWMoM), pp. 1–9. IEEE (2019)

    Google Scholar 

  2. Zhang, S. Gu, H., Chi, K., Huang, L., Yu, K., Mumtaz, S.: DRL-based partial offloading for maximizing sum computation rate of wireless powered mobile edge computing network. IEEE Trans. Wireless Commun. 21(12), 10:934–10:948 (2022)

    Google Scholar 

  3. Xu, C., Zhan, C., Liao, J., Gong, J.: Computation throughput maximization for UAV-enabled MEC with binary computation offloading. In: ICC 2022-IEEE International Conference on Communications, pp. 4348–4353. IEEE (2022)

    Google Scholar 

  4. Chen, S., Rui, L., Gao, Z., Li, W., Qiu, X.: Cache-assisted collaborative task offloading and resource allocation strategy: a metareinforcement learning approach. IEEE Internet of Things J. 9(20), 19:823–19:842 (2022)

    Google Scholar 

  5. Bi, S., Zhang, Y.J.: Computation rate maximization for wireless powered mobile-edge computing with binary computation offloading. IEEE Trans. Wireless Commun. 17(6), 4177–4190 (2018)

    Article  Google Scholar 

  6. Huang, L., Bi, S., Zhang, Y.-J.A.: Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks. IEEE Trans. Mob. Comput. 19(11), 2581–2593 (2019)

    Article  Google Scholar 

  7. Nguyen, P.X., et al.: Backscatter-assisted data offloading in OFDMA-based wireless-powered mobile edge computing for IoT networks. IEEE Internet Things J. 8(11), 9233–9243 (2021)

    Article  Google Scholar 

  8. Mao, S., et al.: Computation rate maximization for intelligent reflecting surface enhanced wireless powered mobile edge computing networks. IEEE Trans. Vehic. Technol. 70(10), 10:820–10:831 (2021)

    Google Scholar 

  9. Wu, X., He, Y., Saleem, A.: Computation rate maximization in multi-user cooperation-assisted wireless-powered mobile edge computing with OFDMA. China Commun. 20(1), 218–229 (2023)

    Article  Google Scholar 

  10. Ren, C., Zhang, G., Gu, X., Li, Y.: Computing offloading in vehicular edge computing networks: Full or partial offloading? In: IEEE 6th Information Technology and Mechatronics Engineering Conference (ITOEC), vol. 6, pp. 693–698. IEEE (2022)

    Google Scholar 

  11. Bi, J., Yuan, H., Duanmu, S., Zhou, M., Abusorrah, A.: Energy-optimized partial computation offloading in mobile-edge computing with genetic simulated-annealing-based particle swarm optimization. IEEE Internet Things J. 8(5), 3774–3785 (2020)

    Article  Google Scholar 

  12. Li, Y., Zhang, X., Sun, Y., Liu, J., Lei, B., Wang, W.: Joint offloading and resource allocation with partial information for multi-user edge computing. In: IEEE Globecom Workshops (GC Wkshps), pp. 1736–1741. IEEE (2022)

    Google Scholar 

  13. Saleem, U., Liu, Y., Jangsher, S., Tao, X., Li, Y.: Latency minimization for D2D-enabled partial computation offloading in mobile edge computing. IEEE Trans. Veh. Technol. 69(4), 4472–4486 (2020)

    Article  Google Scholar 

  14. Guo, M., Wang, W., Huang, X., Chen, Y., Zhang, L., Chen, L.: Lyapunov-based partial computation offloading for multiple mobile devices enabled by harvested energy in MEC. IEEE Internet Things J. 9(11), 9025–9035 (2021)

    Article  Google Scholar 

  15. Feng, J., Pei, Q., Yu, F.R., Chu, X., Shang, B.: Computation offloading and resource allocation for wireless powered mobile edge computing with latency constraint. IEEE Wireless Commun. Lett. 8(5), 1320–1323 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shubin Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhu, M., Zhang, S., Chi, K. (2024). DRL-Based Optimization Algorithm for Wireless Powered IoT Network. In: Tari, Z., Li, K., Wu, H. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2023. Lecture Notes in Computer Science, vol 14491. Springer, Singapore. https://doi.org/10.1007/978-981-97-0808-6_11

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-0808-6_11

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-0807-9

  • Online ISBN: 978-981-97-0808-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics