Abstract
The placement of operators in Complex Event Processing (CEP) services, handling real-time data with DAGs, faces challenges due to the NP-hard nature and edge environment complexity. Prior research by Cai et al. used a predictive and greedy approach to minimize delay during placement, but it degrades with increased node count or event rate fluctuations. We propose a novel approach for CEP operator placement using response time feedback to adapt to the dynamic edge environment. We formulate the problem as a Markov Decision Process and use reinforcement learning for optimal policy learning. Our objective is to minimize total response time in edge environments. Extensive simulations evaluate our approach, which outperforms the greedy method with a 25% average reduction in response time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Behrisch, M., Bieker, L., Erdmann, J., Krajzewicz, D.: SUMO-simulation of urban mobility: an overview. In: Proceedings of SIMUL 2011, The Third International Conference on Advances in System Simulation. ThinkMind (2011)
Cai, X., Kuang, H., Hu, H., Song, W., Lü, J.: Response time aware operator placement for complex event processing in edge computing. In: Pahl, C., Vukovic, M., Yin, J., Yu, Q. (eds.) ICSOC 2018. LNCS, vol. 11236, pp. 264–278. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-03596-9_18
Hong, K., Lillethun, D.J., Ramachandran, U., Ottenwalder, B., Koldehofe, B.: Opportunistic spatio-temporal event processing for mobile situation awareness. In: Proceedings of the 7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013, pp. 195–206 (2013)
Jia, M., Liang, W., Xu, Z., Huang, M.: Cloudlet load balancing in wireless metropolitan area networks. In: IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications, pp. 1–9 (2016)
Jiang, J., Lu, Z.: Generative exploration and exploitation. CoRR abs/1904.09605 (2019). http://arxiv.org/abs/1904.09605
Liu, D., et al.: Data-flow graph mapping optimization for CGRA with deep reinforcement learning. IEEE Trans. CAD Integr. Circ. Syst. 38(12), 2271–2283 (2019)
Mirhoseini, A., et al.: Device placement optimization with reinforcement learning. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6–11 August 2017, pp. 2430–2439 (2017). http://proceedings.mlr.press/v70/mirhoseini17a.html
Ottenwalder, B., Koldehofe, B., Rothermel, K., Hong, K., Lillethun, D.J., Ramachandran, U.: MCEP: a mobility-aware complex event processing system. ACM Trans. Internet Technol. 14(1), 6 (2014)
Pietzuch, P.R., Ledlie, J., Shneidman, J., Roussopoulos, M., Welsh, M., Seltzer, M.I.: Network-aware operator placement for stream-processing systems. In: 22nd International Conference on Data Engineering (ICDE 2006), p. 49 (2006)
Rizou, S., Durr, F., Rothermel, K.: Solving the multi-operator placement problem in large-scale operator networks. In: 2010 Proceedings of 19th International Conference on Computer Communications and Networks, pp. 1–6 (2010)
Salaht, F.A., Desprez, F., Lebre, A.: An overview of service placement problem in fog and edge computing. ACM Comput. Surv. 53(3), 1–35 (2020)
Satyanarayanan, M.: The emergence of edge computing. Computer 50(1), 30–39 (2017)
Saurez, E., Hong, K., Lillethun, D., Ramachandran, U., Ottenwalder, B.: Incremental deployment and migration of geo-distributed situation awareness applications in the fog. In: Proceedings of the 10th ACM International Conference on Distributed and Event-Based Systems, DEBS 2016, pp. 258–269. ACM (2016)
Sutton, R.S., Barto, A.G.: Reinforcement Learning - An Introduction. Adaptive Computation and Machine Learning. MIT Press, Cambridge (1998)
Tesauro, G.: Temporal difference learning and TD-Gammon. Commun. ACM 38(3), 58–68 (1995)
Tsitsiklis, J.N., Van Roy, B.: An analysis of temporal-difference learning with function approximation. IEEE Trans. Autom. Control (2002)
Tziritas, N., Loukopoulos, T., Khan, S.U., Xu, C.Z., Zomaya, A.Y.: On improving constrained single and group operator placement using evictions in big data environments. IEEE Trans. Serv. Comput. 9(5), 818–831 (2016)
Varga, A., Hornig, R.: An overview of the OMNeT++ simulation environment, p. 60 (2008)
Yue, X., Shi, L., Zhao, Y., Ji, H., Wang, G.: Online runtime prediction method for distributed iterative jobs. In: Xing, C., Fu, X., Zhang, Y., Zhang, G., Borjigin, C. (eds.) WISA 2021. LNCS, vol. 12999, pp. 156–168. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87571-8_14
Zabihi, Z., Moghadam, A.M.E., Rezvani, M.H.: Reinforcement learning methods for computing offloading: a systematic review. ACM Comput. Surv. (2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Hu, H., Kuang, H., Fan, C., Wang, L., Tao, X. (2023). RL-Based CEP Operator Placement Method on Edge Networks Using Response Time Feedback. In: Yuan, L., Yang, S., Li, R., Kanoulas, E., Zhao, X. (eds) Web Information Systems and Applications. WISA 2023. Lecture Notes in Computer Science, vol 14094. Springer, Singapore. https://doi.org/10.1007/978-981-99-6222-8_47
Download citation
DOI: https://doi.org/10.1007/978-981-99-6222-8_47
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6221-1
Online ISBN: 978-981-99-6222-8
eBook Packages: Computer ScienceComputer Science (R0)
