Skip to main content
Log in

Integration of Synergetic IoT Applications with Heterogeneous Format Data for Interoperability Using IBM ACE

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Data interoperability is a crucial requirement in IoT to improve services and enhance business opportunities and innovation. Integrating synergetic applications with heterogeneous data formats is a critical issue that needs to be addressed to achieve interoperability. The use cases indicate IBM ACE is promising in resolving integration issues among on-premises and cloud applications. Further, many efforts are observed to address the interoperability issue apart from the IBM ACE approach. However, they are complex, restricted to few data formats, and use proprietary solutions. To address these above-mentioned issues, this paper proposes the Integration of Synergetic IoT applications with Heterogeneous format data for Interoperability using IBM ACE (ISHII). Further, an intelligence-based data recognition module in the proposed ISHII is trained with standard features defined in RFC 7111, 8259, 8996, JSON-LD of W3C, and Google’s Protobuf. Subsequently, recognized heterogeneous format data are integrated and translated to interoperable format using Data Format Description Language (DFDL) with Extended SQL codes on IBM ACE. Finally, the performance of ISHII has been evaluated with synthetically generated patient monitoring and room ambiance datasets with reference to accuracy, time required for integration, and translation efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

All data generated or analyzed during this study are included in this published article. Methods to generate the dataset are mentioned in the article. A sample dataset is presented in the article.

Notes

  1. https://www.w3schools.com/whatis/whatis_json.asp.

  2. https://www.javatpoint.com/what-is-xml.

  3. https://docs.fileformat.com/spreadsheet/csv/.

  4. https://www.k2view.com/platform/data-integration-tools/.

  5. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=model-data-format-description-language-dfdl.

  6. https://www.tutorialspoint.com/sap/sap_introduction.htm.

  7. https://en.wikipedia.org/wiki/Salesforce.

  8. https://www.ibm.com/docs/en/integration-bus?topic=SSMKHH/mapfiles/product_welcome.html.

  9. https://kafka.apache.org/.

  10. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=nodes-creating-integration-node.

  11. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=servers-creating-integration-server.

  12. https://www.ibm.com/docs/en/app-connect/12.0?topic=overview-app-connect-enterprise-web-user-interface.

  13. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=flows-message-overview.

  14. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=overview-app-connect-enterprise-toolkit.

  15. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=overview-app-connect-enterprise-web-user-interface.

  16. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=solutions-creating-bar-file.

  17. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=model-data-format-description-language-dfdl.

  18. https://media.datadirect.com/download/docs/xmlconverters/java/readme/readme.htm.

  19. https://daffodil.apache.org/.

  20. https://json-ld.org/.

  21. https://cloud.google.com/apis/design/proto3.

  22. https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html.

  23. https://www.ibm.com/docs/en/integration-bus/10.0?topic=esql-overview.

References

  1. Kung A, Gyrard A. IOT systems and interoperability. 2023. https://doi.org/https://www.trialog.com/en/iot-systems-and-interoperability/. Accessed 19 July 2023.

  2. Gonzalez-Usach R, Palau CE, Julian M, Belsa A, Llorente MA, Montesinos M, Ganzha M, Wasielewska K, Sala P. Next generation internet of things–distributed intelligence at the edge and human- machine interactions. River Publishers, 2022; p. 139–73.

  3. Petrasch RJ, Petrasch RR. Data integration and interoperability: towards a model-driven and pattern-oriented approach. Modelling. 2022;3(1):105–26.

    Article  Google Scholar 

  4. Balakrishna S, Thirumaran M, Solanki V. IoT sensor data integration in healthcare using semantics and machine learning approaches, pp. 275–300. 2019. https://doi.org/10.1007/978-3-030-23983-1_11

  5. Mehta Y. Data integration in the Internet of Things (IoT) ecosystem | IoT Now News & Reports. 2022. https://www.iot-now.com/2022/02/23/119714-data-integration-in-the-internet-of-things-iot-ecosystem/. Accessed 19 July 2023.

  6. What is interoperability in healthcare? 2023. https://doi.org/https://www.ibm.com/in-en/topics/interoperability-in-healthcare. Accessed 19 July 2023.

  7. Phan L-A, Kim T. Breaking down the compatibility problem in smart homes: a dynamically updatable gateway platform. Sensors. 2020;20:2783. https://doi.org/10.3390/s20102783.

    Article  Google Scholar 

  8. Informatica: What is data integration. 2023. https://www.informatica.com/resources/articles/what-is-data-integration.html. Accessed 19 July 2023.

  9. K2View: data integration tools | K2View. https://doi.org/https://www.k2view.com/platform/data-integration-tools/. Accessed 19 July 2023.

  10. Gartner I. K2View data product platform review in data integration tools. 2022. https://www.gartner.com/reviews/market/data-integration-tools/vendor/k2view/product/k2view-data-product-platform/review/view/4098826. Accessed 19 July 2023.

  11. Varma O. What is data transformation?: A comprehensive guide 101. 2020. https://hevodata.com/learn/what-is-data-transformation/. Accessed 19 July 2023.

  12. IBM App Connect Enterprise introduction. IBM. 2023. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=overview-app-connect-enterprise-introduction. Accessed 19 July 2023.

  13. IBM App Connect Enterprise software. 2023. https://www.ibm.com/docs/en/app-connect/11.0.0?topic=app-connect-enterprise-software. Accessed 19 July 2023.

  14. Backlund N. Implementing amazon web services integration connector with IBM app connect enterprise. 2023. https://doi.org/https://urn.fi/URN:NBN:fi:amk-2020100520985. Accessed 19 July 2023.

  15. Integrating ERP and CRM Applications with IBM WebSphere Cast Iron | IBM Redbooks. 2013. https://www.redbooks.ibm.com/Redbooks.nsf/RedbookAbstracts/tips0961.html?Open. Accessed 19 July 2023.

  16. Cloud data mashups using IBM App Connect. IBM. 2023. https://www.ibm.com/docs/en/app-connect/cloud?topic=cases-cloud-data-mashups-using-app-connect. Accessed 19 July 2023.

  17. Cloud data migration using IBM App Connect. IBM. 2023. https://www.ibm.com/docs/en/app-connect/cloud?topic=cases-cloud-data-migration-using-app-connect. Accessed 19 July 2023.

  18. Cloud data synchronization using IBM App Connect. IBM. 2023. https://www.ibm.com/docs/en/app-connect/cloud?topic=cases-cloud-data-synchronization-using-app-connect. Accessed 19 July 2023.

  19. OData APIs and connectivity using IBM App Connect. 2023. https://www.ibm.com/docs/en/app-connect/cloud?topic=cases-odata-apis-connectivity-using-app-connect. Accessed 19 July 2023.

  20. Gonzalez-Usach R, Julian M, Esteve M, Palau C. Federation of aal & aha systems through semantically interoperable framework. In: 2021 IEEE International Conference on Communications Workshops (ICC Workshops); 2021, p. 1–6. https://doi.org/10.1109/ICCWorkshops50388.2021.9473503

  21. Jaleel A, Mahmood T, Hassan MA, Bano G, Khurshid SK. Towards medical data interoperability through collaboration of healthcare devices. IEEE Access. 2020;8:132302–19.

    Article  Google Scholar 

  22. Ahmed A, Kleiner M, Roucoules L. Model-based interoperability IOT hub for the supervision of smart gas distribution networks. IEEE Syst J. 2018;13(2):1526–33.

    Article  Google Scholar 

  23. Modoni GE, Caldarola EG, Mincuzzi N, Sacco M, Wasielewska K, Szmeja P, Ganzha M, Paprzycki M, Pawłowski W. Integrating IOT platforms using the inter-IOT approach: a case study of the casaware project. J Ambient Intell Smart Environ. 2020;12(6):457–74.

    Article  Google Scholar 

  24. Singh M, Wu W, Rizou S, Vakaj E. Data information interoperability model for IOT-enabled smart water networks. In: 2022 IEEE 16th International Conference on Semantic Computing (ICSC), IEEE; 2022, p. 179–186.

  25. Ballard C, Bhat V, Choudhary S, Ravindranath R, Ruiz EA, Titus A. InfoSphere datastage for enterprise XML data integration. 2012. https://www.redbooks.ibm.com/redbooks/pdfs/sg247987.pdf.

  26. Derhamy H, Eliasson J, Delsing J, Priller P. A survey of commercial frameworks for the internet of things. In: 2015 IEEE 20th Conference on Emerging Technologies & Factory Automation (etfa), IEEE; 2015, p. 1–8.

  27. JSON-LD 1.1. 2020. https://www.w3.org/TR/json-ld11/. Accessed 19 July 2023.

  28. Protocol Buffers. 2023. https://protobuf.dev/. Accessed 19 July 2023.

  29. Shafranovich Y. Common format and MIME type for comma-separated values (CSV) files. RFC Editor. 2005. https://doi.org/10.17487/RFC4180. https://www.rfc-editor.org/info/rfc4180

  30. Bray T. The JavaScript Object Notation (JSON) Data Interchange Format. RFC Editor. 2017. https://doi.org/10.17487/RFC8259. https://www.rfc-editor.org/info/rfc8259

  31. Moriarty K, Farrell S. Deprecating TLS 1.0 and TLS 1.1. RFC Editor. 2021. https://doi.org/10.17487/RFC8996. https://www.rfc-editor.org/info/rfc8996

  32. Lindsey H. What are vital signs, and what can they tell us about our health?. 2022. https://www.healthline.com/health/what-are-vital-signs. Accessed 19 July 2023.

  33. DiGiacinto J, Seladi-Schulman J. Normal vs. dangerous heart rate: How to tell the difference. Heathline. 2022. https://doi.org/https://www.healthline.com/health/dangerous-heart-rate. Accessed 19 July 2023.

  34. Sharma S, Hashmi MF. Hypotension. [Updated 2022 Feb 16]. 2022. https://www.ncbi.nlm.nih.gov/books/NBK499961/. Accessed 19 July 2023.

  35. Walker HK, Hall WD, Hurst JW. Clinical methods: the history, physical, and laboratory examinations,chapter—218. 1990. https://doi.org/https://www.ncbi.nlm.nih.gov/books/NBK331/.

  36. Shaikh J. MD: what are blood oxygen levels by age? Chart, normal, high & low. 2022. Accessed 19 July 2023.

  37. Holland K. Is my blood oxygen level normal?. 2022. https://www.healthline.com/health/normal-blood-oxygen-level. Accessed 19 July 2023.

  38. what is the ideal room temperature?. 2022. https://www.vaillant.co.uk/homeowners/advice-and-knowledge/what-is-the-ideal-room-temperature-1769698.html. Accessed 19 July 2023.

  39. Bannister M. How humidity damages home. Airthings. 2021. https://www.airthings.com/resources/home-humidity-damage. Accessed 19 July 2023.

  40. Sinaga KP, Yang M-S. Unsupervised k-means clustering algorithm. IEEE Access. 2020;8:80716–27. https://doi.org/10.1109/ACCESS.2020.2988796.

    Article  Google Scholar 

  41. Müllner D. Modern hierarchical, agglomerative clustering algorithms. 2011. arXiv:1109.2378.

  42. Sharma P. What is hierarchical clustering in python Analytics Vidhya (2023). https://doi.org/https://www.analyticsvidhya.com/blog/2019/05/beginners-guide-hierarchical-clustering/. Accessed 19 July 2023.

  43. Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: applications, challenges and trends. Neurocomputing. 2020;408:189–215.

    Article  Google Scholar 

  44. Cunningham P, Delany SJ. k-nearest neighbour classifiers—a tutorial. ACM Comput Surv (CSUR). 2021;54(6):1–25.

    Article  Google Scholar 

  45. Charbuty B, Abdulazeez A. Classification based on decision tree algorithm for machine learning. J Appl Sci Technol Trends. 2021;2(01):20–8.

    Article  Google Scholar 

  46. Biau G, Scornet E. A random forest guided tour. Test. 2016;25:197–227.

    Article  MathSciNet  MATH  Google Scholar 

  47. Cutler A, Cutler DR, Stevens JR. Random forests. In: Ensemble machine learning: methods and applications. 2012. p. 157–75.

  48. Bi Z-j, Han Y-q, Huang C-q, Wang M. Gaussian naive bayesian data classification model based on clustering algorithm. In: 2019 International Conference on Modeling, Analysis, Simulation Technologies and Applications (MASTA 2019). Atlantis Press; 2019, p. 396–400.

  49. Guest_blog: Introduction to XGBOOST Algorithm in Machine Learning. Analytics Vidhya. 2023. https://doi.org/https://www.analyticsvidhya.com/blog/2018/09/an-end-to-end-guide-to-understand-the-math-behind-xgboost/. Accessed 19 July 2023

Download references

Funding

The authors did not receive support from any organization for the submitted work. No funding was received to assist with the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Sandeep.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Infomed consent

Has followed ethical standards, and no conflict of interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Research Trends in Computational Intelligence” guest edited by Anshul Verma, Pradeepika Verma, Vivek Kumar Singh and S. Karthikeyan.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sandeep, M., Chandavarkar, B.R. Integration of Synergetic IoT Applications with Heterogeneous Format Data for Interoperability Using IBM ACE. SN COMPUT. SCI. 5, 3 (2024). https://doi.org/10.1007/s42979-023-02279-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-023-02279-x

Keywords

Navigation