AIoT-based drum transcription robot using convolutional neural networks

Yang Yi; Ming Lu; Lianghong Wu; Zuguo Chen

doi:10.1117/12.2627208

14 February 2022 AIoT-based drum transcription robot using convolutional neural networks

Yang Yi, Ming Lu, Lianghong Wu, Zuguo Chen

Proceedings Volume 12161, 4th International Conference on Informatics Engineering & Information Science (ICIEIS2021); 121610G (2022) https://doi.org/10.1117/12.2627208
Event: 4th International Conference on Informatics Engineering and Information Science, 2021, Tianjin, China

Abstract

With the development of information technology, robot technology has made great progress in various fields. These new technologies enable robots to be used in industry, agriculture, education and other aspects. In this paper, we propose a drum robot that can automatically complete music transcription in real-time, which is based on AIoT and fog computing technology. Specifically, this drum robot system consists of a cloud node for data storage, edge nodes for real-time computing, and data-oriented execution application nodes. In order to analyze drumming music and realize drum transcription, we further propose a light-weight convolutional neural network model to classify drums, which can be more effectively deployed in terminal devices for fast edge calculations. The experimental results show that the proposed system can achieve more competitive performance and enjoy a variety of smart applications and services.

Citation Download Citation

Yang Yi, Ming Lu, Lianghong Wu, and Zuguo Chen "AIoT-based drum transcription robot using convolutional neural networks", Proc. SPIE 12161, 4th International Conference on Informatics Engineering & Information Science (ICIEIS2021), 121610G (14 February 2022); https://doi.org/10.1117/12.2627208

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available