Audification and sonification of texture in images

Antonio C. G. Martins; Rangaraj M. Rangayyan; Ruggero Andrea Ruschioni

doi:10.1117/1.1382811

1 July 2001 Audification and sonification of texture in images

Antonio C. G. Martins, Rangaraj M. Rangayyan, Ruggero Andrea Ruschioni

Journal of Electronic Imaging, Vol. 10, Issue 3, (July 2001). https://doi.org/10.1117/1.1382811

Texture is one of the main image attributes used for visual and computer-aided pattern recognition in several areas. However, texture analysis is often confounded by other neighboring or surrounding features. The auditory system has not been used much for image analysis in spite of the fact that it has several advantages over the visual system. We explore in this article the potential of auditory display procedures, including audification and sonification, for aural presentation and analysis of texture in images. We first draw an analogy between random/periodic texture and unvoiced/ voiced speech in terms of their generation based on filtering of an excitation function. An audification procedure that consists of playing in sequence the projections of the given image at several angles is then proposed. A linear prediction model is used to generate the sound signal from the projection data. Also presented is a sonification procedure to convert periodic texture to sound with the emphasis on displaying the essential features of the texture element and periodicity. In order to verify the potential of the proposed methods for aural analysis of texture, a set of pilot experiments was designed and presented to 10 subjects. The results indicate that the proposed methods can facilitate qualitative and comparative analysis of texture. The methods could lead to the use of auditory display of images as an adjunctive procedure to visualization.

©(2001) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Antonio C. G. Martins, Rangaraj M. Rangayyan, and Ruggero Andrea Ruschioni "Audification and sonification of texture in images," Journal of Electronic Imaging 10(3), (1 July 2001). https://doi.org/10.1117/1.1382811

Published: 1 July 2001

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available