Yoichi Ochiai
Takayuki Hoshi
Jun Rekimoto
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We propose a novel graphics system based on the expansion of 3D acoustic-manipulation technology. In conventional research on acoustic levitation, small objects are trapped in the acoustic beams of standing waves. We expand this method by changing the distribution of the acoustic-potential field (APF). Using this technique, we can generate the graphics using levitated small objects. Our approach makes available many expressions, such as the expression by materials and non-digital appearance. These kinds of expressions are used in many applications, and we aim to combine them with digital controllability. In the current system, multiple particles are levitated together at 4.25-mm intervals. The spatial resolution of the position is 0.5 mm. Particles move at up to 72 cm/s. The allowable density of the material can be up to 7 g/cm3. For this study, we use three options of APF: 2D grid, high-speed movement, and combination with motion capture. These are used to realize floating screen or mid-air raster graphics, mid-air vector graphics, and interaction with levitated objects. This paper reports the details of the acoustic-potential field generator on the design, control, performance evaluation, and exploration of the application space. To discuss the various noncontact manipulation technologies in a unified manner, we introduce a concept called "computational potential field" (CPF).
Supplemental Material
- Barnum, P. C., Narasimhan, S. G., and Kanade, T. 2010. A multi-layered display with water drops. ACM Trans. Graph. 29, 4 (July), 76:1--76:7. Google Scholar
Digital Library
- Brandt, E. H. 1989. Levitation in physics. Science 243, 4889, 349--55.Google Scholar
- Carter, T., Seah, S. A., Long, B., Drinkwater, B., and Subramanian, S. 2013. Ultrahaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '13, 505--514. Google ScholarDigital Library
- Cossairt, O., Napoli, J., Hill, S., Dorval, R., and Favalora, G. 2007. Occlusion-capable multiview volumetric three-dimensional display. Applied Optics 46, 8, 1244--1250.Google ScholarCross Ref
- Follmer, S., Leithinger, D., Olwal, A., Hogge, A., and Ishii, H. 2013. inform: Dynamic physical affordances and constraints through shape and object actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '13, 417--426. Google ScholarDigital Library
- Foresti, D., Nabavi, M., Klingauf, M., Ferrari, A., and Poulikakos, D. 2013. Acoustophoretic contactless transport and handling of matter in air. Proceedings of the National Academy of Sciences.Google Scholar
- Goldstein, S. C., Campbell, J. D., and Mowry, T. C. 2005. Programmable matter. IEEE Computer 38, 6 (June), 99--101. Google ScholarDigital Library
- Gor'kov, L. P. 1962. On the forces acting on a small particle in an acoustical field in an ideal fluid. Soviet Physics Doklady 6, 773--775.Google Scholar
- Heiner, J. M., Hudson, S. E., and Tanaka, K. 1999. The information percolator: Ambient information display in a decorative object. In Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '99, 141--148. Google ScholarDigital Library
- Hoshi, T., Takahashi, M., Iwamoto, T., and Shinoda, H. 2010. Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Transactions on Haptics 3, 3, 155--165. Google ScholarDigital Library
- Hoshi, T. 2012. Compact ultrasound device for noncontact interaction. In Advances in Computer Entertainment, Springer, A. Nijholt, T. Romao, and D. Reidsma, Eds., vol. 7624 of Lecture Notes in Computer Science, 502--505. Google ScholarDigital Library
- Ishii, H., and Ullmer, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '97, 234--241. Google ScholarDigital Library
- Ishii, H., Lakatos, D., Bonanni, L., and Labrune, J.-B. 2012. Radical atoms: Beyond tangible bits, toward transformable materials. interactions 19, 1 (Jan.), 38--51. Google ScholarDigital Library
- Iwaki, S., Morimasa, H., Noritsugu, T., and Kobayashi, M. 2011. Contactless manipulation of an object on a plane surface using multiple air jets. In ICRA, IEEE, 3257--3262.Google Scholar
- Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. 2001. Project feelex: Adding haptic surface to graphics. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '01, 469--476. Google ScholarDigital Library
- Jones, A., McDowall, I., Yamada, H., Bolas, M., and Debevec, P. 2007. Rendering for an interactive 360° light field display. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Kimura, H., Asano, A., Fujishiro, I., Nakatani, A., and Watanabe, H. 2011. True 3d display. In ACM SIGGRAPH 2011 Emerging Technologies, ACM, New York, NY, USA, SIGGRAPH '11, 20:1--20:1. Google ScholarDigital Library
- Kono, M., Kakehi, Y., and Hoshi, T., 2013. lapillus bug. SIGGRAPH Asia 2013 Art Gallery.Google Scholar
- Kozuka, T., Yasui, K., Tuziuti, T., Towata, A., and Iida, Y. 2007. Noncontact acoustic manipulation in air. Japanese Journal of Applied Physics 46, 7S, 4948.Google ScholarCross Ref
- Landis, H., 2013. Spaxels. Ars Electronica 2013.Google Scholar
- Lee, C., DiVerdi, S., and Hollerer, T. 2009. Depth-fused 3d imagery on an immaterial display. IEEE Trans. Vis. Comput. Graph. 15, 1, 20--33. Google ScholarDigital Library
- Lee, J., Post, R., and Ishii, H. 2011. Zeron: Mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '11, 327--336. Google ScholarDigital Library
- Marshall, M., Carter, T., Alexander, J., and Subramanian, S. 2012. Ultra-tangibles: Creating movable tangible objects on interactive tables. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '12, 2185--2188. Google ScholarDigital Library
- Nakamura, M., Inaba, G., Tamaoki, J., Shiratori, K., and Hoshino, J. 2006. Mounting and application of bubble display system: Bubble cosmos. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACM, New York, NY, USA, ACE '06. Google ScholarDigital Library
- Nijholt, A., Giusti, L., Minuto, A., and Marti, P. 2012. Smart material interfaces: "a material step to the future". In Proceedings of the 1st Workshop on Smart Material Interfaces: A Material Step to the Future, ACM, New York, NY, USA, SMI '12, 1:1--1:3. Google ScholarDigital Library
- Nyborg, W. L. 1967. Radiation pressure on a small rigid sphere. Journal of Acoustical Society of America 42, 947--952.Google ScholarCross Ref
- Ochiai, Y., Hoshi, T., Oyama, A., and Rekimoto, J. 2013. Poppable display: A display that enables popping, breaking, and tearing interactions with people. In Consumer Electronics (GCCE), 2013 IEEE 2nd Global Conference on, 124--128.Google Scholar
- Ochiai, Y., Hoshi, T., and Rekimoto, J. 2014. Three-dimensional mid-air acoustic manipulation by ultrasonic phased arrays. PLoS ONE 9, 5, e97590.Google ScholarCross Ref
- Perlin, K., and HAN, J., 2006. Volumetric display with dust as the participating medium, Feb. 14. US Patent 6,997,558.Google Scholar
- Poupyrev, I., Nashida, T., Maruyama, S., Rekimoto, J., and Yamaji, Y. 2004. Lumen: Interactive visual and shape display for calm computing. In ACM SIGGRAPH 2004 Emerging Technologies, ACM, New York, NY, USA, SIGGRAPH '04, 17--. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., and Okabe, M. 2007. Actuation and tangible user interfaces: the vaucanson duck, robots, and shape displays. In Tangible and Embedded Interaction, ACM, B. Ullmer and A. Schmidt, Eds., 205--212. Google ScholarDigital Library
- Rakkolainen, I., DiVerdi, S., Olwal, A., Candussi, N., Hüllerer, T., Laitinen, M., Piirto, M., and Palovuori, K. 2005. The interactive fogscreen. In ACM SIGGRAPH 2005 Emerging Technologies, ACM, New York, NY, USA, SIGGRAPH '05. Google ScholarDigital Library
- Sodhi, R., Poupyrev, I., Glisson, M., and Israr, A. 2013. Aireal: Interactive tactile experiences in free air. ACM Trans. Graph. 32, 4 (July), 134:1--134:10. Google ScholarDigital Library
- TOCHKA. Tochka. http://tochka.jp/ Last accessed on 30 April 2013.Google Scholar
- Weber, R., Benmore, C., Tumber, S., Tailor, A., Rey, C., Taylor, L., and Byrn, S. 2012. Acoustic levitation: recent developments and emerging opportunities in biomaterials research. European Biophysics Journal 41, 4, 397--403.Google ScholarCross Ref
- Wetzstein, G., Lanman, D., Heidrich, W., and Raskar, R. 2011. Layered 3d: Tomographic image synthesis for attenuation-based light field and high dynamic range displays. ACM Trans. Graph. 30, 4 (July), 95:1--95:12. Google ScholarDigital Library
- Whymark, R. 1975. Acoustic field positioning for containerless processing. Ultrasonics 13, 6, 251--261.Google ScholarCross Ref
- Xie, W. J., Cao, C. D., Lu, Y., Hong, Z. Y., and Wei, B. 2006. Acoustic method for levitation of small living animals. Applied Physics Letters 89, 21 (Nov), 214102-214102-3.Google ScholarCross Ref
Index Terms
- Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field
Recommendations
Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field
SIGGRAPH '14: ACM SIGGRAPH 2014 Emerging TechnologiesIn this study, we demonstrate real-world-oriented computer graphics by using and expanding 3D acoustic manipulation [Ochiai et al. 2014]. An acoustic potential field (APF) is generated and controlled in order to levitate and manipulate small objects (...
Learning-based acoustic displacement field modeling and micro-particle control
AbstractAcoustic manipulation has emerged as a promising microtarget control method with potential applications in microchip assembly, noncontact control of chemical materials, and cell control. However, the precision of acoustic micro-/nano-manipulation ...
Highlights- Micro target control can be achieved using acoustic manipulation technology.
- Neuronal network is applied to model and predict the displacement field.
- Frequency determination algorithm based on the predicted model is designed to ...
BitDrones: Towards Using 3D Nanocopter Displays as Interactive Self-Levitating Programmable Matter
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe present BitDrones, a toolbox for building interactive real reality 3D displays that use nano-quadcopters as self-levitating tangible building blocks. Our prototype is a first step towards interactive self-levitating programmable matter, in which the ...
Comments