Danielle Ellyse Crowley
Robin R. Murphy
Tim D. McLaughlin
ABSTRACT
This work in progress describes AerialAR, a global positioning system (GPS) augmented reality (AR) application for mobile devices that automatically labels points of interest (POI) in unmanned aerial vehicle (UAV) imagery. This has important implications for assisting emergency responders. Existing AR applications for UAVs provide the pilot with navigational situational awareness such as terrain features; AerialAR locates and labels mission-relevant points such as schools that may need to be evacuated or hospitals to transport victims to. Locating POI in UAV imagery poses more challenges than those addressed by typical AR browsers on smartphones. The UAV operates at different altitudes as opposed to handheld devices and the UAV camera can tilt over a wide range of angles rather than simply facing forward. AerialAR overcomes these issues by developing a set of equations that translate UAV telemetry and field of view (fov) into a projection onto a Google Map. The map can then be queried for categories of POI. The current version calculates the POI distance and angles with an average error of 0.04% as compared to the Haversine and Rhumb line equations for the distance between the UAV location projected on the ground and the POI on the Google Map. Future work will complete AerialAR by processing UAV video in real-time on mobile devices.
Supplemental Material
Available for Download
Zip file containing a PDF of the Accompanying Poster
- Benton, C., Nitzel, R., & Zysk, T. (2008, 15--18 Sept. 2008). Merging ocean/maritime models and arctic operations using mission planning toolkits and augmented reality. Paper presented at the OCEANS 2008.Google Scholar
- Drury, J. L., Richer, J., Rackliffe, N., & Goodrich, M. A. (2006). Comparing situation awareness for two unmanned aerial vehicle human interface approaches. MITRE CORP BEDFORD MA.Google Scholar
- Grasset, Raphael, Mulloni, Alessandro, Billinghurst, Mark, & Schmalstieg, Dieter. (2011). Navigation Techniques in Augmented and Mixed Reality: Crossing the Virtuality Continuum. In B. Furht (Ed.), Handbook of Augmented Reality (pp. 379--407): Springer New York.Google Scholar
- Göktogan, Ali Haydar, & Sukkarieh, Salah. (2005). A Augmented Reality System for MultiAUV Missions.Google Scholar
- Huiyao, Wu, Zhihao, Cai, & Yingxun, Wang. (2012, 25--27 July 2012). Vision-based auxiliary navigation method using augmented reality for unmanned aerial vehicles. Paper presented at the Industrial Informatics (INDIN), 2012 10th IEEE International Conference on.Google Scholar
- Madden, Lester. (2011). Professional augmented reality browsers for smartphones: programming for junaio, layar and wikitude: Wrox. Google ScholarDigital Library
- Zhihao, Cai, Meng, Chen, & Liman, Yang. (2011). Multi-source information fusion augmented reality benefited decision-making for unmanned aerial vehicles: A effective way for accurate operation. Paper presented at the 2011 6th IEEE Conference on Industrial Electronics and Applications, 21--23 June 2011, Piscataway, NJ, USA.Google Scholar
Index Terms
- AR browser for points of interest in disaster response in UAV imagery
Recommendations
ITU Tailless UAV Design
Nowadays, mini Unmanned Aerial Vehicles (UAVs) are utilized in a wide range of reconnaissance and surveillance missions with an ever increasing need for endurance and range. Thus, a slight improvement on these two primary performance parameters is ...
Unmanned aerial vehicles
As unmanned aerial vehicles have become more affordable, their popularity with the general public and commercial organisations has seen significant growth in recent years. Whilst remaining a device for both the hobbyist and aircraft-enthusiast to enjoy, ...
Automatic Control for Aerobatic Maneuvering of Agile Fixed-Wing UAVs
The use of unmanned aerial vehicles (UAVs) has become ubiquitous in a broadening range of applications, including many civilian uses. UAVs are typically categorized into two categories: conventional fixed-wing aircraft, which are associated with ...
Comments