Abstract
In this paper we present a new algorithm for automatic recognition of hand drawn sketches based on the Levenshtein distance. The purpose for drawing sketches in our application is to create graphical user interfaces in a similar manner as the well established paper sketching. The new algorithm is trainable by every user and improves the recognition performance of the techniques which were used before for widget recognition. In addition, this algorithm ay serve for recognizing other types of sketches, such as letters, figures, and commands. In this way, there is no modality disruption at sketching time.
Chapter PDF
References
Bailey, B.P., Konstan, J.A.: Are Informal Tools Better? Comparing DEMAIS, Pencil and Paper, and Authorware for Early Multimedia Design. In: CHI 2003. Proc. of the ACM Conf. on Human Factors in Computing Systems, pp. 313–320. ACM Press, New York (2003)
Bresenham, J.E.: Algorithm for Computer Control of a Digital Plotter. IBM Systems Journal 4(1), 25–30 (1965)
Caetano, A., Goulart, N., Fonseca, M., Jorge, J.: JavaSketchIt: Issues in Sketching the Look of User Interfaces. In: Proc. of the 2002 AAAI Spring Symposium - Sketch Understanding, Palo Alto, March 2002, pp. 9–14. AAAI Press, California, USA (2002)
Coyette, A., Vanderdonckt, J.: A Sketching Tool for Designing Anyuser, Anyplatform, Anywhere User Interfaces. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 550–564. Springer, Heidelberg (2005)
Do, T.T.: A Social Patterns Framework for Designing Multiagent Architectures, Ph.D. thesis, Université catholique de Louvain, IAG, Louvain-la-Neuve (June 2005)
Fonseca, M.J., Jorge, J.A.: Using Fuzzy Logic to Recognize Geometric Shapes Interactively. In: Proc. of the 9th Int. Conf. on Fuzzy Systems FUZZ-IEEE 2000, San Antonio, pp. 191–196. IEEE Computer Society Press, Los Alamitos (2000)
Freeman, H.: Computer Processing of Line-Drawing Images. ACM Computing Surveys 6(1), 57–97 (1974)
Hong, J.I., Li, F.C., Lin, J., Landay, J.A.: End-User Perceptions of Formal and Informal Representations of Web Sites. In: CHI 2001. Proc. of ACM Conf. on Human Aspects in Computing Systems, Extended Abstracts, pp. 385–386. ACM Press, New York (2001)
Kolp, M., Giorgini, P., Mylopoulos, J.: An Organizational Perspective on Multi-agent Architectures. In: Meyer, J.-J.C., Tambe, M. (eds.) ATAL 2001. LNCS (LNAI), vol. 2333, Springer, Heidelberg (2002)
Landay, J.A., Myers, B.A.: Sketching Interfaces: Toward More Human Interface Design. IEEE Computer 34(3), 56–64 (2001)
Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals. Doklady Akademii Nauk SSSR 163(4), 845–848 (1965) [in Russian]. English translation in Soviet Physics Doklady 10(8) , 707–710 (1966)
Long, A.C., Landay, J.A., Rowe, L.A.: Implications For a Gesture Design Tool. In: CHI 2001. Proc. of ACM Conf. on Human Factors in Computing Systems, Seattle, pp. 40–47. ACM Press, New York (2001)
Lin, J., Newman, M.W., Hong, J.I., Landay, J.A.: Denim: Finding a Tighter Fit Between Tools and Practice for Web Site Design. In: CHI 2000. Proc. of ACM Conf. on Human Factors in Computing Systems, The Hague, April 2000, pp. 510–517. ACM Press, New York (2000)
Newman, M.W., Lin, J., Hong, J.I., Landay, J.A.: Denim: An Informal Web Site Design Tool Inspired by Observations of Practice. Human-Computer Interaction 18, 259–324 (2003)
Plimmer, B.E., Apperley, M.: Software for Students to Sketch Interface Designs. In: Proc. of Interact 2003, pp. 73–80. IOS Press, Amsterdam (2003)
Plimmer, B.E., Apperley, M.: Interacting with Sketched Interface Designs: An Evaluation Study. In: Proc. of CHI 2004, pp. 1337–1340. ACM Press, New York (2004)
Rubine, D.: Specifying Gestures by Example. Computer Graphics 25(3), 329–337 (1991)
Schimke, S., Vielhauer, C., Dittmann, J.: Using Adapted Levenshtein Distance for On-Line Signature Authentication. In: Proc. of ICPR 2004 (2004)
Sumner, T., Bonnardel, N., Kallag-Harstad, B.: The Cognitive Ergonomics of Knowledge-based Design Support Systems. In: CHI 1997. Proc. of ACM Conf. on Human Aspects in Computing Systems, Atlanta, April 1997, pp. 83–90. ACM Press, New York (1997)
van Duyne, D.K., Landay, J.A., Hong, J.I.: The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience. Addison-Wesley, New York (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 IFIP International Federation for Information Processing
About this paper
Cite this paper
Coyette, A., Schimke, S., Vanderdonckt, J., Vielhauer, C. (2007). Trainable Sketch Recognizer for Graphical User Interface Design. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds) Human-Computer Interaction – INTERACT 2007. INTERACT 2007. Lecture Notes in Computer Science, vol 4662. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74796-3_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-74796-3_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74794-9
Online ISBN: 978-3-540-74796-3
eBook Packages: Computer ScienceComputer Science (R0)