ABSTRACT
Learning of new words is assisted by contextual information. This context can come in several forms, including observations in non-linguistic semantic domains, as well as the linguistic context in which the new word was presented. We outline a general architecture for word learning, in which structural alignment coordinates this contextual information in order to restrict the possible interpretations of unknown words. We identify spatial relations as an applicable semantic domain, and describe a system-in-progress for implementing the general architecture using video sequences as our non-linguistic input. For example, when the complete system is presented with "The bird dove to the rock," with a video sequence of a bird flying from a tree to a rock, and with the meanings for all the words except the preposition "to," the system will register the unknown "to" with the corresponding aspect of the bird's trajectory.
- John R. Bender. 2001. Connecting language and vision using a conceptual semantics. Master's thesis, Massachusetts Institute of Technology.Google Scholar
- Lera Boroditsky. 2000. Metamorphic structuring: understanding time through spatial metaphors. Cognition, 75(1):1--28.Google ScholarCross Ref
- Bonnie Dorr. 1992. The use of lexical semantics in interlingual machine translation. Machine Translation, 7(3):135--193.Google ScholarCross Ref
- Dedre Gentner and Arthur B. Markman. 1997. Structure mapping in analogy and similarity. American Psychologist, 52(1):45--56.Google ScholarCross Ref
- Berthold Klaus Paul Horn. 1986. Robot Vision. McGraw-Hill, New York, New York.Google Scholar
- Ray Jackendoff. 1983. Semantics and Cognition, volume 8 of Current Studies in Linguistics Series. MIT Press, Cambridge, Massachusetts.Google Scholar
- Jeffrey Mark Siskind. 1990. Acquiring core meanings of words, representated as jackendoff-style conceptual structures, from correlated streams of linguistic and non-linguistic input. In Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics (ACL-1990). Google ScholarDigital Library
- Mark Steedman. 2000. The Syntactic Process. MIT Press, Cambridge, Massachusetts. Google ScholarDigital Library
- Shimon Ullman, 1996. High Level Vision, chapter 10, pages 317--358. Sequence Seeking and Counter Streams: A Model for Information Flow in the Visual Cortex. MIT Press, Cambridge, Massachusetts.Google Scholar
- Deniz Yuret. 1999. Lexical attraction models of language. Submitted to The Sixteenth National Conference on Artificial Intelligence.Google Scholar
Recommendations
Two-Word Collocation Extraction Using Monolingual Word Alignment Method
Statistical bilingual word alignment has been well studied in the field of machine translation. This article adapts the bilingual word alignment algorithm into a monolingual scenario to extract collocations from monolingual corpus, based on the fact ...
Collocation extraction using monolingual word alignment method
EMNLP '09: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2Statistical bilingual word alignment has been well studied in the context of machine translation. This paper adapts the bilingual word alignment algorithm to monolingual scenario to extract collocations from monolingual corpus. The monolingual corpus is ...
Finding synonyms using automatic word alignment and measures of distributional similarity
COLING-ACL '06: Proceedings of the COLING/ACL on Main conference poster sessionsThere have been many proposals to extract semantically related words using measures of distributional similarity, but these typically are not able to distinguish between synonyms and other types of semantically related words such as antonyms, (co)...
Comments