Skip to main content
SpringerLink
Log in

Toward a situation model in a cognitive architecture

  • SI: BRIMS 2011
  • Published:
Computational and Mathematical Organization Theory Aims and scope Submit manuscript

Abstract

The ability to coherently represent information that is situationally relevant is vitally important to perform any complex task, especially when that task involves coordinating with team members. This paper introduces an approach to dynamically represent situation information within the ACT-R cognitive architecture in the context of a synthetic teammate project. The situation model represents the synthetic teammate’s mental model of the objects, events, actions, and relationships encountered in a complex task simulation. The situation model grounds textual information from the language analysis component into knowledge usable by the agent-environment interaction component. The situation model is a key component of the synthetic teammate as it provides the primary interface between arguably distinct cognitive processes modeled within the synthetic teammate (e.g., language processing and interactions with the task environment). This work has provided some evidence that reasoning about complex situations requires more than simple mental representations and requires mental processes involving multiple steps. Additionally, the work has revealed an initial method for reasoning across the various dimensions of situations. One purpose of the research is to demonstrate that this approach to implementing a situation model provides a robust capability to handle tasks in which an agent must construct a mental model from textual information, reason about complex relationships between objects, events, and actions in its environment, and appropriately communicate with task participants using natural language. In this paper we describe an approach for modeling situationally relevant information, provide a detailed example, discuss challenges faced, and present research plans for the situation model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. For some proposed extensions to ACT-R emanating from the language analysis research which are largely functionally motivated, see Ball (2011a, 2012).

References

  • Altmann G (1998) Ambiguity in sentence processing. Trends Cogn Sci 2(4):146–152

    Article  Google Scholar 

  • Altmann G, Steedman M (1988) Interaction with context during human sentence processing. Cognition 30:191–238

    Article  Google Scholar 

  • Anderson J (2007) How can the human mind occur in the physical universe? Oxford Univ Press, New York

    Book  Google Scholar 

  • Baddeley A (2000) The episodic buffer: a new component of working memory? Trends Cogn Sci 4(11):417–423

    Article  Google Scholar 

  • Ball J (2003) Beginnings of a language comprehension module in ACT-R 5.0. In: Detje F, Doerner D, Schaub H (eds) Proceedings of the fifth international conference on cognitive modeling. Universitaets-Verlag Bamberg, Bamberg

    Google Scholar 

  • Ball J (2010) Context accommodation in human language processing. In: Proceedings of the 7th international workshop on natural language processing and cognitive science. SciTePress, Porto, pp 27–36

    Google Scholar 

  • Ball J (2011a) Explorations in ACT-R based cognitive modeling—chunks, inheritance, production matching and memory in language analysis. In: Proceedings of the AAAI fall symposium: advances in cognitive systems. AAAI, Arlington, pp 10–17

    Google Scholar 

  • Ball J (2011b) A pseudo-deterministic model of human language processing. In: Carlson L, Hölscher C, Shipley T (eds) Proceedings of the 33rd annual conference of the cognitive science society. Cognitive Science Society, Austin, pp 495–500

    Google Scholar 

  • Ball J (2012) Explorations in ACT-R based language analysis—memory chunk activation, retrieval and verification without inhibition. In: Russwinkel N, Drewitz U, van Rijn H (eds) Proceedings of the 11th international conference on cognitive modeling. Universitaets der TU Berlin, Berlin, pp 131–136

    Google Scholar 

  • Ball J, Heiberg A, Silber R (2007) Toward a large-scale model of language comprehension in ACT-R 6. In: Proceedings of the 8th international conference on cognitive modeling, pp 163–168

    Google Scholar 

  • Ball J, Freiman M, Rodgers S, Myers C (2010a) Toward a functional model of human language processing. In: Proceedings of the 32nd annual meeting of the cognitive science society. Cognitive Science Society, Portland, pp 1583–1588

    Google Scholar 

  • Ball J, Myers C, Heiberg A, Cooke N, Matessa M, Freiman M, Rodgers S (2010b) The synthetic teammate project. Comput Math Organ Theory 16(3):271–299

    Article  Google Scholar 

  • Barsalou LW (2003) Situated simulation in the human conceptual system. Lang Cogn Processes 18:513–562

    Article  Google Scholar 

  • Barsalou L (1999) Perceptual symbol systems. Behav Brain Sci 22:577–660

    Google Scholar 

  • Cassimatis N, Bello P, Langley P (2008) Ability, breadth, and parsimony in computational models of higher-order cognition. Cogn Sci 32:1304–1322

    Article  Google Scholar 

  • Chandrasekaran B, Kurup U (2005) Multi-modal cognitive state: an experiment in augmenting soar with a visual component. In: Proceedings of the AAAI conference

    Google Scholar 

  • Chandrasekaran B, Kurup U, Banerjee B, Josephson J, Winkler R (2004) An architecture for problem solving with diagrams. In: Blackwell A, Marriott K, Shomojima A (eds) Diagrammatic reasoning and inference. Lecture notes in artificial intelligence, vol 2980. Springer, Berlin, pp 151–165

    Chapter  Google Scholar 

  • Cooke N, Shope S (2005) Synthetic task environments for teams: CERTT’s UAV-STE. Handbook on human factors and ergonomics methods. CLC Press, Boca Raton, pp 46-1–46-6

    Google Scholar 

  • Core M, Allen J (1997) Coding dialogs with the DAMSL annotation scheme. Paper presented at the AAAI fall symposium on communicative action in humans and machines, November 8–10, 1997, Cambridge

  • Douglass S, Ball J, Rodgers S (2009) Large declarative memories in ACT-R. In: Proceedings of the 9th international conference on cognitive modeling, pp 222–227

    Google Scholar 

  • Douglass SA, Myers CW (2010) Concurrent knowledge activation calculation in large declarative memories. In: Salvucci DD, Gunzelmann G (eds) Proceedings of the 10th international conference on cognitive modeling. Drexel University, Philadelphia, pp 55–60

    Google Scholar 

  • Endsley M (2000) Theoretical underpinnings of situation awareness: a critical review. In: Endsley MR, Garland DJ (eds) Situation awareness analysis and measurement. Lawrence Erlbaum Associates, Mahwah

    Google Scholar 

  • Ericsson S (2004) Dynamic optimisation of information enrichment in dialogue. In: Proceedings of the 8th international workshop on formal semantics and pragmatics of dialogue. Catalog, Barcelona

    Google Scholar 

  • Ericsson K, Kintsch W (1995) Long-term working memory. Psychol Rev 102(2):211–245

    Article  Google Scholar 

  • Freiman M, Ball J (2010) Improving the reading rate of double-R-language. In: Salvucci DD, Gunzelmann G (eds) Proceedings of the 10th international conference on cognitive modeling. Drexel University, Philadelphia, pp 1–6

    Google Scholar 

  • Fu W-T, Anderson JR (2006) From recurrent choice to skill learning: a reinforcement-learning model. J Exp Psychol Gen 135(2):184–206

    Article  Google Scholar 

  • Gibson E, Pearlmutter N (1998) Constraints on sentence comprehension. Trends Cogn Sci 2(7):262–268

    Article  Google Scholar 

  • Goodale MA, Milner AD (1992) Separate visual pathways for perception and action. Trends Neurosci 15(1):20–25

    Article  Google Scholar 

  • Gray WD (ed) (2007) Integrated models of cognitive systems. OUP, Oxford

    Google Scholar 

  • Gunzelmann G, Lyon DR (2007) Mechanisms of human spatial competence. In: Barkowsky T, Knauff M, Ligozat G, Montello D (eds) Spatial cognition V: reasoning, action, interaction. Lecture notes in artificial intelligence, vol 4387. Springer, Berlin, pp 288–307

    Chapter  Google Scholar 

  • Harrison A, Schunn C (2002) ACT-R/S: a computational and neurologically inspired model of spatial reasoning. In: Proceedings of the 24th annual meeting of the cognitive science society, Fairfax, Virginia, August, 2002

    Google Scholar 

  • Johnson-Laird P (1983) Mental models. Harvard University Press, Cambridge

    Google Scholar 

  • Just M, Carpenter P (1987) The psychology of reading and language comprehension. Allyn and Bacon, Boston

    Google Scholar 

  • Kennedy WG, Bugajska MD, Marge M, Fransen BR, Adams W, Perzanowski D, Schultz AC, Trafton JG (2007) Spatial representation and reasoning for human-robot collaboration. In: Proceedings of the twenty-second annual conference of the association for the advancement of artificial intelligence, Vancouver, BC, 22–27 July 2007. AAAI Press, Menlo Park, pp 1554–1559

    Google Scholar 

  • Kennedy WG, Bugajska M, Adams W, Schultz AC, Trafton JG (2008) Incorporating simulation for a more effective robotic teammate. Paper and poster presented. In: Proceedings of the twenty-third annual conference of the association for the advancement of artificial intelligence, Washington, DC, 13–17 July 2008. AAAI Press, Menlo Park, pp 1300–1305

    Google Scholar 

  • Kennedy WG, Bugajska MD, Harrison AM, Trafton JG (2009) “Like-Me” simulation as an effective and cognitively plausible basis for social robotics. Int J Soc Robot 1:181–194

    Article  Google Scholar 

  • Kintsch W (1998) Comprehension, a paradigm for cognition. Cambridge University Press, New York

    Google Scholar 

  • Klahr D, Chase WG, Lovelace E (1983) Structure and process in alphabetic retrieval. J Exp Psychol Learn Mem Cogn 9(3):462–477

    Article  Google Scholar 

  • Lathrop S, Laird J (2009) Extending cognitive architectures with mental imagery. In: Proceedings of the second conference on artificial general intelligence, Arlington, Virginia

    Google Scholar 

  • Lovett MC, Reder LM, Lebiere C (1999) Modeling working memory in a unified architecture: an ACT-R perspective. In: Miyake A, Shah P (eds) Models of working memory. Cambridge University Press, Cambridge, pp 135–182

    Google Scholar 

  • Matessa M (2000) Simulating adaptive communication. (Doctoral dissertation), Carnegie Mellon University, Pittsburgh

  • Myers CW (2009) An account of model inspiration, integration, & sub-task validation. In: Proceedings of the 9th international conference on cognitive modeling, Manchester, UK

    Google Scholar 

  • Niles I, Pease A (2001) Towards a standard upper ontology. In: Proceedings of the 2nd international conference on formal ontology in information systems, Ogunquit, Maine

    Google Scholar 

  • Prince A, Smolensky P (1993/2004) Optimality theory: constraint interaction in generative grammar. Wiley-Blackwell, New York

    Google Scholar 

  • Ritter FE (2003) Social processes in validation: comments on Grant (1962) and Roberts and Pashler (2000). Comments as part of symposium on model fitting and parameter estimation. In: ACT-R Workshop, pp 129–130

    Google Scholar 

  • Tanenhaus M, Spivey-Knowlton M, Eberhard K, Sedivy J (1995) Integration of visual and linguistic information in spoken language comprehension. Science 268(5217):1632–1634

    Article  Google Scholar 

  • Traum D, Allen J (1994) Discourse obligations in dialogue processing. In: Proceedings of the 32nd annual meeting of the association for computational linguistics. Association for Computational Linguistics, Las Cruces, Morristown

    Google Scholar 

  • Traum D, Rickel J, Gratch J, Marsella S (2003) Negotiation over tasks in hybrid human-agent teams for simulation-based training. In: Proceedings of the second international joint conference on autonomous agents and multiagent systems, Melbourne, Australia. ACM Press, New York, pp 441–448

    Chapter  Google Scholar 

  • van Dijk T, Kintsch W (1983) Strategies of discourse comprehension. Academic Press, New York

    Google Scholar 

  • Varges S (2006) Overgeneration and ranking for spoken dialogue systems. In: Proceedings of the 4th international natural language generation conference, Sydney, Australia, July 2006. Association for Computational Linguistics, Strousburg, pp 20–22

    Chapter  Google Scholar 

  • Walker M, Whittaker S, Stent A, Maloor P, Moore J, Johnston M, Vasireddy G (2004) Generation and evaluation of user tailored responses in multimodal dialogue. Cogn Sci 28(5):811–840

    Article  Google Scholar 

  • Wintermute S (2010). Abstraction, imagery, and control in cognitive architecture. (Doctoral dissertation). University of Michigan, Ann Arbor

  • Zachary W, Santarelli T, Lyons D, Bergondy M, Johnston J (2001) Using a community of intelligent synthetic entities to support operational team training. In: Proceedings of the tenth conference on computer generated forces and behavioral representation. University of Central Florida, Orlando, pp 215–224

    Google Scholar 

  • Zwaan R, Madden C (2005) Embodied sentence comprehension. In: Pecher D, Zwaan RA (eds) Grounding cognition: the role of perception and action in memory, language, and thinking. Cambridge University Press, Cambridge, pp 224–245

    Chapter  Google Scholar 

  • Zwaan R, Madden C (2004) Commentary and reply: updating situation models. J Exp Psychol Learn Mem Cogn 30:283–288

    Article  Google Scholar 

  • Zwaan R, Radvansky G (1998) Situation models in language comprehension and memory. Psychol Bull 123(2):162–185

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. AGS Analytics LLC, Dayton, OH, 45475, USA

    Stuart M. Rodgers

  2. Air Force Research Laboratory, Wright-Patterson AFB, OH, 45433, USA

    Christopher W. Myers & Jerry Ball

  3. L-3 Communications Corporation, Wright-Patterson AFB, OH, 45433, USA

    Mary D. Freiman

Authors
  1. Stuart M. Rodgers
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christopher W. Myers
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jerry Ball
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mary D. Freiman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stuart M. Rodgers.

Appendix

Appendix

Chunks used in the situation model are subtypes of the following defined top level chunk types. Top level chunk types are based on the Suggested Upper Merged Ontology (SUMO; Niles and Pease 2001), and represent the situations, objects, actions, events, and relations of the situation model (Table 4).

Table 4 Situation model top level chunk types
Full size table

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rodgers, S.M., Myers, C.W., Ball, J. et al. Toward a situation model in a cognitive architecture. Comput Math Organ Theory 19, 313–345 (2013). https://doi.org/10.1007/s10588-012-9134-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10588-012-9134-x

Keywords

Search

Navigation