This paper proposes a medical care support system for computational behavioral data accumulation and interactive display by behavior understanding. The objective of this system is to save doctors' labor of recording their clinical behavior for diagnosis and treatment, and to help doctors to use the medical information more efficiently. The support system has three functions as follows: (1) understanding of a doctor's behavior by visual and audio processing, (2) accumulation of the results of understanding as the doctor's behavioral data, (3) displaying of the clinical information for the decision making by judging the content and timing from the results of understanding. In this paper, the overview of the proposed support system is introduced as well as development of a prototype system.