Use of Portfolio-based Learning and Assessment in Community-based Field Curriculum

Portfolio-based learning is recognized in medical education. It helps students to assess themselves as per the key learning objectives and outcomes expected out of them. The faculty could also get feedback regarding individual student's progress toward learning outcomes and facilitate the students achieve the same. This article addresses the process of portfolio development and assesses from students feedbacks, if portfolio-based learning is an improvement over record-based study in community-based field studies. The results of this study shows that involving students in framing objectives, developing a mechanism for self-introspection and self-assessment by the students and a mechanism by which faculty can monitor each student's progress toward the defined objectives can significantly enhance the learnability of the students.

A portfolio is a purposeful collection of student work that exhibits the student's efforts, progress, and achievements in one or more areas. The collection includes student's participation in selecting contents, the criteria for selection, the criteria for judging merit, and evidence of student's self-reflection. A portfolio provides a comprehensive view of student performance. It is a portfolio where the student is a participant in, rather than the object of assessment. It provides a forum that encourages students to develop abilities needed to become independent, self-directed learners. (1) Portfoliobased learning is recognized to be useful in continuing medical education (2,3) because of the autonomy it gives to the adult learner.
In Department of P&SM, JIPMER, Pondicherry, students have Family Health Advisory Program (FHAP), where medical student from 4 th to 6 th semester of MBBS curriculum, in groups of five to six students, followup a family for three semesters on weekly basis. For years, we have been using record-based teaching learning process in FHAP. In the present new batch of 4 th semester, students we tried to initiate portfolio-based learning, in which, students were encouraged to set-up their own learning objectives with the help of teachers. The idea was that the portfolio-based learning would primarily address student's self-learning abilities and their attitude along with learning related to cognitive and psychomotor domain. This should also help students to assess themselves as per the key learning objectives and outcomes expected out of them and the faculty could also get feedback regarding individual student's progress toward the learning outcomes and facilitate the students achieve the same. Moreover, this type of learning was expected to shift the focus of students from record filling to problem-solving activities. This article addresses the process of portfolio development and assesses, from students feedbacks, if portfolio-based learning is an improvement over record-based study in communitybased field studies.

Materials and Methods
The students of fourth semester MBBS curriculum were asked to enlist the things that they felt worth learning in their FHAP. This exercise was done for the students at the beginning of their FHAP. This list was then analyzed into specific, valid, and measurable points. These points were used to define the broad areas of learning. After the broad areas of students interests were drawn, the more detailed points that the students wanted to learn under the broad headings were enlisted. These were discussed with all the faculty and residents of the department and the second draft of the broad categories of objectives and the minimum specific points that the students were expected to learn was drawn. This second draft was again discussed with students to finalize the seven areas that the students had to concentrate and the five specific sub-areas under each broad area that the students had to learn, practice, and impart health education in the respective families they were allotted.
The students were asked to identify problems in the family, they were following, from the 35 points that was finalized O riginal Article [ Table 1]. They were also made free to identify any other issues, even beyond the enlisted 35 points, during their 18 months interaction with the family allotted to them. The given 35 points were just to guide students in identifying issues in the family, assist them to identify their learning objectives, give them the direction to initiate their selflearning, and to an extent standardize the program for all the groups of students. This 35-point issue list was also devised with the objective to improve the ownership of the program by the students. It was thought that if the students were asked to frame their own learning objectives, as they did at the beginning of the program, their ownership for the program had to increase.
The students were made clear that they were to address only the issues that they encounter in the family; they were not supposed to cover all the 35 enlisted issues in the family allotted to them. The students were expected to solve the problems that were present in the family by giving relevant advices to the family members.
At the time of giving health advice, they were asked to evaluate themselves regarding the quality of health education that they have imparted and identify their areas of deficiencies. The deficiencies thus identified had to act as a trigger for further self-learning to improve their own knowledge in the area and help them to impart better health education on the same topic in their subsequent visits to the family. Thus, they were asked to monitor the quality and effectiveness of their health education and also assess their strengths and weaknesses in imparting proper health education.
All the students may not encounter all the 35-points enlisted, in the family they were allotted, but they were encouraged to introspect how confident they would be in dealing with the situation if they had encountered such situations. These 35-point objectives thus helped the student to uniformly gather knowledge in all aspects they were expected to know, even if they do not encounter all the situations in the family they were following.
Self-evaluation of each student is an important aspect of any portfolio-based learning. These self-evaluations by the students in Table 2 were purely for the purpose of their self-introspection and they were clarified that the marks they award themselves would not be linked in any way to their internal assessment marks. This was important to ensure that the students do not unnecessarily inflate their self-assessment marks. These self-evaluations were done for every 2 months and these gave an opportunity to the guiding residents and faculty to see if the students were improving or not in any area and the reasons for the same. Thus, the residents and faculty could get an opportunity to facilitate learnability of students in their areas of weakness to achieve the desired objectives.
At the end of two semesters, the students were asked to give feedback on a four/five point-likert scale [ Table 3]. The feedback form contained seven questions; the students had to encircle the most appropriate choice The present batch of students also used the same records but the change in approach was that they were asked not to follow-up families page wise as given in records but to go into the family with an open mind, identify the problems in the family and give health education related to the identified issue. If they had any problem in giving health education when they first encountered it, that had to became a trigger point for self-learning so that they could give better advice in their subsequent home visits for that particular topic.
Among the 41 feedbacks from previous batch of students, 2 had submitted incomplete forms and of the 50 feedbacks got from the present batch of students, 1 had submitted incomplete form. Analysis was done using software package SPSS version 13.

Results and Discussion
The results in Table 4 show that there was significant difference between the feedbacks given by students of previous batch and the present batch to the questions -if objectives of FHAP were clear to them, was the FHAP posting useful to them and was it useful to the family they were following. There was no statistical significant difference between the feedback given by students to the questions -regarding how much they were interested in the program, participation of faculty in guiding them, participation of the residents in guiding them, and their opinion regarding if FHAP needed change in the approach of teaching.
The results reflect that with the same amount of efforts from faculty and residents in both the batches, the objectives of FHAP was significantly better with the present approach as compared with the record-based approach alone. With the present approach, the student's feelings regarding the usefulness of the program for themselves and to the family they were following was significantly better when compared with the previous approach. But there was no significant difference in the interest levels between the previous and present batch of students. There was also no difference in the response between the batches to the question -"FHAP  Very useful (1)/useful (2)/moderately useful (3)/of little use (4)/ not useful (5) 4. Participation of residents in guiding you was Excellent (1)/above average (2)/average (3)/below average (4)/ extremely poor (5) 5. Participation of faculty in guiding you was Excellent (1)/above average (2)/average (3)/below average (4)/ extremely poor (5) 6. How much you were interested in the program?
To a great deal (1)/much (2)/some what (3)/little (4)/never (5) 7. FHAP needs change in the approach of teaching. What is your opinion? Strongly agree (1)/agree (2)/undecided (3)/disagree (4)/ strongly disagree (5) need change in the approach of teaching. What is your opinion?" May be this question is too broad to capture any difference between the perceptions of both the batches; the batch-wise difference between the reasons for opting for change in approach of teaching in FHAP would have reflected better picture. This is a limitation while taking feedback in the present study.

Conclusion
To conclude, the results show that involving students in framing objectives, a mechanism for self-introspection and self-assessment by the students and a mechanism by which faculty can monitor each student's progress toward the pre-defined learning objectives can significantly enhance the learnability of the students.