THE EFFECT OF DIGITAL ECO-LEARNING IN STUDENT WORKSHEET FLIPBOOK TO ENVIRONMENTAL PROJECT LITERACY AND PEDAGOGIC COMPETENCY

The study aimed to determine 1) the effect of digital eco learning in student worksheet flipbooks on environmental literacy projects, and 2) the effect of digital eco learning in student worksheet flipbooks on student ecological competence. The research is a quasi-experimental study using a Pretest-Posttest Non-equivalent Control Group. The research subjects were students in the Environmental Geography course semester 6 of 2020, divided into the experimental and control groups. The research was conducted at the Geography Education study program, Social Science Faculty, State University of Malang, Indonesia. Data were analyzed using the independent sample t-test in SPSS version 21 for windows. The results found: 1) there is a significant effect of digital eco learning with student worksheet flipbook on environmental project literacy competence, and 2) there is a significant effect of digital eco learning with student worksheet flipbooks on ecological competence. The use of digital eco-learning helps students get to know the environment quickly by using a flipbook worksheet without having to reduce their pedagogical and environmental literacy skills.

By developing student worksheet flipbook, it is very easy to use in eco-learning so that it can increase environmental project literacy. Eco-learning can improve ecological competence, increase awareness, knowledge, and skills in making decisions on environmental problems (Aquilina, 2001;Omran, Iraj & Yarmohammadian, 2016). The statement is supported by research stated that environment-based learning helps students build human intelligence constructs to interact with nature by maintaining interests in going forward (Tulalessy, 2016). Other research stated that learning based on local environmental problems effectively increases students' ecological competence (Muhaimin, 2015). Eco-learning camps can also build awareness and concern for the environment, this activity, also aims to take real action in protecting the environment (Arent, Sumarmi, Utomo & Ruja, 2020;Ghosh, 2014;Hayati, Utaya & Astina, 2016;Napitupulu, 2015;Susanti & Rachmawati, 2018). In addition, other research also stated that the application of flipbooks can improve students' critical thinking skills (Bozkurt & Bozkaya, 2015;Riyanto et al., 2020).
However, research that examined digital eco-learning in students' worksheets flipbooks, environmental literacy projects, and student ecological competence has not been widely studied. Based on this statement, this study aimed to determine: 1) the effect of digital eco-learning in the student worksheet flipbook book on environmental literacy projects; 2) the effect of digital eco-learning in the student worksheet flipbook book on pedagogical competence.

Theoretical Underpinnings
Tinsley (Sumarmi, 2012) state that the development of environmental literacy projects suggested that digital eco-learning for environmental project literacy improves fieldwork skills, laboratory work, ability to collect data, organize data, analyze data, and make presentations on solving environmental problems. Environmental project literacy learning emphasizes solving authentic problems that occur daily through learning experiences in society, including environmental problems (McBeth & Volk, 2009). The characteristics of this learning activity are long, interdisciplinary, learner-centered, and integrated with real-world issues and practices (Ghosh, 2014).
The use of the Flipbook application to explain theoretical or abstract material is stable (Nurseto, 2011). Visualizing the Flipbook application topic can provide new learning experiences for students in the learning process (Asmi, 2018). Flipbooks can develop critical thinking skills in high school students in Indonesia (Abdurrahman, Setyaningsih & Jalmo, 2019) and improve students' critical thinking in Indonesia (Riyanto et al., 2020). Flipped classrooms in urban general secondary students in America show increased motivation (Dixon & Wendt, 2021). The flipped strategy also significantly improves student academic achievement in Jordan (Elian & Hamaidi, 2018), and in Oman (Al-Maroof & Al-Emran, 2018). Flipped classrooms also positively impact student learning performance and perceptions in Thailand (Santikarn & Wichadee, 2018). Also, flipbooks can improve students' understanding of geography concepts (Suryani, 2015). The components of eco-learning can be seen in the following table (Grigorov, 2012;Sumarmi, 2012).
Based on Table 1, it can be explained that eco-learning is flexible learning. Eco-learning makes it easy for students to learn anywhere and anytime (Ghosh, 2014;Hayati et al., 2016). Eco-learning has a learning principle that students can still get knowledge inside and outside the classroom. Although eco-learning makes learning easier, several challenges can be a barrier for students. The project literacy challenges in eco-learning can be seen in Table 2 (Sumarmi, 2012).

No
Principles and Pedagogical Strategies in Eco-learning 1 Learning everywhere. Availability of learning materials, assignments, and results anytime and anywhere allow flexibility and continuity of learning. Learning through multiple media sources to enrich demonstrations and match different student learning styles. Students can edit, update, and enrich the topic. 2 Students are teacher partners that actively involved in learning 3 Communication can be through in class, online synchronous, and online asynchronous. Discussions with lecturers and fellow students, both about material content and project completion 4 Mapping collaboration to create more effective learning 5 Lessons are carried out to achieve the project's environmental literacy. The collaborative effect in asynchronous learning with peers 6 The assessment paradigm in learning self-assessment, assessment by group members, and assessment by the classroom community (peer assessment). Authentic assessment is carried out on performance, resulting in face-to-face, synchronous, and asynchronous Based on the challenges in project literacy, exercises are needed to approach the problems of eco-learning. Exercises can provide benefits for students (Riyanto et al., 2020;Sumarmi, 2012) as shown in the following Table 3.
The application of eco-learning is expected to provide changes to students' basic competencies in improving environmental problems. Providing knowledge can change students' attitudes and skills regarding environmental problems (Aliman et al., 2019). Ecological aspects can be used to assess the understanding of the interactions between humans and the environment. Humans have a mutual relationship, are interrelated, and influence the environment (Fauzi, Muryani & Santosa, 2018). Besides, ecological intelligence is a student competency based on the knowledge and skills related to nature which every behavior and action has an impact on the natural environment (Supriatna, 2016).

Implementation
In class A, learning was given treatment by applying a digital eco-learning model using a student worksheet flipbook. At the beginning of the meeting, students were given a pretest to determine their initial environmental project literacy and pedagogic competency skills. At the next meeting, the lecturer gave lectures through the zoom meeting application (Synchronous). Furthermore, the meeting was held asynchronously using the e-learning application (https://sipejar.um.ac.id/). Furthermore, students are guided to download worksheets through the e-learning site. The detailed activities showed in the following Figure 1.
Students are given tests related to the subject that has been studied and discussed at the final meeting. Students are also given posttests related to environmental project literacy skills and pedagogic competency for both the experimental and control groups.

Research Instrument
The independent variable of this study is digital eco-learning in student worksheet flipbook, while the dependent variable is environmental project literacy and pedagogical competence. Pedagogical competence has sub-variables of ecological knowledge, ecological attitudes, and ecological skills. The instruments were used questionnaires, observation, and documentation. The following table showed criteria for environmental project literacy skills and student pedagogical abilities. Environmental project literacy and pedagogical competence were measured using a questionnaire with 25 statements. Validity and reliability tests were carried out to collect valid data on the environmental conservation behavior questionnaire. The research instrument was tested to 37 final-year students of Geography Education study program. The instrument validity using Cronbach alpha was showed 0.986 (with the high validity category because, 0.986>0.05). The result on reliability test was showed that the environmental literacy project instrument is 0.874 (with the high Reliability category because, 0.874>0.05) and the pedagogic competency is 0.776 (with the high Reliability category because, 0.776>0.05). Questions are prepared based on environmental project literacy indicators and pedagogical competencies. Documentation is data that supports research both in data and images. Research instruments of the environmental literacy project (Questions no 1-17) and pedagogic competencies (Questions no 18-25) showed in the following Table 5.
Based on the questions in Table 5, students are given options: strongly agree (4), agree (3), disagree (2), and strongly disagree (1). All answers filled in during the pretest and posttest are then added up the total value based on the environmental project literacy indicator and indicators of pedagogic competence. Then look for the average score of each indicator to find the gain score between the pretest and posttest.

No
Statements 1 I know the environment well. 2 I know how the environment affects my life. 3 I actively participate in activities that support environmental preservation. 4 I can teach students to preserve the environment. 5 I am constantly working to find ways to teach others about protecting the environment. 6 I make time for activities to preserve the environment. 7 I am doing an environmental project to conserve the surrounding environment. 8 I prefer to use a spatial approach in the environmental literacy project. 9 I prefer to use the environmental approach in the environmental literacy project. 10 I prefer to use a complex regional approach in the environmental literacy project. 11 I prefer to use the Student Worksheet Flipbook to identify data as project content about the environment. 12 I prefer to use the Student Worksheet Flipbook to relate data as project content about the environment. 13 I prefer to use the Student Worksheet Flipbook to analyze data as project content about the environment. 14 In this pandemic situation, I prefer to use data from the library as a data source for solving environmental literacy projects. 15 In this pandemic situation, I prefer to use secondary data as a data source for the settlement of environmental project literacy. 16 In this pandemic situation, I prefer to use field data as a data source for the completion of environmental project literacy. 17 Eco-Learning with Student Worksheet Digital is very supportive to complete my project. 18 I could use geospatial data to identify environmental problems in an area. 19 I could compile instructional media as a project for the study of environmental problems in an area. 20 I could compile a digital Flipbook for environmental problem studies in an area. 21 I could identify awareness, society, and government in the cycle of managing the environment 22 I am interested in studying environmental problems related to flash floods, river overflow floods, tidal floods, mass displacement/landslides, earthquakes, tsunamis, volcanic eruptions. 23 I worked on more than one project this semester. 24 The completion of my first project greatly influenced the success of my second project, and so on 25 Online lectures support the completion of a project that I have to work on in this pandemic situation.

Data Analysis
The data were analyzed using the independent sample t-test. Before analyzing to test the hypothesis, the normality test and homogeneity test are carried out before the hypothesis test, or prerequisite test is carried out. The normality test used the Shapiro-Wilk test to analyze the distribution of data. The homogeneity test was used to determine homogeneous data variants using Levene's test for variances equality. The hypothesis has tested using the t-test (independent sample t-test) with SPSS for windows 21.00. The analysis result is obtained from the gain score. The gain score is the difference between the pretest and posttest of the control and experimental groups. The gain score calculation can be seen as follows.

Comparison Test of the Mean Gain Score between Groups
Two groups of unpaired samples were analyzed using the independent sample T-test. Before the test, the normality assumption was tested using the Kolmogorov Smirnov test. Data that do not meet the assumptions then replaced using the Mann Whitney test. The analysis hypothesis is as follows: H 0 : There is no significant mean gain score between groups; H 1 : There is a significant mean gain score between groups.

Testing Criteria
• if the value |t count | > t

Gain Score of Environmental Project Literacy
The environmental project literacy ability of the experimental and control group was analyzed to see the mean score using the independent sample t-test analysis. Before performing the analysis, the data normality assumption test is carried out. Following are the results of the mean gain score for environmental project literacy abilities and data normality tests.
Based on Table 6, it is found that the mean gain score for the environmental literacy project control class is 9.61, lower than the experimental class of 19.70. The mean gain score between the two groups can also be seen in the pretest and posttest scores.
The results of the Kolmogorov-Smirnov normality test showed that the control and experimental group are not normally distributed because the significance value is smaller than α 5%. Therefore, the data analysis was continued using the Mann-Whitney normality test. From the Mann Whitney test found Z count < -Z table (-6.413 < -1.960), and the p-value is smaller than α (0.000 < 0.050). Therefore, it was concluded that the hypothesis H 0 was rejected. It showed a significant mean gain score between the experimental and control group based on the environmental project literacy measurement. The detail can be seen in the following Figure 3.
Based on Figure 3, the mean gain score for the environmental project literacy in the experimental group is higher than the control group. The gain score between the two groups has a difference of 10.09, so the difference is very significant.

Gain Score of Pedagogical Competency
The students' pedagogical competence in environmental geography were analyzed using the independent sample t-test to see the mean gain score of the experimental and control group. The data normality assumption test was carried out before conducting the test on the mean gain score for student pedagogical competency. The following are the gain score results and the pedagogical competence normality test in the experimental and control group.
Based on Table 7, it is found that the mean gain score for the pedagogical competence of the control group is 7.48, lower than the experimental group of 18.15. The mean gain scores between the experimental and control groups can be seen from the pretest and posttest scores.
From the normality test of the Kolmogorov-Smirnov model, it was found that the experimental class was normally distributed with a significance value more than α 5%, but the control class data was not normally distributed with a significance value smaller than α 5%. Even though only one group of data is normally distributed, the normality assumption test is still replaced using the Mann-Whitney different test.
From the Mann Whitney test found Z count < -Z table (-6.417 < -1.960), and the p-value is smaller than α (0.000 < 0.050), it was concluded that the hypothesis H 0 was rejected. Therefore, there is a significant mean difference between the experimental and control groups based on the gain score of pedagogical competency. The details can be seen in the following Figure 4.
Based on Figure 4, the average gain score for the pedagogical competence in the experimental group is higher than the control group. The gain score between the two groups is 10.67, so there is a very significant difference.

Digital Eco-Learning in the Students Worksheet Flipbook on Environmental Literacy Project
Eco-learning is one of the contextual learning methods outside the classroom. The learning requires students to better understand their surroundings to learn through an environmental problem (Grigorov, 2012). Eco-learning encourages students to set their analytical skills in turning information into knowledge to help identify environmental problems (Muhaimin, 2015). Learning through discussions and presentations strengthens the teacher's role as a facilitator to increase activity and creativity in finding information delivered independently through cooperative learning (Bozkurt & Bozkaya, 2015).
The group-based learning is aligned with Vygotsky's constructivism learning theory (Sumarmi, 2012).
Another key to constructivist theory in learning activities is that students must find ideas, and complex information must be transformed and interpreted and turn into knowledge (Andersen & Kjeldsen, 2015). Data from the field then analyzed, sorted, and transformed to solve problems in the students' environment. The eco-learning approach was one of the lessons that can encourage students to construct personal knowledge and skills. The eco-learning approach improves collaborative learning in small groups of students, so this approach aligns with Vygotsky's theory of social constructivism, which provided a basis for cognitive development by increasing the intensity of interpersonal interactions (Vygotsky, 1978).
The information obtained can be converted into knowledge using Eco-learning. Eco-learning can shape student attitudes, especially attitudes related to basic ecological (environmental) competencies (Ghosh, 2014;Kahn, 2008Kahn, , 2010Napitupulu, 2015). Changes in the students' ecological attitudes can be stimulated through learning Environmental Geography. The information found through learning Environmental Geography and Eco-learning leads students to analyze environmental problems. Information about environmental problems will construct student knowledge to understand environmental problems (Hayati et al., 2016). It was easier for students to find solutions and form attitudes towards a sustainable environment.
The development of knowledge, skills, and attitudes to analyze problems can be carried out through three activities, namely (1) identifying problems, resolving using prior knowledge, (2) preparing plans to solve problems, and (3) implementing prepared plans to be analyzed the process accuracy in problem-solving (Joyce & Weil, 1996;Muhaimin, 2015).
The results showed that the eco-learning approach in Environmental Physics lectures could develop the pre-service teachers' ecological attitude by understanding the concepts of eco-physics (Napitupulu, 2015).
Other research explains that pre-service teachers' ecological competence in cognitive, affective, and psychomotor can be developed through various eco-learning (Ghosh, 2014;Hayati et al., 2016).
Students' environmental literacy project skills can be improved by applying eco-learning integrated with student worksheets flipbook. The worksheet developed is concrete, simple, align with the concepts being learned so that it can build knowledge and thinking skills based on real experiences. It is also supported by research stated that using flipbooks can improve students' critical thinking skills (Riyanto et al., 2020). Project-based eco-learning is systematic learning that involves students in learning complex knowledge and skills, authentic questions in designing products and assignments (Baidowi, Sumarmi & Amirudin, 2016;Sumarmi, 2012). Eco-learning with student worksheets can improve student environmental project literacy skills in solving environmental problems (Hayati et al., 2016). The environmental project emphasizes student-centered learning, while the lecturer only acts as a facilitator. Eco-learning provides opportunities for students to be active in developing knowledge that comes from environmental issues (Grigorov, 2012).
Project Literacy uses an inquiry learning strategy and uses a constructivist approach (Sumarmi, 2012). Working on the project, students will actively ask, predict, explain, and interact with concrete materials. Students use initial knowledge and apply it to new knowledge. Eco-learning creates a learning environment for students to independently construct their knowledge and skills (Grigorov, 2012;Hayati et al., 2016). Based on the research of Grant and Branch (2005), this project-based learning can; (a) develop multiple intelligences; (b) improve knowledge systems, knowledge domains, and knowledge metacognition. Metacognition includes the process of selecting, searching, asking, dividing, formulating hypotheses, and the process of making decision (Grant & Branch, 2005). Eco-learning helps students construct knowledge independently and improves thinking skills (Ghosh, 2014;Puspitasari, Sumarmi & Amirudin, 2016).
Eco-Learning is used to understand all environmental problems and solutions. Applying Eco-Learning helps students be sensitive to environmental problems and improve to find alternative solutions (Aliman et al., 2019;Hayati et al., 2016). The application of Eco-Learning aims to: (a) integrate the real world with learning, (b) direct student work, (c) teach collaboration or be cooperative, (d) encourage students to investigate and solve problems (Sumarmi, 2012). Eco-learning does not only develop student knowledge through the real world or environmental issues. However, eco-learning also teaches students to solve environmental problems (Garrison, 2011;Omran et al., 2016).
Eco-Learning can be applied to the geography course because it presents problems contextually in learning (Hayati et al., 2016). Eco-Learning in geography learning should: (a) raise meaningful issues to student life, (b) must raise important and new issues, (c) raise complex problems and immediate solutions, (d) problems raised must be relevant to the student, both from a pedagogical view and the student's context, (e) the problems raised should be original (Sumarmi, 2012). Eco-Learning applied in geography learning must emphasize the presentation of authentic problems (Doppelt, 2003). The problem must be following the student's environment to find appropriate solutions to environmental problems.
In the student worksheet, the literacy project uses authentic learning outcomes measurement based on performance-based assessment (Sumarmi, 2012). The learning activity consists of five stages: 1) identification of real problems, 2) planning for problem-solving strategies/alternatives, 3) product design/activity design, 4) production process/activities, and 5) evaluation using Student Worksheet flipbook presents challenges to students on environmental problems. The student worksheet also helps students provide solutions and develop literacy project skills and pedagogical competencies (Baidowi et al., 2016;Kahn, 2010).
The project is carried out in a student worksheet. The first stage is problem identification. At this stage, the thinking ability about environmental project literacy and student pedagogical competences is trained. Students must be able to identify and analyze environmental problems that occur in the surrounding environment. However, beforehand, students must understand the topic being studied by building their knowledge. It requires students to understand and be sensitive to environmental phenomena around them. The second stage is formulating strategies or alternative problem-solving. Students can provide solutions to environmental problems. The second stage is planning. At this stage, cooperation is needed for investigative activities related to the required data and information. Each group can plan activities well so that the implementation runs smoothly. The fourth stage is implementation. Students must also show good character as students and the young generation in requiring thinking skills. At this stage, students get into the community to find information. The fifth stage is evaluation. All activities carried out are then communicated and evaluated. Students must be open-minded to get input and suggestions for future activities.
Teachers make various evaluations to represent learners' knowledge and improve the learning process. Learning communities are developed to make students participate in environmental projects, resolve conflicts, and exchange ideas and skills. Working on a developed project is actual and meaningful, relevant to student life, and relates to the real life (Krajcik, Czerniak & Berger, 2003). Eco-learning is used to understand environmental problems and find solutions. Finding and developing the basics of environmental ethics, understanding ecological concepts, and experiences in the field (Goodwin & Adkins, 1997;Jenkins, 2003;Windschitl, Dvomich, Ryken, Tudor & Koehler, 2007).

Digital Eco-Learning in Student Worksheet Flipbook on Pedagogical Competence
The project-based learning model is also supported by activity theory (Hung and Wong, 2000; Activity Theory) stated that the basic structure of activity consists of (a) goals to be achieved, (b) subjects in the context (c) a society as medium (d) instruments, (e) work regulations, and (f) tasks distribution. Its application in the classroom relies on learning activities that emphasize active activities (doing) rather than passive activities (receiving) knowledge from teachers. Then, digital eco-learning used can improve students' pedagogical competence.
The objectives of implementing Eco-learning are: (a) integrating learning with the real world, (b) directing students' work, (c) teaching students to collaborate, (d) Therefore, based on the objective, eco-learning can improve students' pedagogical competence. The eco-learning carried out in this study raised a significant problem for student development. Also, at the design and production process stages, students look for important, complex, new, and relevant issues from a pedagogical and contextual perspective in the environment (Supriatna, 2016). Research also supports this research stated that communication and awareness of the environment could be developed through eco-learning (Susanti & Rachmawati, 2018). Through eco-learning that examines students' problems, students can act as the planner, collaborators, producer, decision-maker, and presenter (Audet, 2000).
Student pedagogical competence develops well by applying eco-learning. It is due to Eco-Learning principles that train students to research real problems (Blumenfeld et al, 1991). Based on eco-learning elements such as (1) introduction, (2) task description, (3) procedures for investigation, (4) learning resource support, (5) task completion mechanisms, (6) collaboration, and (7) reflection and activity transfers (Grant & Branch, 2005). Elements in eco-learning were used to develop student pedagogical competencies and can develop student academic motivation (Dixon & Wendt, 2021).
The student worksheets in eco-learning provided students with the knowledge and environmental sensitivity. Eco-learning shapes students' ability to analyze, synthesize, evaluate and be proficient in making decisions about the problems found. It is also aligned with previous research stated that a simultaneous and continuous environmental learning can improve the student's pedagogical environment (Aliman et al., 2019;Sumarmi et al., 2020). In addition to improving pedagogical abilities, eco-learning can also improve students' critical thinking skills (Hayati et al., 2016).

Conclusions
Based on the research and discussion results, it can be concluded that there is a significant mean gain score between the control and experimental group on environmental literacy projects and student pedagogical competence. Digital eco-learning in the student worksheet flipbook has a significant effect on student environmental literacy projects. Digital eco-learning in the student worksheet flipbook has a significant effect on student pedagogical competence. More than one person should use digital eco-learning as a control for inactive student groups. This research implies that lecturers and teachers can use this learning to improve environmental project literacy, pedagogical competency and save time. The development of digital ecolearning in the student worksheet flipbook can use other independent variables. One of the variables is critical thinking, creative thinking, and other cognitive variables. Its application can also be carried out on middle school students and pre-service teachers to determine the effectiveness.