Portraying Students’ Critical Thinking: A Case Study of Information Technology Students

— Students’ critical thinking is one of the life skills that they have to master in their life. The shifting means of reading, from textbooks to electronic text tends to change students’ behavior. They are lazy to read from the text on the other hand they are keen to read through gadgets. Reading is one of the strategies to build critical thinking in which students have to improve their understanding so that they know about the things written in the texts. Though the COVID-19 pandemic changes the reading mode, the students’ com prehension is still low. This study is a preliminary study for portraying students’ critical thinking from Information Technology students, about critical thinking, known as a case study. The findings show that the students’ comprehension is low. Among seven (7) traits of critical thinkers proposed by Martha Stewart, they show that the systematic-by-the method trait is the dominant trait because they rely on their logical reasoning. Based on Bloom Taxonomy, the result shows that their cognitive level is on the level of understanding that belongs to young learners’ level. The conclusion shows that the students of Information Technology are dominant in the systematic-by-the method trait. They should improve their reading level by spending more reading time and practicing their comprehension from reading different texts. By reading, the students will gain knowledge of the world and be critical thinkers.


I. INTRODUCTION
The low level of reading literacy of Indonesian students based on PISA (2018) showed that the average score is 371. Reading literacy is based on the Indonesian National Report of PISA published in 2018 [1] is defined as an individual capacity in understanding, using, reflecting, and being fully devoted to written texts to achieve goals, develop knowledge and potential, and participate in society. Indonesia is on the 10th bottom position among 79 countries according to PISA 2018 achievement. It is written that the Indonesian student's reading average is 80 points below OECD standard though it is also below the average of students from Asian countries.
Reading is a receptive skill like listening while writing and speaking are productive skills. The higher their receptive skills are, the better their productive skills will be. The point is on the practicality which need be taken care of by them. If they lack reading activity then their reading literacy level remains low. The lower their level, their understanding is below the standard. The university students should have this reading level above the standard because they will need it to support their life.
The change in teaching mode, from face to face to virtual creates different results, both good and bad sides. The good side is that the teaching and learning process is still running online but the bad thing is the gap between the teacher and students widen. The distance becomes wide, as a result, communication also becomes hard. The passive students remain passive while the active students will do the opposite, Bloom's Taxonomy gave a clear picture of the process on the students' cognitive skills that the remember activity takes the biggest part of the teaching and learning method applied in Indonesia. The next level that is understood also becomes the target of teachers to help students know what they are reading. Those two basic levels, namely remember and understand shown by the students, but only a few of them can move to higher levels, they are analyzed, evaluate and create. The change in teaching mode did not reflect the students' knowledge.
This online teaching paradigm contributes to improving students' digital literacy. It shows the opposite result that the students become more passive. The lack of teacher's touch in this kind of teaching makes those students' typeface more difficult. This situation makes us concerned so we conducted a case study to portray the students' critical thinking by measuring their reading comprehension towards the electronic paper they have to read. This

II. METHOD
This study is a case study that aimed at portraying students' critical thinking. The students of Information Technology have a subject called Information Research Methodology which they have to take in semester 6. This subject is only 3 credits but they are expected to learn how to do research in the information systems field. There are 65 student respondents in this study. The instrument in this study is the questionnaire that was developed based on critical thinking traits. The questionnaire was distributed to measure their critical thinking by using seven traits of critical thinker proposed by Martha Stewart [7] namely: open-mindedness, analytic nature, systematic by method, inquisitive, judicious, truth-seeking ethos, and confidence in reasoning. These traits are created because critical thinkers tend to exhibit certain traits that are common to them. There are four questions for each trait created to measure the students' understanding of the text that they are reading. This qualitative study is analyzed statistically using R Project for statistical computing to measure the reliability test, validity test, and factor analysis from the collected data.

III. RESULTS AND DISCUSSION
The researcher collects the data by distributing the questionnaire to 80 respondents and then analyzed it using R Project for Statistical Computing software. This part was divided into two sections which are (a) result of the research statistic calculation, and (b) discussion of the statistic calculation results.
A. RESULT The first statistic calculation is the reliability test. The reliability test itself in research is the extent to which how the used instrument gives consistent results. Meaning that if the researcher wants to do the same research by using the same instrument, it provides the same reliability. The instrument is said to be reliable if the value of Cronbach's alpha is greater than 0.6.
The reliability test was done by using the alpha() function contained in the psych library. The reliability test of all traits of critical thinking is shown in Table 2. Another statistical test was to make sure that the instrument was feasible in certain situations. The feasibility of the instrument can be measured by doing a validity test. The validity test was done by the KMO() function contained in the psych library. The instrument was valid if the value from KMO() is greater than 0.5.
The validity test result of the critical thinking trait is shown in Table 3. The last statistical calculation for this research is the factor analysis. The factor analysis is used to find which factors have the relationship between the observed various independent indicators. The factor analysis calculation can be done by calling the factanal() function. The factanal() function is contained in the psych library, but it also needs another library which is the GPArotation library.
The factor analysis for the first trait of critical thinking is shown in Table 4. The second trait, the Analytic Nature, is shown in Table 5. The third trait, the Systematic by Method, is shown in Table 6. The fourth trait, the Inquisitive, is shown in Table 7. The fifth trait, the Judicious, is shown in Table 8. The sixth trait, the Truth-Seeking Ethos, is shown in Table 9. The last trait of critical thinking, the Confident in Reasoning, is shown in Table  10. All trait of critical thinking factor analysis is shown in Table 11.

B. DISCUSSION
The reliability test gives information that all instruments were used to measure the seven traits of critical thinking are reliable. Table 2, which is the reliability test result of all critical thinking traits, shows that the reliable test results are greater than 0.6.
The validity test gives information that all instruments for measuring the critical thinking traits are valid. The result from the KMO() function gives a value that is greater than 0.5. The validity test results for all traits of critical thinking can be seen in Table 3.
The factor analytic of each critical thinking trait give different results. Each instrument of the first trait, openmindedness, when measured with factor analysis gives good results. It was greater than 0.5, but only the last instrument of the open-mindedness traits gives the slightest value which is 0.575. It is almost equal to the limit value. The factor analysis result of the first trait can be seen in Table 4. This means that almost all instruments have relationships with the open-mindedness trait.
The second trait, analytic nature, the factor analysis results can be seen in Table  5. Only two instruments give a value that is greater than 0.5, the rest instruments are below 0.5. It means that the first and the fourth instrument were not having strong relationships with the second trait.
The third trait, systematic by method, the factor analysis result is presented in Table  6. All instrument's factor analysis values for this trait are greater than 0.5. The inquisitive, the fourth trait, factor analysis result can be seen in Table 7. The three instruments of four have values that are greater than 0.5. The fourth instrument gives slightly greater than 0.5, which is 0.535.
From the third and fourth traits, it can be drawn to a conclusion that all instruments are having relationships with the traits. The only one that has the value of 0.535, which is the fourth instrument of the fourth trait, means that the relationship is there.
The fifth, sixth, and seventh traits instruments, each have one instrument that value was below 0.5. This means that almost all instruments that use to measure the fifth, sixth, and seventh traits are having relationships with the traits. Table 11 gives the final result of the factor analysis of all critical thinking traits. From Table 11, it can be seen that the systematicby-the method has the greatest value, which is 0.903.

IV. CONCLUSION
The researchers can conclude that the dominant trait from critical thinking is the systematic-by-the method trait because the students rely on their logical reasoning therefore their understanding of the text is only for seeking the truth based on their knowledge. Based on Bloom Taxonomy, the result shows that their cognitive level is on the level of understanding that belongs to young learners' level.
The students should do more analysis to improve their critical thinking traits as reflected in Bloom's Taxonomy. To improve the level of critical thinking, the students must spend their time with reading activities. Combining with practicing their comprehension by reading different texts. It is common knowledge that by reading, one will gain knowledge of the world and be a critical thinker.