An empirical review of a hybrid teacher education programme: Lessons from South Africa

Scholars have recommended hybrid learning to combat education problems in emerging economies due to their challenging contexts. It potentially offers a means to address growing demand without sacrificing quality or increasing costs. In this article we report on a new “hybrid” distance teacher education programme in which we sought to address the requirements of new policies (both institutional and national) by combining the blended and distance education approach. We adopted a pragmatic qualitative approach, rooted in a communitarian perspective and distance education theory. Although progressing slower than expected, the programme’s implementation to date has provided lessons that bolster the value of blended learning theory and practice in a hybrid model. The study also highlighted the critical role that the mode adopted for teacher training can play in shaping teachers’ practice. However, to work more effectively in an emerging economy, a more substantial teaching presence is suggested, coupled with modularised and ongoing information and communication technology (ICT) training and support for staff and students as areas for further research.


Introduction and Background
In October 2016, the University of Pretoria introduced a new programme, the Bachelor of Education (BEd) Honours (Hons) in Teacher Education and Professional Development (TEPD), which sought to address new policy requirements (Department of Higher Education and Training [DHET], 2015) that all teacher education graduates demonstrate basic ICT skills.Teachers must be accustomed to the use of ICTs to align teaching and learning with the 21st-century skills required of students.The university's move helped it achieve its strategic drive to adopt a "hybrid" model for all its programmes, irrespective of the original mode.As noted more recently by Nørgård (2021), there is a need for clarity on what we understand by the term "hybrid" and how it differs from, for example, online learning.Although the term could be understood differently in different contexts (see Li, Li & Han, 2021; Raes, Detienne, Windey & Depaepe, 2020, for example), for the unit in question, hybrid learning refers to a teaching model that combines blended and distance provision.All assessment is, however, completed online.Therefore, success in learning depends on access to the online learning management system (LMS), known as ClickUP -University of Pretoria.
Before introducing the new hybrid learning model, the technology profile of distance students showed that only 30% of students had regular access to ICTs and connectivity, another 30% had irregular access and about 40% had little or no access (Aluko, 2015).This profile informed the design of the new programme during 2016.The integration of online learning into distance learning programmes poses particular challenges for institutions and students in a context characterised by variable access and relatively high data costs in relation to salaries (Hülsmann & Shabalala, 2016).The challenge was, therefore, to design an implementation model for the new programme in a way that would address both internal and external policy directives, take cognisance of what had been learned from past practice (Aluko & Hendrikz, 2012), and be feasible in terms of financial and other resources available to both the students and the institution.

Rationale and Research Questions
Some of the first cohorts of students were due to complete the programme between April and October 2018.This seemed an opportune time to undertake a formative evaluation of the programme.Therefore, the main research question that informed this project was: To what extent does the newly introduced "hybrid" programme address students' learning needs from the point of view of key stakeholdersstudents, tutors and module coordinators?
Two sub-questions further guided the project: 1) To what extent do key stakeholders agree we are teaching the right things?
2) To what extent do key stakeholders think we are teaching things in a right way?

Literature Review
It is widely argued that the use of ICTs in teaching and learning helps to enrich teachers' productivity and students' performance (Ojo & Adu, 2018).However, generally, the provision of education in emerging economies faces various problems (Lalima & Dangwal, 2017).Scholars have recommended hybrid learning as a possible solution, partly because of its ability to meet the 21st-century expectations of students and address the challenges of limited resources (Dlamini & Coleman, 2017), although there is no clear agreement on how face-to-face and online learning should be blended optimally (Rajkoomar, 2015).More broadly, hybrid or mixed-mode learning has been used to refer to programmes in which various instructional design systems are employed to enrich teaching and learning experiences (Lalima & Dangwal, 2017).
Generally, achieving active learning in an online environment is more challenging than in traditional face-to-face environments (Khan, Egbue, Palkie & Madden 2017), as is achieving high student retention and attainment (Sahawneh & Benuto, 2018).Among the reasons that students drop out of online courses is the absence of social presence due to a lack of physical interaction with the lecturer or other students (Zilka, Cohen & Rahimi, 2018).Furthermore, lecturers need support in designing and delivering online modules, and they need continuous professional development to update their technological and pedagogical skills (Tshabalala, Ndeya-Ndereya & Van der Merwe, 2014).However, despite the challenges, developing countries have forged ahead to adopt blended and hybrid learning (Cleveland-Innes & Wilton, 2018).
Staff and student satisfaction are essential to assessing a program's quality.The teaching design of the lecturer, organisation of the online environment, and the instructor's presence are also determining factors that influence quality (Costley & Lange, 2016).On the other hand, students need to embrace the opportunities and skills associated with online learning to reach their learning goals (Yilmaz, 2017).Concerning this study, research shows that some teachers are still slow in accepting the value that ICTs can bring to teaching and learning, which is in opposition to their traditional role of transmitter of education that they have been used to (Ojo & Adu, 2018).
Subsequently, institutions need to evaluate how a programme could prepare students to attain knowledge and competence to work in a specific field of study (Masoumi & Lindström, 2012).Effective hybrid learning is associated with practical online activities that could facilitate and direct cognitive and social processes (Moradi, Liu, Luchies, Patterson & Darban, 2018).Online interaction is essential for learning effectiveness (Sun, Abdourazakou & Norman, 2017).Learning effectiveness could be enhanced when students and lecturers are engaged in hybrid activities (Ogange, Agak, Okelo & Kiprotich, 2018;Sun et al., 2017).The students' and lecturers' online presence should create a meaningful learning environment where effective learning could take place (Sun et al., 2017).
Lecturers' effective instructional design could positively affect students' perceived learning and satisfaction (Costley & Lange, 2016).Yilmaz (2017) argues that e-learning readiness is a determining factor ensuring student satisfaction.Additionally, factors such as students' experiences in hybrid learning, access to off-campus support, access to learning resources and students' motivation to use the internet could influence hybrid learning effectiveness and satisfaction (Hao, 2016).Student feedback also plays an integral part in student satisfaction (Costley & Lange, 2016).Students expect timely feedback from lecturers and administrative personnel (Costley & Lange, 2016).Unfortunately, students without technological skills will struggle to participate in hybrid learning activities (Borup & Stevens, 2016).Therefore, institutions should investigate how they could support students in acquiring these skills.
With this study we sought to investigate whether the promise held out in the literature on hybrid learning would prove an effective hybrid learning solution when combined with our previous distance learning experience.

Conceptual Framework
The conceptual framework adopted for this study emanated from the communitarian perspective neatly summarised in Ubuntu philosophywe are made human through our relationships with other humans (Letseka, 2016).The interaction between students and content, students and peers, and students and tutors, in both online and face-to-face tutorials, was therefore considered a vital dynamic to explore.Within this Ubuntu framework of the self, concerning others, we adopted a transactional approachworking with teams of people in multiple locations and contexts to develop and/or review the learning programme and supporting systems arrived at through iterative processes of discussion and compromise (Dewey, 1929).
Previously, distance learning provision at the institution had been informed by Moore's (2007) concept of transactional distance and the interplay between structure (provided in approved curricula and learning resources), dialogue (initially via telephone, face-to-face contact sessions and feedback on assessments and later by electronic mail (email) and Short Message Service [SMS] technology) and autonomy (for instance, students were able to choose when to register).But, when it came to the review of the hybrid model, because of the increased online component, it was felt that the CoI framework might be appropriate, even though it had not informed the original design of the hybrid programme.
Generally, an inquiry is a process that leads to deep and meaningful understanding because it involves critical thinking, problem-solving and the growth of personal and collective knowledge (Garrison, 2014:148).However, we assert that inquiry does not take place in isolation.It involves three presences: the cognitive presence, the social presence and the teaching presence (Garrison, 2014).
Social presence is the ability to project one's identity in the online community to be perceived as a "real" person (Garrison, Anderson & Archer, 1999:94).Cognitive presence is the extent to which learners can construct and confirm meaning through sustained reflection and discourse (Garrison et al., 1999).Teaching presence is the "design, facilitation and direction of cognitive and social processes for the purpose of realising personally meaningful and educationally worthwhile learning outcomes" (Anderson, Rourke, Garrison & Archer, 2001:8).
Despite some unresolved issues (such as the possibility of the framework to lead to significant learning and affirmative learning goals) surrounding the framework (Kreijns, Van Acker, Vermeulen & Van Buuren, 2014), scholars have found it beneficial for blended courses because the mode can provide the benefits of face-to-face and online learning.The model remains widely used and researched in other settings such as course development and new technologies (Anderson, 2017;Guo, Saab, Wu & Admiraal, 2021).
As a consequence of choosing this conceptual framework, we revised the research sub-questions as follows: 1) To what extent do key stakeholders agree that we are teaching the right things (that is, is the content fit for purpose)?2) To what extent do key stakeholders think that we are teaching things in a right way (in terms of cognitive, social and teaching presence)?

Research Design and Methodology Design
The main aim of pragmatist ontology is action and change (Goldkuhl, 2012).This highlights what we wanted to achieve with this study: to determine where the institution needed to improve the programme from the perspective of key stakeholders.Pragmatic ontology analyses current events and interprets them from a realistic point of view (Maarouf, 2019).We adopted the single case study design using a qualitative approach to review the relationship between the programme, lecturers and students with the aim of evaluating the programme through stakeholders' perceptions.This strategy provided opportunities to do an in-depth analysis of the programme using various data collection instruments (Creswell & Creswell, 2018) through which detailed information was acquired (Yin, 2014).

Data Collection Instruments
The data collection instruments included a literature review, documents, an open-ended survey and interview schedules (for both individual and focus-group interviews), and review criteria for learning materials.
The development of the instruments was informed by quality criteria developed by the distance education community in South Africa (National Association of Distance Education Organisations of South Africa [NADEOSA].n.d.).The fact that the criteria were developed by distance education experts and used by other distance education experts for similar purposes over several years (Martin, Polly, Jokiaho & Birgit, 2017;Mostert, 2007) suggested that the criteria were both valid and reliable for use in the context of distance education provision in South Africa.One of the authors of this paper has been directly involved in several programme and courseware reviews and has used variations of these instruments in multiple contexts.The survey and interview instruments are available on request.
Question items for the student survey were closed-ended to stimulate set responses from as many of the respondents on the content, programme delivery, feedback and support.It would not have been possible to conduct interviews with all the students because of the number involved.In addition, not all students attended contact sessions; many did not have the necessary technology tools for online interviews; furthermore, they were widely dispersed geographically.
The review instruments on learning resources given to the learning experts, the online LMS expert and the interview schedules (for students, tutors and module coordinators) contained question items guided by the main research questions.

Population and Sampling
The target group for the student survey was the first cohort of the new programme (300 students).Due to the low enrolment, we adopted the total population sampling technique for the survey, which allows respondents to have equal chances of participation in the research (Haque, 2010).
The population for the participants of the focus-group discussions included 300 students, eight module coordinators and eight module experts (representing the eight modules presented in the programme), and one learning management expert.
Students in this programme were widely dispersed and did not all attend the voluntary contact sessions.Based on past history of attendance, we felt confident that we would be able to interview 40 students.With this sample size, there was a 70% chance that the real value was within ±2.89% of the measured value (checked on Calculator.net, 2023).Taken together with the 100% sample of teaching staff, we felt that we would get a reasonably accurate picture.Stakeholders were conveniently sampled, resulting in 40 students from the five contact session venues, eight module coordinators, six module experts who participated in the review of the content of the learning material, and one LMS expert who reviewed the online aspects of the programme on the university's LMS.The total number of participants was 201.The information on the distribution of the participants in relation to the instruments is displayed in Table 1.We manually distributed and collected the survey during a face-to-face contact session with the students.This was with the aim of generating a better response rate.
The review criteria were sent to eight MERs, while the LMSE was given temporary access to the university's LMS to review its design and use.
We interviewed eight MCs individually and held five FG discussions comprising 40 students from the five contact session venues.The discussions took place during the sessions.

Data Analysis
Data analysis took the form of thematic analysis (Caulfield, 2023) and involved the identification of codes, themes and sub-themes from the qualitative data.
The University of Pretoria has ethical clearance to collect and use anonymised student and teacher information for quality assurance and research purposes related to distance education provision.

Findings
Table 2 shows the biographical information reflecting the gender and age brackets of the student respondents.Of the 146 participants who participated in the survey, 103 (70.547%) were female, while 41 (28.08%) were male.This tallies with the demographics of teachers in the country (Skosana, 2018) and enrolled students in distance education programmes at the institution.

Findings from the Thematic Analysis
The thematic analysis results were grouped into the three main categories of the CoI framework, which served as the main themes.Thirteen sub-themes were developed during the data collection process, as summarised in Table 3.Most of the sub-themes are discussed in the teaching presence category.

Teaching Presence
Regarding teaching presence, which denotes the role of the instructor, participants had the following to say under each sub-theme.
The findings reveal that most staff participants involved in distance education did not have any background in this teaching mode.Many felt that the institution had not equipped and prepared them to teach effectively, while some felt that their dedication was to the contact mode.The verbatim quotations below confirm this: It was quite a challenge because I did not have any distance experience previously … (MC2).This is the department where … my first line of work is.Distance has been the tag-on late within the year ... (MC1).
The BEd Hons programme is a postgraduate qualification that aims to develop the students' research skills with a focus on areas of specialisation.While some staff participants felt comfortable with this focus, some expressed concern.A participant commented: "We force students to write a proposal … it is extremely academic, and they struggle a lot" (MC7).
Most students indicated that the content presented in the modules was relevant and of a good standard.This extract from the student qualitative survey buttressed this: "Yes, we have gained more skills on how to conduct research … it also develops us professionally" (SS3).
This was confirmed during the FG discussions as highlighted by a student: "According to me, the alignment of the programme is of a good standard because it unpacks the aims and it improves our understanding of the programme" (FGSRB1).
In addition, students felt that it prepared them thoroughly for a master's degree.Buttressing this, a learning expert said: "I think that the overall programme is valuable.An Honours degree through distance education where many students are already in practice is beneficial" (MER2).
Most tutors and academic supporters are familiar with the use of the institution's LMS.A tool such as a discussion board is considered helpful since it provides a space where students and tutors can interact with each other asynchronously.The LMS expert emphasised that [o]nline discussions are very helpful for students studying independently and/or remotely … Many students study in a language other than their mother tonguean asynchronous discussion forum provides the opportunity to construct a contribution thoughtfully and to review and edit the language before submitting it.(LMSE) Nonetheless, it is quite worrisome that the LMS expert indicated: "While there were a few indications of facilitator/lecturer presence, the majority of modules did not display any such presence at all" (LMSE).
All the learning experts credited the quality of the assignments provided to students.One of them said: "Yes, the activities (e.g., assignments) are clearly in line with the purpose and outcomes" (MER1).
Furthermore, students and staff participants agreed that feedback on assignments was essential but insufficient.A student said: "There are some assignments where there is no feedback.When we get feedback, sometimes you find that you fail the assignment and you are supposed to use that assignment to do Assignment 3" (FGSRB6).
Although statistics from the unit showed that less than 30% of the students attended contact sessions, those that did felt that the sessions added value to their learning experience.A participant said: "If you do not attend the contact session, you'll be lost forever" (FGNS3).
The student participants' viewpoint about the support they had received from tutors was mixed.The following response from a student participant provides an example: "… there is one of my modules that I experienced a challenge.Then I forwarded an email, it took long time for the tutor to respond" (FGSRB7).
The mixed reaction was also confirmed through the survey report.
However, the participating MCs were particularly concerned about the payment of tutors.They felt that tutors were underpaid, a point also stressed by tutors.An MC lamented: "I feel humiliated when those people sitting there have doctorates and you know, and then I tell them but this is the kind of payment you are going to get …" (MC5).

Cognitive Presence
The cognitive presence shows to what extent students can construct and confirm meaning through sustained reflection and discourse.
Most students agreed that the programme was academic to equip them for a master's degree and broaden their horizons by showing them what they could achieve in the future.A student said: "Now I know that it was not only for the classroom teacher, but for the fact that I can broaden my horizons.I can choose whether I want to stay in the classroom or … do something else" (FGSNS6).
Unfortunately, some students struggled to find the correlation between their work and their studies.Such students indicated that they found modules on policy and management more relevant than those focused on developing research skills.This ties in with the earlier concerns of some MCs.
The LMSE asserted that online discussions support reflection.She had the following to say: "Forums enable students to express their own thoughts and opinions in a safe learning space, and to respond to and support other students.Encouraging this academic discourse is valuable …" (LMSE).
However, staff participants felt that students were not extrinsically motivated to participate in online discussions and activities.The following comment emphasises this: "We do not have selfdirected learners or students and (they do not bother) if they miss something on clickUP, even if there are marks involved" (MC8).
Another comment highlighted the challenge of students only being in "survival mode."This made them focus on completing their research proposals and passing a module, overlooking the online communities of practice where they could learn a lot from one another.
All the external experts attested to the relative accessibility of the learning material language that enabled student-centred learning outcomes, which most students affirmed.
However, all the MCs agreed that students' academic writing skills were limiteda problem not confined only to distance students, and has to do with students' backgrounds.The following comment illustrates this: "… they do not know how to express themselves in writing, and especially… with academic writing.It is often SMS language … we need some kind of language intervention" (MC1).

Social Presence
For social presence to be effective, students are expected to participate online.However, this expectation is not without its challenges.
Although students received ICT training as a prerequisite for the programme, most indicated the need for a follow-up training session because they still struggled to navigate the LMS.However, some acknowledged that they disregarded the additional requirements of the programme, as a student attested: "I think some of us … we are not (truthful) when we were asked questions.I remember (a marketer) asked this question: Are you computer literate?"(FGSNS2).
Many students lamented that older students, who were often not computer literate, struggled with technology.A participant said: "If you look … into the age of the people doing the Honours, it may be older teachers than the younger generation.That will tell you about their computer literacy level …" (SS50), This can be bolstered from Table 2 that shows that 59 (40.4%) of the studentparticipants were over 40 years old.
Apart from this, students lamented the cost of data.
Regarding students' use of the LMS, a tutor said: "They are definitely not engaging at all" (FGT2).
In addition, many of the students were under the impression that they needed a computer to access the LMS.They were not aware that they could participate in discussion forums on their mobile devices.Students who are not comfortable using the LMS will attempt to find alternative ways to get support, as suggested by a staff member: "…students will be more comfortable when they can e-mail or send a WhatsApp" (MC5).
A significant reason suggested for this trend was that some students were not comfortable asking questions on an online platform, whereas with email, "…it is between you and them" (FGT3).
A tutor suggested that tutors' email information be removed from the LMS to attract students to the LMS.The tutor also felt that students did not see the value of learning from one another, while "most of the time, they leave things to the last moment" (FGT5).
Most students emphasised no incentive to participate in online activities that did not add to their marks.They would rather spend time on their assignments, citing their busy schedules as the major reason.
Some also preferred the face-to-face discussions, as indicated by a participant: "It is difficult to do most of the activities online.They are not as informative as face-to-face discussions..." (SS60).
The participants' possible reasons were a "lack of access to the internet" and "relevant technical skills." These issues have led to many students withdrawing from the programme.A participant said: "We do not understand how to use computers.That is why many people did not finish with us … many do not know how to even upload the assignment" (SS4).
Nonetheless, another participant praised the online component: For me, the purpose of this online is very good as it was designed … when I began this programme, there was little that I knew about online activities ... I can now go to email and access information very easily.(FGSRB7)

Discussion of the Findings
The Ubuntu framework supports different nuances of relationships and gives room for constant inquiry, leading to change.The Ubuntu and CoI frameworks guided the discussion of the findings.The findings elaborate the extent to which the institution is teaching the right things and whether it is teaching things in the right way to determine the extent to which the newly introduced hybrid programme performs in terms of both student success and student satisfaction.
Is the Institution Teaching the Right Things (that is, is the Content Fit for Purpose)?
The question, Is the institution teaching the right things?, relates to the content and purpose of the programme that can be linked to its outcomes.According to the Centre for Teaching Support and Innovation, University of Toronto (2020:para.1), "learning outcomes are statements that describe the knowledge or skills students should acquire by the end of a particular … programme, and help students understand why that knowledge and those skills will be useful to them.Overall, students' learning outcomes are a key factor of institutional performance…" (Tremblay, Lalancette & Roseveare, 2012:41).
The broad aim of the minimum requirements for all teacher education qualifications in the country is to ensure that the higher education system produces teachers of high quality, in line with the needs of the country (DHET, 2015).Thus, literature (Institute of Museum and Library Services, 2015:para.1)asserts that the purpose of a programme is to achieve outcomes that should strive to answer the question: We do what, for whom, (and) for what outcome or benefit?In the case of this study, the national and institutional outcomes, and the aspirations of graduates, were all catered for.According to the participants, the content of the programme aligned with its purpose.
In addition, the data show that the programme gave students the opportunity to pursue a higher degree.This tallies with the intention of the DHET (2015:s. 13.16) that the BEd Hons, as the first postgraduate degree in education, should "prepare students for research-based postgraduate studies" and should serve to "consolidate and deepen a student's knowledge of the field and develop research capacity in the methodology and techniques of that field."Based on the CoI framework, the findings in this section indicate that cognitive presence permeates the programme.Although there are diverse views on the extent to which cognitive presence can be demonstrated in education settings, Akyol and Garrison (2011) have linked the presence to perceived and actual learning.Some of the MCs expressed concern regarding the academic nature of the programme.The group believed that a distinction should be made between teacher training for classroom purposes and teacher training for research.
Some learning expert participants identified some areas of improvement (for example, the need for more in-depth content in some areas), indicating the need for education providers to continuously improve their programmes.
Is the Institution Teaching Things in a Right Way (in terms of Cognitive, Social and Teaching Presence)?
In this section, we attempted to answer the question, Is the institution teaching things the right way?We did this by focusing on the intersection that existed in the three presences identified by the CoI Framework: the cognitive, social and teaching presences.Garrison et al. (1999:88) refer to these as the elements of an educational experience.
According to Anderson et al. (2001), teaching presence is the design, facilitation and direction of the social and cognitive processes for the purpose of realising relevant learning outcomes.As is the case in this study, the responsibility for creating the right teaching presence lies with the MCs (Van Niekerk, 2015).The data show evidence of the "careful selection and coherence of content" as identified by the learning experts.The MCs also made use of "student experience." In addition, they commended the "student introduction and orientation to the modules", which made it possible for them to link "theory to practice."Other aspects of teaching presence in the programme were the contact sessions during which service providers presented the modules, and the feedback on student assignments.However, some of the students complained about the lack of comments on some of their marked assignments and the lack of rubrics in a module.Kreijns et al. (2014) advocate for a more substantial teaching presence in such instances.In addition, Swan (2016:16) asserts that "some ways to enhance teaching presence include designing courses for clarity and consistency, and learner choice, flexibility and control, with diverse activities to be completed every week, and providing frequent opportunities for public and private interactions with students."Other ways, according to the authors, are "providing students with timely and supportive feedback, and applying collaborative learning principles to support small group discussion and collaborative projects." Unfortunately, the data show that, apart from the contact sessions (teaching presence), during which presenters facilitate sessions and where students can meet other students in attendance, many of the student participants did not participate in online activities (social presence).This was even though modules were designed to enhance social presence on the LMS and that all students were expected to attend a training session on the use of the university's LMS before they began their modules.Reasons given by student participants for their inactivity online included problems with internet connectivity, the cost of bandwidth, their lack of technical skills (which they linked to their age profile) and the lack of responses to students' academic queries by some e-tutors.
Although evidence from the data shows that most student participants struggled with access and ICT skills, there is evidence that technology adoption gives students better exposure, meeting the national objectives.Such acquired skills will assist participants in improving their teaching tasks at school.Some students advocated for the use of WhatsApp for support purposes because they had formed private WhatsApp groups with other students that they had met during the contact sessions.The application is available to everyone and is inexpensive to use.Literature (Kustijono & Zuhri, 2018) shows that, despite its challenges, some scholars are advocating for the use of the application partly for the reasons that the students gave.
Social presence is the ability of participants to project their individual personalities to identify and communicate with the community and develop interpersonal relationships (Garrison, 2009), although Swan (2016:13) argues that the presences in the CoI Framework "are not attached to actors, but can be assumed by any of the participants or even the materials in an online or blended course."Nonetheless, scholars (Gaur, 2015;Mtshali, Maistry & Govender, 2020) aver that more research is needed on the implementation of social presence, especially in the developing context.

Conclusion: Implications of Findings for Theory, Policy and Practice
Institutions that adopt the hybrid mode need to provide all participants with the necessary support and training to maximise the affordances of these frameworks.Both MCs and students must be willing to take responsibility for their roles.Regarding the CoI Framework, the findings reinforce the importance of cognitive presence (both within modules and across the programme) and teaching presence (structure, timely guidelines, constructive feedback and suggested readings).Unfortunately, both teaching and social presences work in tandem.The former's absence or partial presence negatively impacts social presence by increasing transactional distance (Zilka et al., 2018).The Ubuntu framework also emphasises the value of collaboration among all stakeholders in the field.
We noted that social presence does not come through strongly concerning student-student interaction.Although, as the data show, this could be attributed partly to technology challenges, a lack of ICT skills, a lack of adequate tutoring support and a lack of faith or interest in peer engagement.However, in a hybrid programme with an online component, research shows a strong link between social presence and distance education students' motivation (Aliabadi & Zare, 2017).
The study brings to the fore the importance of involving key stakeholders in the research on assessing the quality of programmes because they are the end-users.The iterative stance of the university on the quality of its programmes has enabled it to monitor and improve on quality through operational research.To ensure the quality of distance education programmes, scholars have suggested total quality management approaches, including student experience, which will enhance student success (Tait, 2015).
Based on the continual monitoring of the quality of the programme at the time of writing, there have been improvements in the introduction of more focused specialisations, increased tutor structure and support, and the development of an ICT module that gives newly enrolled students earlier and better exposure to ICT skills.For students to familiarise themselves with the institution's LMS, a new module tagged "Module O" was developed; there is ongoing research on the impact of this on student learning.
In addition, the unit is also championing the current review of the national quality criteria to contextualise the 21st-century learning environment to align theory with practice in the mode while being mindful of the potential barriers (Mphahlele, Seeletso, Muleya & Simui, 2021).The study highlights the critical role of teacher training in shaping teachers' practice.If we wish teachers to be more inclusive, socially constructivist and technology-confident in the classroom, which should be reflected in the nature of the training they receive.The Unit for Distance Education, University of Pretoria (UP UDE) has made some progress in this direction, but the review indicated that more work needs to be done.Therefore, suggested directions for future research include further research to accentuate the importance of student-student interaction and how this can be enhanced in a hybrid distance education (DE) programme; the need to contextualise quality criteria in order to provide adequate support to both staff and students; and the monitoring of the areas of need in ICT due to the disruptive changes that take place in the field.
Limitations of this mixed-methods study include the low number of participants in the survey, which has made it impossible to generalise the findings.In addition, findings of the study could have been different if the design of the new hybrid programme had been guided by the CoI framework.

Table 1
The distribution of the participants in relation to the instruments

Table 2
Gender and age brackets

Table 3
Sub-themes identified during data analysis