Promoting quality and equity in socially disadvantaged schools: A group- randomisation study

https://doi.org/10.1016/j.stueduc.2016.06.001Get rights and content

Highlights

  • The dynamic approach to school improvement (DASI) is presented.

  • An experimental study examined the impact of DASI on promoting quality and equity.

  • Students of schools which used DASI managed to make more progress in mathematics.

  • In the experimental schools the effect of SES on student achievement was reduced.

  • Implications for effectiveness research, policy and practice are drawn.

Abstract

This study investigates the impact of the Dynamic Approach to School Improvement (DASI) on promoting quality and equity. Forty primary schools in socially disadvantaged areas were randomly split into two groups. The control group was supported to develop action plans, whereas the experimental group used DASI. To investigate the impact of DASI on quality, student achievement gains in mathematics were measured. Using multilevel analyses the experimental schools managed to promote student achievement more than schools of the control group. To investigate the impact of DASI on equity, the impact of the socioeconomic status (SES) on student achievement was measured. The effect of SES was reduced only in the experimental schools. Implications for research, policy and practice are drawn.

Introduction

It is expected generally in society that education should achieve high results in different domains of learning and subject areas. This means that the criteria for effectiveness will be at the level to be obtained by individual students, classes, and schools with respect to those objectives (quality). However, it is also possible to look at the effectiveness of a school from a different angle, especially through investigating how far schools and teachers managed to reduce the learning differences between students coming from different socioeconomic backgrounds (equity). At this point, it should be acknowledged that there are different views of equity which emerge from different philosophical and ideological assumptions about the role of schooling in reducing differences in student learning outcomes with most dominant ones the meritocratic and the egalitarian views. Those supporting the meritocratic view consider differences in student learning outcomes to differences between students in talents and amount of work dedicated to schooling. However, the meritocratic view is difficult to implement as different hidden mechanisms operate in society which makes it harder for some students to develop their talents than for others, even if students are given access to learning opportunities (Lim, 2013). On the other hand, the egalitarian view points out that commitment to equity suggests that differences in outcomes of schooling should not be attributable to differences in the socioeconomic background of students. This implies that extra learning opportunities and guidance for socially disadvantaged groups of students are required to assure equal chances for all students. In this paper the different views of equity are not discussed but it is pointed out that one can look at the effectiveness of a school from a different angle, especially through investigating how far schools and teachers managed to reduce the impact of different background factors on student learning outcomes (equity). This results in educational objectives and criteria for educational effectiveness which are not related to a specific objective and specific students, but related to different groups of students in relationship to each other. The idea behind this is that education can contribute to social justice and democracy by closing the gap between students with regards to their background, especially their abilities and the socio-cultural status of their family (Lafontaine, Baye, Vieluf, & Monseur, 2015; Sammons, 2010).

However, international evaluation studies reveal that the performance of students from disadvantaged background both within and across countries differs substantially from other students. For example, the latest Programme for International Student Assessment (PISA) study revealed that across the Organisation for Economic Co-operation and Development (OECD) countries approximately 20% of the youth is not equipped with the basic skills in mathematics. Disadvantaged students are twice as likely as their advantaged peers to be poor performers, implying that personal or social circumstances may be obstacles to achieving their potentials (Schleicher, 2014). PISA also reports that 40% of the variation in student performance in mathematics is found between schools within a country. This implies that interventions aiming to improve the quality of underperforming schools are needed. Moreover, research shows that interventions supporting primary school students who are at risk have stronger effects than those addressing students at secondary school level (Scheerens and Bosker, 1997, Townsend, 2007). Furthermore, various syntheses of effectiveness programs aiming to improve the attainment of primary students with low basic skills reveal that whole school interventions are more effective (e.g., Borman, Hewes, Overman, & Brown, 2003; Hattie, 2009). In this context, this paper presents the results of a study investigating the extent to which a whole school intervention based on the Dynamic Approach to School Improvement (DASI) (Creemers & Kyriakides, 2012) can promote quality and equity in socially disadvantaged schools. Thus, the first part of the paper attempts to illustrate the importance of investigating the school effect on promoting quality and equity. We also refer to the importance of using DASI to undertake interventions at school level in order to promote quality and equity.

Section snippets

Measuring quality and equity at school level

Work on equal educational opportunities conducted fifty years ago by Coleman and his colleagues (Coleman et al., 1966) and Jencks and his colleagues (Jencks et al., 1972) argued that student achievement can be predicted mainly by background characteristics of students and especially their Socio-Economic Status (SES) and their intelligence. These studies claimed that after controlling for student background factors, not much variance in student achievement is left for teachers and schools to

Establishing a dynamic approach to school improvement: assumptions and features

Most reform policies either at macro or micro level usually try to change the role of various stakeholders and introduce new ideas/concepts and/or theoretical notions and/or a specific theory. For example, the introduction of a new curricula or textbook aims to raise the awareness of teachers about the importance of achieving specific aims and/or using specific teaching approaches such as the use of new learning approaches and/or differentiation of teaching. Also school improvement projects

Using the dynamic approach to school improvement to promote quality and equity

This section advocates for the use of DASI to promote quality and equity in education. In regard to its impact on quality, it is stressed that four experimental studies revealed that DASI had a stronger impact on improving learning outcomes than the participatory approach to teacher and school improvement which gives emphasis to professional experience. The first two studies were concerned with interventions addressing the quality of teaching (Antoniou & Kyriakides, 2011; Christoforidou,

Participants

At the beginning of school year 2012–2013, a sample of 40 primary schools of Cyprus in socially disadvantaged areas was selected and randomly split into two groups. No statistically significant difference at 0.05 level between the two groups in relation to the background characteristics of their students (i.e., gender, SES, ethnicity) was identified. A pre-measure of achievement in mathematics of all grade 4, 5 and 6 students (n = 5520) of the participating schools and of the functioning of

Findings

Multilevel analysis of mathematics achievement was conducted in order to evaluate the impact of DASI on promoting quality. The first step of our analysis was to determine which levels had to be considered in order to reflect the hierarchical structure of the data. Empty models with all possible combinations of the levels of analysis (i.e., student, class and school) were established and the likelihood statistics of each model were compared (Snijders & Bosker, 1999). An empty model consisting of

Discussion

Implications of findings for research, policy and practice are drawn. First, previous studies revealed that DASI had an effect on promoting student learning outcomes. However, improving quality without equity risks leading large economic and social disparities. Nevertheless, this study seems to reveal that by using DASI not only student learning outcomes can be promoted but also learning differences between students coming from different socioeconomic backgrounds may be reduced. The findings of

Evi Charalambous is a PhD student at the Department of Education of the University of Cyprus. She has participated in several international projects and her main research interests are in the area of educational effectiveness research and school improvement for promoting quality and equity in education.

References (59)

  • B.P.M. Creemers et al.

    Improving Quality in Education: Dynamic Approaches to School Improvement

    (2012)
  • T.G. Bond et al.

    Applying the Rasch model: fundamental measurement in the human sciences

    (2001)
  • G.D. Borman et al.

    Comprehensive school reform and achievement: a meta-analysis

    Review of Educational Research

    (2003)
  • W.B. Brookover et al.

    School systems and student achievement: schools make a difference

    (1979)
  • A.S. Bryk et al.

    Organizing schools for improvement: lessons from Chicago

    (2010)
  • C. Chapman et al.

    The Routledge international handbook of educational effectiveness and improvement: research, policy, and practice

    (2016)
  • S.L. Christenson et al.

    Family factors and student achievement: an avenue to increase students’ success

    School Psychology Quarterly

    (1992)
  • J.S. Coleman et al.

    Equality of educational opportunity

    (1966)
  • L.J. Cronbach

    Essentials of psychological testing

    (1990)
  • D. Demetriou et al.

    The impact of school self-evaluation upon student achievement: a group randomization study

    Oxford Review of Education

    (2012)
  • P. den Brok et al.

    Diagnosing and improving the quality of teachers’ interpersonal behavior

    International Journal of Educational Management

    (2002)
  • X. Dumay et al.

    Stability over time of different methods of estimating school performance

    School Effectiveness and School Improvement

    (2014)
  • R.R. Edmonds

    Effective schools for the urban poor

    Educational Leadership

    (1979)
  • K. Elliot et al.

    Exploring the use of effect sizes to evaluate the impact of different influences on child outcomes: possibilities and limitations

  • J.L. Epstein

    Effects on student achievement of teachers’ practices of parent involvement

  • X. Fan et al.

    Parent Involvement and students’ academic achievement: a meta- analysis

    Educational Psychology Review

    (2001)
  • A. Feuerstein

    School characteristics and parent involvement: influences on participation in children’s schools

    The Journal of Educational Research

    (2000)
  • W.A. Firestone et al.

    Prescriptions for effective elementary schools don’t fit secondary schools

    Educational Leadership

    (1982)
  • H. Goldstein

    Methods in school effectiveness research

    School Effectiveness and School Improvement

    (1997)
  • Cited by (15)

    • Unpacking equity. Educational equity in secondary analyses of international large-scale assessments: A systematic review

      2023, Educational Research Review
      Citation Excerpt :

      Further, the conceptualizations exhibit a number of inadequacies. First, the role of schools in counterbalancing educational inequity, as distinct from the responsibility of the child, is not always recognized (Charalambous et al., 2018; Field et al., 2007; Levin, 2003). Second, the term that is being defined (viz., equity) is often also used in the definition.

    • The evaluation of students’ progression in lower secondary education in Brazil: Exploring the path for equity

      2022, Studies in Educational Evaluation
      Citation Excerpt :

      Hanushek et al., 2022, p. 20). The literature on value-added models (Everson, 2017; Leckie & Goldstein, 2019; Levy et al., 2019) has addressed the relationship between students’ SES and achievement showing inspiring results that demonstrate the effectiveness of some schools (Charalambous et al., 2018; Kyriakides et al., 2019; Sammons, 2007; Sammons et al., 1995; Thomas et al., 2007), and in particular their differential effectiveness (Palardy, 2008; Strand, 2010, 2011, 2016b) in closing the gaps. The study conducted by Marks (2017) about Australian education, leads the author to state that “SES does not have a strong relationship with student outcomes and the relationship is particularly weak when taking into account much stronger influences: prior achievement and cognitive ability” (Marks, 2017, p. 206).

    View all citing articles on Scopus

    Evi Charalambous is a PhD student at the Department of Education of the University of Cyprus. She has participated in several international projects and her main research interests are in the area of educational effectiveness research and school improvement for promoting quality and equity in education.

    Leonidas Kyriakides is Professor of Educational Research and Evaluation at the Department of Education of the University of Cyprus, Cyprus. His main research interests are in the area of school effectiveness and school improvement and especially in modelling the dynamic nature of educational effectiveness and in using research to promote quality and equity in education. Leonidas acted as chair of the EARLI SIG on Educational Effectiveness and as chair of the AERA SIG on School Effectiveness and Improvement.

    Bert (Hubertus Peter Maria) Creemers is Professor emeritus in educational sciences at the University of Groningen, The Netherlands. His main interest is educational quality and equity in terms of students learning outcomes at classroom school and system level. Together with Leonidas Kyriakides he works on the development and testing of the dynamic model on educational effectiveness and the approach based on this model for the improvement of education.

    View full text