Who feels taught to lead? Assessing collegiate leadership skill development

C. Douglas Johnson (School of Business, Wake Forest University, Winston-Salem, North Carolina, USA)
P. Wesley Routon (Georgia Gwinnett College, Lawrenceville, Georgia, USA)

Journal of Leadership Education

ISSN: 1552-9045

Article publication date: 20 February 2024

Issue publication date: 2 April 2024

124

Abstract

Purpose

Using a panel of over 433,000 college students from over 600 institutions of higher education in the USA, we investigate students’ opinions of leadership skill development during their undergraduate tenure.

Design/methodology/approach

The data used in this analysis come from the Higher Education Research Institute, which runs the Cooperative Institutional Research Program (CIRP) housed at the University of California, Los Angeles. Among others, the CIRP administers two surveys known as The Freshman Survey (TFS) and the College Senior Survey (CSS).

Findings

The present research supports the extant literature and conventional wisdom of academic and student affairs professionals with regards to engagement in leadership classes or training where students have an opportunity to increase their knowledge bases through course content, and when there are opportunities for them to apply leadership principles, the students are more likely to report an increase in leadership capacity upon completion of their collegiate degree.

Originality/value

If colleges and universities are serious about fulfilling their espoused visions, then it is essential that awareness of leadership courses and applied opportunities be heightened and made a strategic priority to ensure resources are allocated in appropriate places to support these key efforts. It also suggests greater collaboration between academic and student affairs, as well as other departments (e.g. athletics and centers), is needed, as well as prioritizing experiential learning.

Keywords

Citation

Johnson, C.D. and Routon, P.W. (2024), "Who feels taught to lead? Assessing collegiate leadership skill development", Journal of Leadership Education, Vol. 23 No. 1, pp. 50-65. https://doi.org/10.1108/JOLE-01-2024-0013

Publisher

:

Emerald Publishing Limited

Copyright © 2024, C. Douglas Johnson and P. Wesley Routon

License

Published in Journal of Leadership Education. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


Introduction

While relatively young as a scholarly discipline (House & Aditya, 1997), leadership principles and theories abound: situational leadership (e.g. Blanchard, Hzigarmi, & Nelson, 1993), Fieldler’s contingency leadership (1967), path-goal theory of leadership effectiveness (House, 1971), transactional and transformational leadership (Bass, 1997), authentic leadership (George, Sims, McClean, & Mayer, 2007), leader–member exchange (Graen & Uhl-Bien, 1995), etc. In fact, it has been presumed there are likely as many definitions, theories (or conceptualizations) and principles of leadership as there are people who have studied it, including academic scholars, practitioners and laypersons. In turn, there are likely as many approaches to teaching leadership as there are individuals engaged in this work (e.g. Sinclair, 2007; Wren, 1994).

Given the vast body of leadership literature, those who teach leadership, whether in the classroom or a practical setting, must decide which theories/principles to cover in the allotted timeframe and which pedagogical method to employ in an effort to affect learning and develop critical leadership skills (e.g. Escamilla & Fraccastoro, 2018; McCarron, Zhou, Campbell, Muscente, & Schierbeek, 2022; Stetch, 2008; Yip & Raelin, 2011). This has become increasingly relevant as many, if not most, academic institutions posit as part of their respective missions to prepare holistic leaders who will impact the world (e.g. DeRue, Sitkin, & Podolny, 2011; Rosch, Collier, & Thompson, 2015). Business entities, government agencies and communities also spend billions annually on leadership development activities (Avolio & Hannah, 2008) to provide specific training for their organization, sector or community and/or to fill the knowledge gaps that may not have been filled previously (Sowcik & Allen, 2013). Avery and Thomas (2004) challenge facilitators of knowledge relative to diversity management competency to consider what specific topics should be included when determining course content, what specific pedagogies should be employed and what, if any, biases may be at play in making such a determination. Similarly, these questions must be considered within the teaching of leadership domain given the various delivery methodologies that could be employed and the role that the leadership educator plays in the development of future leaders (Guthrie & Jenkins, 2018; Wiborg, 2022). Additionally, consideration should be given to the leaders or leaders-in-training, who will be engaged in the learning process: what prior knowledge and/or experiences do they bring with them (e.g. McCarron et al., 2022)? What is their perspective on leadership and the role of leaders?

Philosophical differences on which epistemological and pedagogical approach to take in the teaching of leadership exists (Yip & Raelin, 2011). For example, Parks (2005) posits that education is fundamental to leadership development, while Robinson and Wick (1992) contends that formal training and educational setting have little to do with leadership development and it depends more on practical, first-hand experiences. Further, as described in greater detail below, the Handbook for Teaching Leadership: Knowing, Doing, & Being (hereinafter referred to as The Handbook; Snook, Khurana, & Nohria, 2011) offers many different best practices and approaches. These differences may exist given personal experiences, academic disciplines, whether the instructor believes leaders are born or made, as well as many other significant factors. Some believe that a theoretical approach should be taken to teaching leadership, while others prefer a more practical, hands-on approach with experiential learning, project-based work projects, etc. Empirical research is still needed to assess which is more effective in preparing the next generation of leaders. Does the approach depend on the particular students one is trying to impart such wisdom? The professor or trainer facilitating the leadership content either in a collegiate classroom or applied setting (e.g. Escamilla & Fraccastoro, 2018)? Or, should one approach fit all?

In 2009, Harvard University hosted a conference, “How Can Leadership Be Taught,” where they convened professors to grapple with these questions and share best practices. The Handbook (Snook et al., 2011) was one outcome of the conference and is now a useful compendium of information for instructors to reference. Thematically, The Handbook is divided into three sections: knowing, being and doing. These are helpful in framing the ways by which faculty may approach teaching leadership, linking “knowing” with the theoretical aspects of the course content, the “doing” focusing on the application in practical settings or through course active learning and “being” by actually assuming the roles and integrating it into their person. In a critique of The Handbook, Clawson (2011) concurs with the authors of The Handbook in that it provides “a single eclectic reference point for educators who are responding to the burgeoning demand for courses on leadership” (p. 535) and attempts to present a framework for the contributors (and readers) to structure the content, which was not easily implemented.

In a special issue of the Academy of Management Learning and Education journal, DeRue et al. (2011, p. 369) present a follow up to the conference which focuses on the “scarcity of rigorous theoretical and empirical research on the design and delivery of leadership teaching and education.” The contributors employ various research designs and methods to examine the learning and educational implications of different philosophies, designs and approaches to teaching leadership. This special issue is a more manageable set of papers compared to The Handbook, yet does not really address teaching leadership to undergraduates and answer some basic questions that professors tend to grapple with when tasked with teaching leadership. One objective of the present research is to fill that gap.

Focusing on undergraduate students, our research questions are fourfold. First, as viewed by the students themselves, how much change in leadership ability is taking place during one’s college tenure? The answer to this question will help inform if higher education is serving one of its purposes: developing the next generation of leaders (DeRue et al., 2011). Second, how much does the answer to our first question vary across student demographics, institution type and program of study (or major)? With this information in hand we may judge, among other things, which (if any) students are being “left behind” in terms of the acquisition of these skills. Third, do students who matriculate with lower leadership abilities increase them the most during their college tenure or is the opposite true? Asked differently, does higher education impart leadership skills broadly or does it instead only enhance the skills of those who are already natural leaders or had previous experiences that propel them into leadership positions or to take leadership courses in college? Lastly, after controlling for a host of relevant variables, we estimate which college experiences and courses of study most affect changes in these abilities. The answer to this last question may inform educational policy, particularly at colleges and universities where instilling leadership is a stated institutional goal or part of their mission. For example, if there is a particular college experience that is found to greatly enrich leadership abilities, then colleges wanting to instill these skills could benefit through policy which increases its prevalence on campus.

More recently, McCarron et al. (2022) posit leadership educators are not working with blank slates when it comes to the students being engaged in leadership education. Many students have pre-college leadership experiences that affect their college-based leader emergence and leader self-efficacy. Using a sample of students from one large, public Mid-Atlantic university, they found pre-college engagement with sports team positional leadership, extracurriculars and community service, among other things, predicted leader self-efficacy. Further, leader emergence was predicted by community service, peer tutoring and extracurriculars before entering college. Our study extends this research by including a panel of respondents across more than 600 colleges and universities rather than focusing on a single institution.

While the focus of Escamilla and Fraccastoro’s (2018) research is on leadership offerings in MBA programs and professional leadership programs, the question of content is essential. These authors compare topics and content covered in workshops and seminars offered by top professional entities with that of subjects addressed in university courses. This comparison is important in better preparing graduates to meet the needs of organizations. Our research seeks to contribute to the leadership education literature by assessing which students feel most prepared to lead by assessing participation in a broader range of activities than prior studies. These activities reflect various types of leadership education pedagogies which focus on knowing (the more traditional approach through classroom lectures) or being and doing (the more contemporary approach with experiential learning and work projects) (Anderson, Hibbert, Mason, & Rivers, 2018; Hawkins & Edwards, 2015; Jenkins, 2012; McCarron et al., 2022; Yip & Raelin, 2011). Grunberg, Barry, Callahan, Kleber, McManigle and Schoomaker (2019) provide a conceptual framework to guide curriculum content development and serve as a basis for assessment. This aligns with the present research in that it is important to understand who feels prepared to lead based on the pedagogical methodologies employed, given there may be perceived differences of skill development and enhancement. Further, the research sheds light on whether or not varied approaches to leadership development affect categories of students differently and if theories of adult learning are perceived as being employed (Allen, Rosch, & Riggio, 2022; Reyes et al., 2019).

As a preview of our results, we find that 49% of students in the sample attending 619 different American colleges and universities report their leadership skills have grown somewhat stronger during their college tenure. Additionally, approximately 25% believe these skills have become much stronger, 2% feel their leadership abilities have declined during college, and the remaining 24% report they have been unchanged in this way. Male students, African-American students, those attending private institutions, those attending institutions which focus on undergraduate programs, those with higher grade point averages and (unsurprisingly) those who took leadership courses or training are more likely to report greater skills development than their counterparts. Interestingly, differences across international and domestic students, across first-generation student status and across geography are all very small. Large differences across programs of study are apparent, with business students feeling the most prepared to lead and those with a physical science degree feeling the least ready. The stronger a student feels their leadership skills are at matriculation, the more likely they are to report at graduation that these skills have been enhanced because of their higher education. We find evidence that several college experiences and majors directly impact changes in this skill. The following section begins with a description of our data source. Following that, we present our results and discuss the implications of the findings, limitations and suggestions for future research.

Surveys of leadership skill change. Data used in this analysis come from the Higher Education Research Institute, which runs the Cooperative Institutional Research Program (CIRP) housed at The University of California, Los Angeles. Among others, the CIRP administers two surveys known as The Freshman Survey (TFS) and the College Senior Survey (CSS). The TFS is administered very near a student’s matriculation, most often as an entrance survey, while the CSS is administered very near graduation, most often as an exit survey as part of the student’s exit exams. We collect, merge and make use of all freely available data at the time of writing on students who took both surveys. This merged data set includes a large number of American undergraduate students of higher education who earned their bachelor’s degree between 1994 and 2006.

Specifically, our final data set is comprised of 433,758 students from 619 different institutions of higher education in the United States of America and includes a broad range of variables not usually included in a single study. One hundred percent of these students are college graduates, otherwise they would not have been administered the CSS. While rich, this data set is not without limitations. Notably, only 24% of the students in the sample attended a university (an institution which additionally grants graduate degrees), while the remainder attended a college (those which only grant bachelor’s [four-year] degrees). More importantly, 79% attended a private institution, as these colleges and universities more often participate in the CIRP than do public institutions. Thus, while our sample is quite large, it cannot be thought nationally representative in this regard, and the generalizability of our results may be somewhat limited. Lastly, we note that, by design, these surveys capture no post-graduation information, and as in most any multivariate data sets, we can think of additional variables that would have warranted examination had they been available through further survey. Regarding the age of the data, this means results are indicative of persons who graduated college and are currently mid-career, quite possibly serving in leadership roles today. However, as higher education persistently attempts to adapt to a changing world, and for other reasons, the same results may not fully represent what is occurring at colleges and universities at present. We advise the reader to remain cognizant of the data’s age when interpreting our findings, while keeping in mind many tried-and-true pedagogical practices remain as leadership education continues to evolve.

This research responds to calls to assist leadership educators and practitioners in better understanding how leadership capacities and engagement emerges (e.g. Dugan, 2011). Of primary interest here is a question asked of students on the CSS, that is, very near their graduation date: How do you feel your leadership skills have changed during your college tenure? Students could respond to this question with one of five options: Much Weaker, Weaker, No Change, Stronger or Much Stronger. Figure 1 presents the proportions of students who chose each option for our full sample. At almost 49%, the most common response was “stronger.” At 24.9 versus 24.4, the percent of students who chose “much stronger” was only marginally larger than those choosing “no change.” Only two percent of students reported their leadership skills declined during college tenure, with over five times as many students responding they grew “weaker” compared to “much weaker.” Still, educators wishing to enhance the leadership skills of students may find it somewhat disheartening that over one fourth of graduating students report they have gained no such skills or (much less likely) that these skills have declined during college tenure.

The statistics in Figure 1 answer our first research question: as viewed by the students themselves, how much change in leadership ability is taking place during college tenure? Approximately half of students believe they experienced some increase in these skills, one fourth feel these skills have been enhanced significantly, almost one fourth feel unaffected in this way, and one in fifty college students believe their leadership abilities have declined during their college years. These estimates beg the question of which students more often fall in each of these categories, our second research question. Table 1 presents responses to this survey question across several student subsamples. For ease of comparison, both proportions and means are displayed. For the means, survey responses were first transformed into a five-point ordinal scale, where “much weaker” equals one and “much stronger” equals five.

A review of Table 1, the data suggest that the subjective view of leadership skill change is minimal when comparing most of the groups. For instance, the mean comparison of females and males show 3.94 and 4.01, respectively, with both having over 70% saying that their skills are stronger or much stronger than when they entered college. Similarly, the racio-ethinic groups are similar when comparing means across White, African American and Hispanics, with African Americans having a higher percentage (77.4%) saying their skills were stronger or much stronger as compared to Whites, Hispanics and other racial identities (72.0%, 71.7% and 68.5%, respectively). As leadership class(es) and training may be the most relevant subsampling we examine, these responses are also presented in Figure 2 for ease of reference.

We are also interested in which majors of study are associated with the most leadership ability change, as judged by the students themselves. Table 2 presents the responses to our key survey question across this variable. Looking to mean values from the ordinal scale, business majors report the highest average skill level increase, while those studying a physical science have the lowest average value. While business majors are also the least likely to report “no change,” they rank 3rd in being the most likely to report a “much stronger” skill increase, after the humanities and history/political science majors.

Statistical hypothesis tests were also conducted on all student categories presented in Tables 1 and 2. For each of the six binary pairs in Table 1 (male vs female, first-generation vs not first-generation, etc.) a test of equality across the two groups was performed. For the four available racial categories, six total tests were run so that each category could be independently compared to each of the other three. Similarly, six tests were performed across the four geographic regions. For GPA, where there are 6 available categories, this required 15 total tests. Finally, for Table 2, each of the 15 aggregate major categories were compared to the average of all other students in each case, for a total of 15 tests related to Table 2. In all, 48 statistical hypothesis tests of equality were performed around the statistics presented in Tables 1 and 2. Since the leadership skill change variable in these tables is categorical (specifically, ordinal) in nature, chi-square tests were used. The p-value in the test that compared students with a graduating GPA of 3.25–3.74 to those with one 3.75+ was 0.233, the p-value in the test that compared social science majors to the average of all other students was 0.013 and in all other 46 cases the p-value was less than 0.010. That is, students who earn a GPA of 3.25–3.74 are statistically similar to those with a GPA of 3.75+, we are only 95% confident social science majors are statistically different than the aggregate group of all other majors, but in every other possible comparison, we are 99% confident the group is statistically different than its opposite category (or categories) in terms of self-reported leadership skill change during collegiate tenure.

On the TFS, that is, very near matriculation, students were asked to rate their current level of leadership abilities. Thus, we know how students felt about these skills before their college experience. Students could respond to this survey question by rating their matriculating leadership skills being: in the lowest 10% of individuals, below average, average, above average or in the highest 10% of individuals. Figure 3 presents the proportions of students reporting each case for our full sample. About 41% of college students rated themselves as having above average leadership skills at matriculation, the most common response. About 21% felt they belonged to the 90th percentile in this distribution. It is interesting to note that over 60% of college students believe they would be better leaders than the average person in the general population at the time of matriculation. At 6.8 and 0.6%, respectively, few students rated themselves as having below average or belonging to the 10th percentile in terms of leadership. The remaining 31% of students reported their skills were “average.”

The statistics presented in Figure 3 are interesting in their own right, but here we are particularly curious as to how they relate to reported changes in leadership abilities at graduation. Therefore, we reexamine responses to the leadership change survey question within each of the matriculating leadership ability categories in Figure 3. These new proportions are presented in Figure 4. This figure constitutes a visual answer to our third research question: do students who matriculate with lower leadership abilities increase them the most during their college tenure or is the opposite true? We see a clear, monotonic pattern. The higher a student rated their leadership abilities at matriculation, the more likely they were to report at graduation that their skills in this area grew during college tenure. For those in the 10th percentile, exactly 44% reported these skills grew, with less than 10% feeling they grew significantly. At the 90th percentile, however, exactly 80% reported their leadership skills grew, with 37% feeling they grew significantly. On the other end of the continuum, those in the lowest 10th percentile had almost 60% state their leadership skills did not change or were weaker following their college tenure. These are important differences that warrant the attention of those engaged in leadership development programming to better understand what can be done to engage those who subjectively view their leadership skills to be in the lowest 10% or below average as there may be special programming that might benefit these students. This may be a matter of low self-esteem or feelings of inadequacy given they have not had prior experience in leadership roles. This may also be an opportunity for those students who perceive their leadership skills to be above average or in the highest 10% to serve as mentors and/or role models to the other students, which would further strengthen their leadership skills while helping their peers.

Collegiate experiences, major of study and leadership skill change. Our fourth and final research question regards the estimation of which college experiences and majors of study most contribute, on average, to changes in leadership ability. To this end, we turn to multivariate techniques. Specifically, we estimate models of the form

yi=α+βCi+γMi+δXi+Ss+Tt+yi,t4+ϵi
where yi is student i’s change in leadership ability during college tenure; α a constant term; Ci a vector of different college experiences, with β its corresponding vector of coefficients; Mi major of study, with γ its corresponding vector of coefficients; Xi a vector of individual-specific control variables, with δ its corresponding vector of coefficients; Ss school fixed effects; Tt time (graduating year) fixed effects; yi,t4 student i’s matriculating leadership ability; and ϵi the usual (in this case, well behaved) error term. Here, we are particularly interested in β and γ, the estimated effects of various collegiate experiences and major of study, respectively, on changes in leadership ability. Since the dependent variable is ordinal, ordered logistic regression is used.

The inclusion of time fixed effects allows us to control for any time-specific unobserved heterogeneity, such as any national trends in education during the sample period. School fixed effects allow us to control for unobserved heterogeneity at the institution level. While we consider this a very important dimension of control, the inclusion of school fixed effects disallows the estimation of institutional characteristics on leadership ability change. Therefore, we estimate this model both with and without Ss such that the impacts of institutional characteristics may be examined. That is, in the model with Ss excluded, indicators for private and university institutions are added to Ci. Perhaps our most important dimension of control is yi,t4, for multiple reasons, including the fact we have here uncovered evidence that students matriculating with different skill levels change them at different rates.

Summary statistics for the relevant collegiate experiences captured by the CSS, the variables we include in Ci, are presented in Table 3. By relevant collegiate experiences, we are referring to all college experiences that may reasonably impact a student’s leadership abilities in addition to choice of major and institutional characteristics. These include Greek (fraternity or sorority) membership; intercollegiate sports participation; intramural sports participation; academic achievement (as measured by GPA); typical hours per week devoted to student clubs; and indicators for students who frequently studied with others, tutored others, frequently encountered in-class group assignments, held a student office of any rank (e.g. served as president of a student club or student government), completed a leadership course(s) and/or training offered by the institution and participated in a college internship. There are other college experiences that would warrant investigation in this context, but we must of course work within the confines of what was made available through these national surveys. For each of these occurrences, many more than a requisite number of students participated for multivariate analysis to be utilized. For example, the least frequent occurrence in Ci was internship participation (2.8% of students), but due to the size of our working panel this activity was still completed by 12,145 students among those sampled.

Thompson (2006) notes that most often student leadership research on collegiate is centered on those with a propensity for leadership, based on prior experience. The present research seeks to determine if this is warranted or if a broader lens is necessary to better understand who benefits from leadership training and applied opportunities. Based on the extant literature (e.g. Kezar & Moriarty, 2000; Posner & Brodsky, 1992, Smart, Felman, Ethington, & Thompson, 2000), we include variables purported by student affairs professionals as having an impact. In general, these experiences afford the student an opportunity to interact and collaborate with diverse students of varying backgrounds, experiences, values, beliefs and mental models that may differ from their own. These experiential experiences also offer an array of learning opportunities to students, regardless of prior history of leadership.

In the interest of data disclosure, we also present summary statistics for our control variables in vectors Xi and yi,t4 in Table 4, alongside our two institutional characteristics. These control variables were determined based on our review of existing literature and their relevance on affecting leadership skill development. Again, these are factors that prior research suggests can affect one’s perceptions and experiences relative to leadership.

Table 5 presents the results of the ordered logit models. Values in this table are odds ratios, with standard errors in parentheses. For those unfamiliar with this type of statistics, we briefly mention how odds ratios are interpreted in this context. Here, values greater than (less than) one imply the variable increases (decreases) the student’s probability of reporting a larger change in leadership ability. The “distance” from one discloses the odds, the magnitude of the impact. For example, the odds ratio of 1.19 attached to fraternity/sorority membership in Model 1 implies that, all else equal, a student who joined such an organization is 19% (1.19–1.00 = 0.19 = 19%) more likely to report a higher leadership ability gain than other students, on average. As another example, the odds ratio of 0.75 attached to biological science majors in Model 1 implies that, all else equal, a student with this major is 25% (1.00–0.75 = 0.25 = 25%) less likely to report a higher leadership ability gain than other students, on average.

There are two models summarized in Table 5. Model 1 has the advantage of being able to additionally estimate the impact of institutional characteristics (college/university and public/private) on leadership ability change. Model 2 has the advantage of controlling for all unobserved heterogeneity at the institution level (a college’s mission, culture, specific geography, relative size, prestige, etc.). As discussed previously, it is mathematically impossible to do both simultaneously. Results are similar across the two models. In Model 1, where there are no school fixed effects, those who reported taking a leadership class(es) or training are 199% more likely to report a leadership ability gain than other students. This is by far the largest difference of the variables included in the model. The five other variables showing the largest increase in leadership ability are: student office (85% more likely), internship participant (75% more likely), tutored other students (43% more likely), frequently studied with others (34% more likely) and played intercollegiate sports (31% more likely). The factors that were likely to lead to less likely reporting a higher leadership ability gain were associated with specific majors and attending a University.

Most results remain similar in Model 2, that is, after controlling for unobserved institution-level heterogeneity. While the order and effect change slightly, the top five factors are the same: leadership class(es) or training (200%), student office (85%), internship participant (76%), frequently studied with others (37%) and tutored other students (35%). A similar pattern exists in terms of the factor that reduces the likelihood of being less likely of reporting a higher leadership ability gain being associated with certain majors.

As previously shown in Table 5, one unsurprising result is that the variable with the largest impact on self-perceived leadership skill change is whether students have participated in leadership training during college. It may be of similar interest to estimate if this kind of training impacts other collegiate outcomes. Within the data available here, there are two other such outcomes worthy of examination, graduating GPA and an indicator for students who report, at the time of undergraduate graduation, wishing to pursue graduate school. To test leadership training’s potential relationships with these two outcomes, additional regressions are estimated with them incorporated as the dependent variables, with all other previously used control variables remaining as such. The estimated marginal effect of leadership training in the ordinary least squares regression for GPA shows that participating students graduate with 0.098 additional GPA points, on the typical 0.0–4.0 scale, on average and all else equal (standard error = 0.002; p-value < 1.0e15). In a logit model for graduate school desires, the estimated marginal effect is 0.103, implying students who received leadership training are an impressive 10.3% points more likely to report wanting to enroll in graduate school at undergraduate graduation, on average and all else equal (standard error = 0.001; p-value < 1.0e15). In short, leadership training during undergraduate tenure appears to be strongly positively related to academic success and continued education.

Discussion and conclusions

Using a large sample of students from 619 institutions of higher education in the USA, we set out to answer four questions related to leadership skill change during college tenure. First, as reported by the students themselves, how much change in leadership ability is taking place during college tenure? Second, how much does the answer to this first question vary across student demographics, institution type and major of study? Third, do students who matriculate with lower leadership abilities increase them the most during their college tenure or is the opposite true? Finally, after controlling for relevant factors, which college experiences and majors of study most affect changes in these abilities, by how much and in which direction?

The present research supports the extant literature and conventional wisdom of academic and student affairs professionals with regards to engagement in leadership classes or training where students have an opportunity to increase their knowledge bases through course content and when there are opportunities for them to apply leadership principles, the students are more likely to report an increase in leadership capacity upon completion of their collegiate degree. If colleges and universities are serious about fulfilling their espoused visions, then it is essential that awareness of leadership courses and applied opportunities is heightened and made a strategic priority to ensure resources are allocated in appropriate places to support these key efforts. It also suggests greater collaboration between academic and student affairs, as well as other departments (e.g. athletics, centers), is needed, as well as prioritizing experiential learning. Further, additional research is needed to better understand the dynamics associated with various majors and students who come from disadvantaged situations to determine what can be done to level the playing field and encourage them to engage more fully. While our findings seem consistent with aspects of McCarron et al. (2022) in that leadership educators are not dealing with blank states and should identify strategies which continue to bolster learning and development for those who enter college with certain leadership experiences, while also ensuring those who do not are afforded opportunities to enhance their motivation to lead, increase their leadership self-efficacy and emerge as leaders.

As leadership education continues to evolve, future research should continue to examine whether certain modalities produce different results. Guthrie, Batchelder, Hu and Purita (2022) explore how changes in technology have impacted leadership program offerings online and additional research should be conducted to assess implications of online approaches. If holistic leadership development is an expected outcome for graduates to be prepared to contribute in an ever changing, global world, curriculum development discussions around difficult concepts are essential to determine what omitted content must be embedded in leadership education (e.g. Irwin & Posselt, 2022; Sugiyama, Cavanagh, van Esch, Bilimoria, & Brown, 2016; Wiborg, 2022).

Educators and education policymakers striving to enhance the leadership abilities of students may find our estimates of most use. However, as mentioned earlier, students wanting to advance their own leadership skills can also benefit from knowledge of our findings. More research is needed before a clearer picture of the relationship between higher education and leadership ability may be obtained. Post-graduation information would likely prove particularly useful. How much do collegiate changes in this skill alter labor market outcomes such as the occupation obtained, wages earned and the speed of advancement? Do changes in this skill affect students’ post-graduation goals? These questions can be best addressed through longitudinal research designs that follow individuals from college matriculation through their professional careers. It may prove insightful for leadership educators to compare whether pedagogies categorized as knowing, being and doing yield differential outcomes over time.

Though true leadership ability is by no means an easy attribute to quantify, objective measures of this skill would allow one to examine how much student assessments of changes in their ability match reality. The primary limitation of the current study is the age of the data. Results here are more indicative of individuals who are currently mid-career and/or serving in leadership positions today, be those in business, politics or some other arena. These results may not still be indicative of what is occurring in higher education today, however, and as an avenue of future research, we suggest a similar study be conducted with more recent data. Given the present data set focuses on institutions in the United States, future research should also include institutions beyond the USA or include comparative analyses across countries to understand those realities. We leave these tasks for future research.

Figures

Subjectively-viewed leadership skill change during college

Figure 1

Subjectively-viewed leadership skill change during college

Leadership skill change across the incidence of specific training

Figure 2

Leadership skill change across the incidence of specific training

Subjectively-viewed matriculating leadership skills

Figure 3

Subjectively-viewed matriculating leadership skills

Leadership skill change within each matriculating skill level

Figure 4

Leadership skill change within each matriculating skill level

Subjectively-viewed leadership skill change across student groups

SamplePercent of students in each response categoryMeann
MuchWeakerNoStrongerMuch
WeakerChangeStronger
Full0.31.724.448.724.93.964433,758
Female0.21.825.748.523.83.940271,099
Male0.31.522.249.226.84.005162,659
White0.51.825.745.726.33.967347,873
African-American0.31.221.046.231.24.06827,327
Hispanic0.51.826.045.825.93.94914,748
Other racial identity0.72.328.545.223.33.88343,810
First-generation students0.21.425.349.223.83.95140,773
Not first-generation0.31.724.348.725.13.965392,985
International students0.42.026.047.324.23.9285,205
Domestic students0.31.724.448.824.93.964428,553
Public institution0.31.831.146.420.43.84891,957
Private institution0.31.622.649.426.13.995341,801
College students0.31.423.249.225.93.991331,825
University students0.32.528.147.421.73.877101,933
Region: East0.31.524.948.824.63.959156,146
Region: Midwest0.21.822.550.824.73.981126,655
Region: South0.32.026.246.724.83.93861,930
Region: West0.31.725.047.125.93.96789,027
GPA: 3.75–4.000.21.523.149.026.23.99467,864
GPA: 3.25–3.740.21.623.249.026.03.989168,653
GPA: 2.75–3.240.31.724.348.924.83.963134,990
GPA: 2.25–2.740.31.927.348.422.13.90150,491
GPA: 1.75–2.240.62.134.944.717.63.76710,708
GPA: below 1.753.72.949.234.79.43.4331,052
Leadership class(es) or training0.10.87.643.548.04.38477,643
No such class or training0.31.928.149.919.93.872356,115

Note(s): Overall n = 433,758. Institutions participating in survey = 619. Data come from the CIRP

Source(s): Table by authors

Subjectively-viewed leadership skill change across major of study

Aggregate majorPercent of students in each response categoryMeann
MuchWeakerNoStrongerMuch
WeakerChangeStronger
Agriculture0.22.124.152.321.33.9232,086
Biological sciences0.22.028.648.320.93.87728,916
Business0.21.219.252.227.24.05168,090
Education0.11.122.650.625.54.00333,087
Engineering0.32.024.750.222.83.93417,340
English0.32.428.045.024.33.90516,253
Health or medicine0.11.122.753.522.63.97321,289
History0.22.025.945.426.53.95910,198
Political science0.32.222.545.929.14.01514,086
Humanities0.32.023.345.728.74.00521,534
Fine arts0.32.328.446.322.73.88815,599
Math or statistics0.32.129.646.421.63.8695,478
Physical sciences0.32.129.447.920.33.8578,424
Social sciences0.21.925.947.924.13.93851,798
Other0.42.127.048.022.53.909119,580

Note(s): Overall n = 433,758. Institutions participating in survey = 619. Data come from the CIRP. The aggregate major categories are those used by the CIRP

Source(s): Table by authors

Leadership-related college experience summary statistics

College experience (continuous variables)MeanSDMinMax
Graduating GPA3.2410.46514
Hours/week devoted to student clubs1.5553.331020
College experience (indicator variables)Percent frequency
Joined fraternity or sorority16.8
Played intercollegiate sports11.3
Played intramural sports16.4
Frequently studied with other students40.6
Tutored other students3.0
Frequent in-class group assignments36.0
Student office (club, student gov’t, etc.)7.3
Leadership class(es) or training17.9
Internship participant2.8

Note(s): n = 433,758. SD, standard deviation. Minimums and maximums rounded to the integer. Data come from the CIRP

Source(s): Tables by authors

Selected summary statistics

Continuous variableMeanSDMinMax
High school GPA3.3710.26714
Self-rated academic ability3.9620.70715
Age at matriculation18.2061.0351655
Parental income (2016 USD)112690.80052,501.1690366,100
Father’s years of schooling15.3862.869020
Mother’s years of schooling15.0382.597020
Distance from home (miles)140.629165.4795500
Num. colleges applied to4.1101.894112
Indicator variablePercent frequency
Male37.5
African-American6.3
Hispanic3.4
Other non-white race10.1
Not a native English speaker7.6
Two-parent household88.5
First-generation college student9.4
Became married during college3.5
Full-time job during college42.9
Part-time job during college23.0
Transferred schools19.1
Took one or more remedial courses7.1
Failed one or more courses9.3
Part-time student6.1
International student1.2
Private institution78.8
University23.5
Wanted graduate degree at matriculation35.8
Wants graduate degree at graduation22.2
Leadership skills at matriculation: lowest 10%0.6
Leadership skills at matriculation: below avg.6.8
Leadership skills at matriculation: above avg.40.6
Leadership skills at matriculation: highest 10%20.6

Note(s): n = 433,758. SD, standard deviation. Minimums and maximums rounded to the integer. Data come from the CIRP

Source(s): Tables by authors

Estimated effects on leadership skill change

VariableModel
(1)(2)
Joined fraternity or sorority1.19*** (0.01)1.23*** (0.01)
Played intercollegiate sports1.31*** (0.01)1.25*** (0.01)
Played intramural sports1.25*** (0.01)1.21*** (0.01)
Graduating GPA1.16*** (0.01)1.05*** (0.01)
Frequently studied with other students1.34*** (0.01)1.37*** (0.01)
Tutored other students1.42*** (0.03)1.35*** (0.02)
Frequent group assignments1.29*** (0.01)1.28*** (0.01)
Student office1.85*** (0.02)1.85*** (0.02)
Leadership class(es) or training2.99*** (0.02)3.00*** (0.02)
Internship participant1.75*** (0.03)1.76*** (0.03)
Hours/week student clubs1.08*** (0.00)1.08*** (0.00)
Private institution1.21*** (0.01)n/a
University0.77*** (0.01)n/a
Major
Agriculture1.03 (0.04)1.01 (0.04)
Biological sciences0.75*** (0.01)0.76*** (0.01)
Business1.29*** (0.01)1.26*** (0.01)
Education1.12*** (0.01)1.17*** (0.01)
Engineering0.87*** (0.01)0.81*** (0.01)
English0.86*** (0.01)0.86*** (0.01)
Health or medicine1.06*** (0.02)1.10*** (0.02)
History1.00 (0.01)0.99 (0.01)
Political science1.20*** (0.02)1.19*** (0.02)
Humanities1.07*** (0.02)1.06*** (0.02)
Fine arts0.90*** (0.01)0.91*** (0.01)
Math or statistics0.73*** (0.02)0.71*** (0.02)
Physical sciences0.70*** (0.02)0.68*** (0.01)
Social sciences0.93*** (0.01)0.95*** (0.01)
Control level
Control variablesYesYes
School fixed effectsNoYes

Note(s): Values are odds ratios with standard errors in parentheses. *p < 0.10; **p < 0.05; ***p < 0.01. See Table 4 and Section 3 for controls. n = 433,758

Source(s): Tables by authors

References

Allen, S. J., Rosch, D. M., & Riggio, R. E. (2022). Advancing leadership education and development: Integrating adult learning theory. Journal of Management Education, 46(2), 252283. doi: 10.1177/10525629211008645.

Anderson, L., Hibbert, P., Mason, K., & Rivers, C. (2018). Management education in turbulent times. Journal of Management Education, 42(4), 423440. doi: 10.1177/1052562918779421.

Avery, D. R., & Thomas, K. M. (2004). Blending content and contact: The roles of diversity curriculum and campus heterogeneity in fostering diversity management competency. Academy of Management Learning and Education, 3(4), 380396. doi: 10.5465/amle.2004.15112544.

Avolio, B. J., & Hannah, S. T. (2008). Developmental readiness: Accelerating leader development. Consulting Psychology Journal: Practice and Research, 60(4), 331347. doi: 10.1037/1065-9293.60.4.331.

Bass, B. M. (1997). Does the transactional-transformational leadership paradigm transcend national boundaries?. American Psychologist, 52(2), 130139. doi: 10.1037//0003-066x.52.2.130.

Blanchard, K., Hzigarmi, D., & Nelson, R. (1993). Situational leadership after 25 years: A retrospective. Journal of Leadership Studies, 1, 2226.

Clawson, J. G. S. (2011). Book review of the Handbook for teaching leadership: Knowing, doing, & being. Academy of Management Learning and Education, 10(3), 535539. doi: 10.5465/amle.2011.0007.

DeRue, D. S., Sitkin, S. B., & Podolny, J. M. (2011). Teaching leadership – issues and insights. Academy of Management Learning and Education, 10(3), 369372. doi: 10.5465/amle.2011.0004.

Dugan, J. P. (2011). Pervasive myths in leadership development: Unpacking constraints on leadership learning. Journal of Leadership Studies, 5(2), 7984. doi: 10.1002/jls.20223.

Escamilla, C. A., & Fraccastoro, K. A. (2018). Comparison of professional leadership program content to university leadership programs. Journal of the Academy of Business Education, 345354.

Fieldler, F. E. (1967). A theory of leadership effectiveness. McGraw-Hill, NY.

George, B., Sims, P., McClean, A. N., & Mayer, D. (2007). Discovering your authentic leadership. Harvard Business Review, 130139.

Graen, G., & Uhl-Bien, M. (1995). Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective Management Department Faculty Publications, 57.

Grunberg, N. E., Barry, E. S., Callahan, C. W., Kleber, H. G., McManigle, J. W., & Schoomaker, E. B. (2019). A conceptual framework for leader and leadership education and development. International Journal of Leadership in Education, 22(5), 644650. doi: 10.1080/13603124.2018.1492026.

Guthrie, K. L., & Jenkins, D. M. (2018). The role of leadership educators: Transforming learning. Information Age Publishing. CA.

Guthrie, K. L., Batchelder, J. M., Hu, P., & Purita, R. (2022). Online academic leadership programs in the United States: An overview. Journal of Leadership Education, 21(2), 1831. doi: 10.12806/v21/i2/r2.

Hawkins, B., & Edwards, G. (2015). Managing the monsters of doubt: Liminality, threshold concepts and leadership learning. Management Learning, 46(1), 2443. doi: 10.1177/1350507613501736.

House, R. J. (1971). A path-goal theory of leader effectiveness. Administrative Science Quarterly, 16(3), 321328. doi: 10.2307/2391905.

House, R. J., & Aditya, R. N. (1997). The social scientific study of leadership: Quo Vadis?. Journal of Management, 23(3), 409473. doi: 10.1016/s0149-2063(97)90037-4.

Irwin, L. N., & Posselt, J. R. (2022). A critical discourse analysis of mainstream college student leadership development models. Journal of Leadership Education, 21(4), 7697. doi: 10.12806/v21/i4/r1.

Jenkins, D. M. (2012). Exploring signature pedagogies in undergraduate leadership education. Journal of Leadership Education, 11, 127. doi: 10.12806/v11/i1/rf1.

Kezar, A., & Moriarty, D. (2000). Expanding our understanding of student leadership development: A study exploring gender and ethnic identity. Journal of College Student Development, 41, 5569.

McCarron, G. P., Zhou, S., Campbell, A., Muscente, K. K., & Schierbeek, E. (2022). We’re not working with a black slate: Students’ pre-college leadership activities and perceived parenting behavior as predictors of college-based leadership emergence and leader self-efficacy. Journal of Leadership Education, 21(1), 3352. doi: 10.12806/v21/i1/r3.

Parks, S. D. (2005). Leadership can be taught: A bold approach to a complex world. Harvard Business Press, Brighton.

Posner, B. Z., & Brodsky, B. (1992). A leadership development instrument for college students. Journal of College Student Development, 33, 231237.

Reyes, D. L., Dinh, J., Lacerenza, C. N., Marlow, S. L., Joseph, D. L., & Salas, E. (2019). The state of higher education leadership development program evaluation: A meta-analysis, critical review, and recommendations. The Leadership Quarterly, 30(5), 101311. doi: 10.1016/j.leaqua.2019.101311.

Robinson, G. S., & Wick, C. W. (1992). Executive development that makes a business difference. Human Resource Planning, 15, 6376.

Rosch, D. M., Collier, D., & Thompson, S. E. (2015). An exploration of students’ motivation to lead: An analysis by race, gender, and student leadership behaviors. Journal of Student Development, 56(3), 286291. doi: 10.1353/csd.2015.0031.

Sinclair, A. (2007). Teaching leadership critically to MBAs: Experiences from heaven and hell. Management Learning, 38(4), 461475. doi: 10.1177/1350507607080579.

Smart, J. C., Felman, K. A., Ethington, C. A., & Thompson, M. D. (2000). Influences of institutional expenditure patterns on the development of students’ leadership competencies. Research in Higher Education, 43(1), 115132. doi: 10.1023/a:1013074218134.

Snook, S. A., Khurana, R., & Nohria, N. (2011). The handbook for teaching leadership: Knowing, doing, & being. Sage. London.

Sowcik, M., & Allen, S. J. (2013). Getting down to business: A look at leadership education in business schools. Journal of Leadership Education, 12(3), 5775. doi: 10.12806/v12/i3/tf3.

Stetch, E. (2008). Leadership education, training and development: What should we be doing and what can we be doing?. Journal of Leadership Education, 7(1), 4346. doi: 10.12806/v7/i1/c1.

Sugiyama, K., Cavanagh, K. V., van Esch, C., Bilimoria, D., & Brown, C. (2016). Inclusive leadership development: Drawing from pedagogies of women and general leadership development programs. Journal of Management Education, 40(3), 253292. doi: 10.1177/1052562916632553.

Thompson, M. D. (2006). Student leadership process development: An assessment of contributing college resources. Journal of College Student Development, 47(3), 343350. doi: 10.1353/csd.2006.0035.

Wiborg, E. R. (2022). Troubling the niceness of social change in leadership education. Journal of Leadership Studies, 16(3), 5156. doi: 10.1002/jls.21821.

Wren, J. T. (1994). Teaching leadership: The art of the possible. The Journal of Leadership Studies, 1(2), 7393. doi: 10.1177/107179199400100208.

Yip, J., & Raelin, J. A. (2011). Threshold concepts and modalities for teaching leadership practice. Management Learning, 43(3), 333354. doi: 10.1177/1350507611422476.

Further reading

Vroom, V. H., & Jago, A. G. (2007). The role of the situation in leadership. American Psychologist, 616.

Corresponding author

C. Douglas Johnson can be contacted at: johnsocd@wfu.edu

Related articles