Skip to main content

Advertisement

SpringerLink
Log in

Evaluation of the quality and quantity of research results in higher education

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

The evaluation of the quality and quantity of research results in higher education, both at an institutional and an individual level, has become a must in today’s competitive environment. Universities use sets of indicators validated at national or international level, in order to measure research results and to set goals, but sometimes they need specific systems that are more appropriate in order to reach their strategic objectives. Based on the system of evaluation used by a Romanian medium-sized university, in the first part of the case study from this article, it is mathematically proven that the measurement itself has a great impact on the research results’ dynamics because of the changing behaviour of the academic staff. The model could be applied and customized to any set of indicators used by different universities, and our results prove that a good set of indicators could be a useful tool to increase research performance and to achieve specific goals and strategic objectives in universities. In the second part of the case study, we tried to answer the following question: From a set of indicators used to quantify research activity in higher education, which ones are critical indicators? In order to find an answer to this question, we used the topic of hierarchization of the research indicators in higher-education as a multiple-criteria decision-making problem. The criteria used in the case study are funding from the state budget and from other sources, and national and international visibility of the research results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Ab Hamid, M.R., Mustafa, Z., Suradi, N.R.M., Idris, F., Abdullah, M.: Value-based performance excellence measurement for higher education institution: instrument validation. Qual. Quant. 47(6), 3019–3030 (2013)

    Article  Google Scholar 

  • Agrell, P.J., Lence, B.J., Stam, A.: An interactive multicriteria decision model for multipurpose reservoir management: the Shellmouth Reservoir. J. Multi-Criteria Decis. Anal. 7(2), 61–86 (1988)

    Article  Google Scholar 

  • Angilella, S., Corrente, S., Greco, S., Slowinski, R.: Multiple criteria hierarchy process for the Choquet integral. Evol. MultiCriterion Optim. Lect. Notes Comput. Sci. 7811, 475–489 (2013)

    Article  Google Scholar 

  • Bacon, D.R., Paul, P., Stewart, K.A., Mukhopadhyay, K.: A new tool for identifying research standards and evaluating research performance. J. Mark. Educ. 34(2), 194–208 (2012)

    Article  Google Scholar 

  • Barnes, C.: The emperor’s new clothes: the h-index as a guide to resource allocation in higher education. J. High. Educ. Policy Manag. 36(5), 456–470 (2014)

    Article  Google Scholar 

  • Beg, I., Rashid, T.: A geometric aggregation operator for decision making. Vietnam J. Comput. Sci. 2, 243–255 (2015)

    Article  Google Scholar 

  • Beltramini, R.F., Schlacter, J.L., Kelly, C.: Marketing faculty promotion and tenure policies and practices. J. Mark. Educ. 7(2), 74–80 (1985)

    Article  Google Scholar 

  • Blackmore, P., Blackwell, R.: Strategic leadership in academic development. Stud. High. Educ. 31(3), 373–387 (2006)

    Article  Google Scholar 

  • Bucur, A.: Examples of using the SPSS and WinQSB softwares for collecting and analyzing data in order to obtain the optimum quality. Metal. Int. 17(6), 187–191 (2012)

    Google Scholar 

  • Bucur, A.: Contribuţii la abordarea ştiinţifică a calităţii şi managementului calităţii, prin modelare şi simulare. Lucian Blaga University of Sibiu Publishing House, Sibiu (2015)

    Google Scholar 

  • Burnett, J.J., Amason, R.D., Cunningham, P.: What makes marketing academicians successful? An assessment of teaching, publishing, and service. J. Mark. Educ. 11(3), 7–11 (1989)

    Article  Google Scholar 

  • Choy, C.S., Yew, W.K., Lin, B.: Criteria for measuring KM performance outcomes in organizations. Ind. Manag. Data Syst. 106(7), 917–936 (2006)

    Article  Google Scholar 

  • Ciuiu, D.: MADM in case of simultaneous equations models and economic applications. Procedia Econ. Financ. 8, 167–174 (2014)

    Article  Google Scholar 

  • Coe, R.K., Weinstock, I.: Evaluating journal publications of marketing professors: a second look. J. Mark. Educ. 5(1), 37–42 (1983)

    Article  Google Scholar 

  • Diwekar, U.M., Rubin, E.S., Frey, H.C.: Optimal design of advanced power systems under uncertainty. Energy Convers. Manag. J. 38, 1725–1735 (1997)

    Article  Google Scholar 

  • Ebadi, A., Schiffauerova, A.: How to boost scientific production? A statistical analysis of research funding and other influencing factors. Scientometrics (2016). doi:10.1007/s11192-015-1825-x

    Google Scholar 

  • Escheauer, H.A.: Multicriteria optimization techniques for highly accurate focusing systems. Multicriteria Optim. Eng. Sci. 37, 309–354 (1988)

    Article  Google Scholar 

  • Frangopol, P.T.: Indexul Hirsch – un nou indicator scientometric pentru evaluarea rezultatelor unui cercetător ştiinţific. Revista de Politica Ştiinţei şi Scientometrie 1, 75 (2012)

    Google Scholar 

  • Fu, Y., Diwekar, U.: Cost effective environmental management for utilities. Adv. Environ. Res. 8, 173 (2003)

    Article  Google Scholar 

  • Gordon, G., Whitchurch, C.: Managing human resources in higher education: the implications of a diversifying workforce. High. Educ. Manag. Policy 19(2), 135–155 (2007)

    Google Scholar 

  • Kolesnikov, A., Lebedeva, I.: Investigation of causality based on complex use of statistical methods (case study of social research). Qual. Quant. 47(6), 3043–3050 (2013)

    Article  Google Scholar 

  • Kumar, P., Singh, N., Tewari, N.K.: A nonlinear goal programming model for multistage, multiobjective decision problems with application to grouping and loading problem in a flexible manufacturing system. Eur. J. Oper. Res. 53(2), 166–171 (1991)

    Article  Google Scholar 

  • Ionescu, GhGh, Cazan, E., Negruşa, A.L.: Modelarea şi optimizarea deciziilor manageriale. Dacia Publishing House, Cluj-Napoca (1999)

    Google Scholar 

  • Ionescu, N.I.: An index to quantify the value of research. Revista de Politica Ştiinţei şi Scientometrie 3(2), 108–109 (2014)

    Google Scholar 

  • Li, X., Chen, X.: Multi-criteria group decision making based on trapezoidal intuitionistic fuzzy information. Appl. Soft Comput. 30, 454–461 (2015)

    Article  Google Scholar 

  • McInnis, C.: Changing academic work roles: the everyday realities challenging quality in teaching. Qual. High. Educ. 6(2), 143–152 (2000)

    Article  Google Scholar 

  • Resteanu, C.: MADM. Teorie şi practică. ICI Publishing House, Bucharest (2006)

    Google Scholar 

  • Rhoades, G.: Reorganising the faculty workforce for flexibility: part-time professional labour. J. High. Educ. 67(6), 624–659 (1996)

    Google Scholar 

  • Salmi, J., Saroyan, A.: League tables as policy instruments: uses and misues. High. Educ. Manag. Policy 19(2), 31–68 (2007)

    Google Scholar 

  • Schy, A.A., Giesy, D.P.: Multicriteria optimization methods for design of aircraft control systems. Multicriteria Optim. Eng. Sci. 37, 225–262 (1988)

    Article  Google Scholar 

  • Soung, H.K., Chung, H.H.: An interactive procedure for multi-attribute group decision making with incomplete information. Comput. Oper. Res. 26(8), 755–772 (1999)

    Article  Google Scholar 

  • Seggie, S.H., Griffith, D.A.: What does it take to get promoted in marketing academia? Understanding exceptional publication productivity in the leading marketing journals. J. Mark. 73, 122–132 (2009)

    Article  Google Scholar 

  • Shepherd, C.D., Carley, S.S., Stuart, R.S.: An exploratory investigation of the periodic performance evaluation processes for marketing faculty: a comparison of doctoral-granting and non-doctoral-granting universities. J. Mark. Educ. 31, 143–153 (2009)

    Article  Google Scholar 

  • Shih, K.-H., Liu, Y.-T., Jones, C., Lin, B.: The indicators of human capital for financial institutions. Expert Syst. Appl. 37, 1503–1509 (2010)

    Article  Google Scholar 

  • Silaghi-Dumitrescu, R.: A scientometrics-informed peer-review exercise. Revista de Politica Ştiinţei şi Scientometrie 4(3), 234–237 (2015)

    Google Scholar 

  • Soutar, G.N., Murphy, J.: Journal quality: a Google scholar analysis. Australas. Mark. J. 17, 150–153 (2009)

    Article  Google Scholar 

  • Steward, M.D., Lewis, B.R.: A comprehensive analysis of marketing journal rankings. J. Mark. Educ. 32(1), 75–92 (2010)

    Article  Google Scholar 

  • Wei, G.W.: Some geometric aggregation functions and their application to dynamic multiple attribute decision making in the intuitionistic fuzzy setting. Int. J. Uncertain. Fuzziness Knowl. Based Syst. 17(2), 179–196 (2009)

    Article  Google Scholar 

  • Whitchurch, C.: Who do they think they are? The changing identities of professional administrators and managers in UK higher education. J. High. Educ. Policy Manag. 28(2), 159–171 (2006)

    Article  Google Scholar 

  • Yu, D.: A scientometrics review on aggregation operator research. Scientometrics 105(1), 115–133 (2015)

    Article  Google Scholar 

  • Zanakis, S., Solomon, H., Wishart, A., Dublish, N.S.: Multi-attribute decision making: a simulation comparison of select methods. Eur. J. Oper. Res. 107(3), 507–529 (1998)

    Article  Google Scholar 

Download references

Acknowledgements

Project financed from Lucian Blaga University of Sibiu research grants LBUS-IRG-2015-01.

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, Faculty of Sciences, Lucian Blaga University of Sibiu, Sibiu, Romania

    Amelia Bucur

  2. Department of Engineering and Management, Faculty of Engineering, Lucian Blaga University of Sibiu, Sibiu, Romania

    Claudiu Vasile Kifor

  3. Department of Business Administration, Faculty of Economic Sciences, Lucian Blaga University of Sibiu, Sibiu, Romania

    Silvia Cristina Mărginean

Authors
  1. Amelia Bucur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Claudiu Vasile Kifor
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Silvia Cristina Mărginean
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amelia Bucur.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bucur, A., Kifor, C.V. & Mărginean, S.C. Evaluation of the quality and quantity of research results in higher education. Qual Quant 52, 101–118 (2018). https://doi.org/10.1007/s11135-016-0452-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-016-0452-9

Keywords

JEL Classification

Search

Navigation