Next Article in Journal
Compact City: What Is the Extent of Our Exploration for Its Meanings? A Systematic Review
Next Article in Special Issue
Numerical Investigations of Tribological Characteristics of Biomimetic-Textured Surfaces
Previous Article in Journal
Sustainable Development Goals and Climate Change in Spanish Technology Disciplines’ Curricula: From LOMCE to LOMLOE
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

The Development of Efficiency Analysis in Transportation Systems: A Bibliometric and Systematic Review

by
Thiago Victorino
* and
Carlos Rosano Peña
Department of Administration, Faculty of Administration, Accounting, Economics and Public Policy Management, University of Brasilia, Brasília 70910900, Brazil
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(13), 10300; https://doi.org/10.3390/su151310300
Submission received: 12 May 2023 / Revised: 22 June 2023 / Accepted: 23 June 2023 / Published: 29 June 2023
(This article belongs to the Special Issue Sustainable Development of Intelligent Rail Transit)

Abstract

:
This paper presents a literature review of efficiency analysis in transportation systems (TS). It builds a bibliometric review of published data-envelopment analysis and, for the first time, stochastic frontier analysis publications in TS. The retrieved publications were separated into five groups: highway/road transportation, air transportation, maritime/port transportation, railway transportation, and urban/bus transportation. The 135 data-envelopment-analysis rail-related publications were surveyed to assess the model used, the second-stage analysis (if any), the input–output variables, the model orientation, return-to-scale assumptions, and their methodological classification. The results show that frontier methods in transportation systems have gained relevance since 2017. Also, gaps in the literature and future directions have been identified in empirical rail research, such as eco-efficiency and safety-related issues, as well as the need for a better investigation of variable choice and scale return assumptions. Finally, this paper proposes a step-by-step methodology for data envelopment analysis in rail systems.

1. Introduction

The operational performance analysis of firms has witnessed a revolution since the late 1970s [1]. Naturally, it has led to comparisons between firms and the public sector, paving the way for benchmarking analysis.
The word, benchmarking can be understood as a tool for the continuous improvement of quality, and identifying and comparing companies in the sector that are excellent in some aspect, which can be copied, incorporated, or adapted. This concept first appeared in 1989 [2], popularized by Xerox. Since then, it has been applied to almost all economic sectors, as the idea of benchmarking (frontier) is consistent with the economic theory of optimizing behavior as deviations from best practices, and enables the proposition of feasible corrective goals [3].
The methods for quantifying relative efficiency were mostly inspired by the work of Farrell [4], who presented the possibility of estimating an efficient productive frontier with the best practices and, by calculating the distance of each productive unit from that frontier, of estimating the relative efficiency. The two most popular methods to measure efficiency are a parametric and a non-parametric one. The parametric one, Stochastic frontier analysis (SFA), was first introduced in seminal articles by Aigner et al. [5] and Meeusen and van Den Broeck [6]. Their idea was implemented by specifying a statistical model characterized by a compound error term in which the classical stochastic disturbance, to capture the measurement error and any other classical noise, is complemented with a one-sided, non-negative disturbance that represents inefficiency. SFA models are generally estimated using maximum-likelihood-based methods, and their main advantage is to make inferences about both the frontier parameters and the inefficiency. An expanded review of these models can be found in Kumbhakar et al. [7].
Among the non-parametric methods, the data envelopment analysis (DEA) and the free disposable hull (FDH) models stand out, the former being the most popular. Data envelopment analysis was initially proposed by Charnes et al. [8], and incorporates a Pareto–Koopmans efficiency or full efficiency assumption and provides a relative efficiency measure of decision-making units (DMU). It allows the use of multiple inputs and outputs without imposing, a priori, any functional relationship between inputs and outputs to build an empirical frontier. It uses mathematical programming to obtain an ex post facto indicator of the relative efficiency of DMUs, identifying the benchmarks against which inefficient DMUs can be compared.
There has been some controversy over which technique (SFA or DEA) should be used to estimate and analyze efficiency. Lovell et al. [9] and Coelli et al. [10] suggest that there are advantages and disadvantages associated with the use of DEA and SFA, but neither approach strictly dominates the other. Lampe and Hilgers [11] analyzed both DEA and SFA publications in general, from 1978 to 2012, identifying seminal papers that have played a major role in the study of productivity, efficiency, and its determining factors. One important contribution of this work relates to the adoption rate of new knowledge. According to the authors, current research tends to build on recent and older literature, but not so much on middle-aged publications. Thus, for DEA and SFA, the authors were able to identify the use of modern techniques.
One of these popular innovations is models for robust analysis of productivity, efficiency, and determining factors using bootstrap DEA techniques and semiparametric second-stage DEA methods. From the seminal works of Simar [12] and Simar and Wilson [13], these approaches have emerged to deal with boundary issues arising from the deterministic and non-parametric nature of DEA estimators, creating a symbiosis that integrates the random term contained in methods of the type SFA to the frontier estimated by non-parametric methods of the DEA type. The last decade has seen an exponential growth in the use of the bootstrap approach in efficiency and productivity studies [14], with the number of citations of the bootstrap methods by Simar and Wilson [15,16,17] exceeding 7200.
In transportation systems—a part of what is known as utility services, along with telecommunications, electricity, water, and sanitation—benchmarking gained importance as an indispensable regulatory tool. During the 1990s, a wave of infrastructure privatization and denationalization began in many developing countries, associated with an attempt to reduce the public deficit, and attract foreign investment through the segmentation of vertically integrated companies, a new regulatory framework, and the creation of new independent regulatory agencies.
Until then, these utility services and natural monopolies were mainly controlled and operated by the state through direct administration bodies, autarchies, or public companies. However, in this new regulatory framework, efficiency and benchmarking are at the core of regulators’ responsibilities when implementing incentive-based regulations [18]. One of the most important incentive-based regulation tool is the price-cap, with every OECD country adopting this regulation scheme in at least one industry [19].
In short, it consists of regulating maximum prices for each product offered or for a basket of them through a periodically reviewed CPI-X rate. This rate is equal to the change in the general price index (CPI) minus a productivity factor offset, commonly denoted by X. To determine X, agencies periodically carry out or order studies on the growth of total factor productivity (TFP) and the relative efficiency levels of companies in the sector. This procedure is, by definition, a benchmarking approach, mainly adopting frontier-based methods such as DEA and SFA, and its estimation is a complex matter [18].
Alongside its regulatory importance, transportation systems are of vital importance to economic development and regional integration but are also responsible for a set of undesired outputs. In 2021, according to data from the IEA (https://www.iea.org/topics/transport accessed on the 10 June 2023), transportation was responsible for 37% of CO2 emission from end-use sectors. According to the World Health Organization (https://www.who.int/en/news-room/fact-sheets/detail/road-traffic-injuries accessed on 10 June 2023), by 2030, road traffic accidents are expected to be the seventh largest cause of death, hence the importance of efficiency and performance assessment in TS.
Thus, the goal of this work is to offer a comprehensive bibliometric analysis of DEA and SFA applied to the transportation sector, from 1977 to 2022, and a systematic review of DEA papers applied to the rail sector, in an attempt to answer the research question: “How to assess the efficiency of transport systems and what are their determining factors?”. To our knowledge, this is the first work that includes both SFA and DEA in transport.
From the posed question, we will be able to contribute to the academic discussion on literature gaps and future directions for data envelopment analysis and rail-related research, as well as propose a bibliometric update of DEA documents in transportation systems and, for the first time, a bibliometric assessment of stochastic frontier publications applied to TS, serving as a base for efficiency and performance analysis in TS.
This work is organized as follows: In Section 2, the referenced literature reviews are presented. In Section 3, the methods and materials are presented, including a detailed description of the databases and data treatment. Section 4 presents the results of the bibliometric analysis and the main statistics regarding DEA and SFA publications. Section 5 proposes a new segmentation for the surveyed literature and a detailed systematic review of DEA in railway sector is presented. Section 6 contains the final remarks and conclusions of the article.

2. Referenced Reviews

For the research regarding DEA in transportation sector, the main previous literature reviews considered in this study are those by Mahmoudi et al. [20] and Cavaignac and Petiot [21].
Mahmoudi et al. [20] used Google Scholar, Web of Science, and Scopus databases to identify more than 600 articles from 1989 to 2018 and classified the 40 most cited papers published from 2007 to 2018 to explore the DEA applications in transport. For those 40 papers, the authors investigated the most common DEA models used for transportation systems, stating that “CCR (Charles, Cooper & Rhodes), BCC (Banker, Charles & Cooper) and SBM (Slacks-Based Measure) are the most popular models used in the literature”.
Cavaignac and Petiot [21] also surveyed DEA literature applied to transport sector using mainly Scopus, Google Scholar, and Econlit databases. They found 461 articles from 1989 to 2016, providing a summary of the 35 most cited articles presenting scope, models and results, as well as an analysis for articles dealing with ports and airports. From the analysis of the most cited papers, the authors identified that:
“The number of DMUs, inputs and outputs were far from obeying the rules which state that the number of DMUs should be greater or equal to twice the product of the number of inputs and the number of outputs or that the number of DMUs should be at least three times the number of inputs and outputs together”.
As for model decision, Cavaignac and Petiot [21] stated that more than half implemented DEA, CCR, or BCC. Also, all other analyses were completed using additional methods such as Malmquist indices, second-stage regression analyses, Simar and Wilson bootstrapping regression analysis etc. Most of the surveyed articles used a VRS formalization.
Mahmoudi et al. [20] proposed a literature segmentation with six sections: (1) DEA and highway transportation, (2) DEA and air transportation, (3) DEA and ports and maritime transportation, (4) DEA and railway transportation, (5) DEA, eco-design, sustainable development, and green issues in transportation, and (6) DEA and other transportation research.
The authors identified that a third of the retrieved articles relate to air transportation and 80% of the papers published between 2008 and 2018 are related to air transport. The authors also present the most cited articles, as well as the most active journals and most productive countries. Mahmoudi et al. [20] used social network analysis (SNA) for citation and co-citation analysis, collaboration among researchers, knowledge patterns, gaps, and emerging knowledge trends within each of the six categories.
In a similar manner, Cavaignac and Petiot [21] presented a monovariate and a multivariate analysis for a number of publications, journals, authors, geographical areas, articles, impact, and a segmentation for DEA research in transport systems, with six categories: air, maritime transport, transit, rail, road, and articles that deal with the transport system as a whole.
We highlight the findings for rail transportation in the work of Mahmoudi et al. [20]. From the 29 surveyed papers, the authors identified the following themes as the most important: (i) performance assessment of railway passenger and freight transportation companies; (ii) performance assessment of railway transport considering environmental issues; (iii) selection and location of urban railway stations; (iv) assessment of the effect of private sector participation, governance structure, policy changes and new investments on performance and efficiency; and (v) performance of rail transportation through time.
For future research in railway systems, Mahmoudi et al. [20] highlight the need for studying various perspectives such as environmental, economic, and social sustainability as well as user experience and quality of service.
Considering that railway transportation, especially in developing countries, has a governmental structure, the assessment of the effects of privatization on performance and efficiency is an important research subject, as well as the assessment of before/after policy/regulatory changes. In addition, Mahmoudi et al. [20] indicate that sustainability and safety issues are an emerging theme that can be analyzed through DEA.
Regarding literature reviews on SFA in transport, as stated in the Introduction, we were unable to identify any.

3. Materials and Methods

Bibliometrics is a research technique that studies publications to quantify, analyze, and critically evaluate relevant scientific production on specific topics. It measures the contribution of scientific knowledge derived from publications, identifying their authors, institutional affiliation, research networks, citations, and keywords. It is used to represent current research trends, identify new themes, methods, and gaps in the literature as a means of supporting the justification and planning of future investigations [22]. To stay current in their fields, researchers often recur to these studies.
The fundamental component of bibliometric research is a database of published documents and its analysis is both objective and subjective in essence [23]. In sum, the goal is to summarize large quantities of bibliometric data and present the state of the intellectual structure and emerging trends of a research topic or field and is used when the database is too big for a manual analysis [23].
The importance of bibliometric analysis has grown exponentially over the last few years [24,25,26], especially with the advances and popularization of bibliometric software such as VOSviewer and programming language packages such as Bibliometrix. Despite its ever-growing importance, it is still relatively new in management and business research [23].
The primary benefit of adopting this approach lies in its ability to overcome the limitations of qualitative reviews. Instead of relying on the judgement of a single expert, it harnesses the collective judgment of many experts in a given field.
Another method of review research is the systematic review. Its main objective is to provide a comprehensive synthesis of relevant studies in a single document [27]. It enables researches to analyze scientific contributions and summarize findings [28], and differs from traditional qualitative narrative reviews in that it adopts a reproducible process, creating a trail of author decisions, methods and findings.
We believe that the integration of a bibliometric and systematic review can be a powerful tool in analyzing literature. In this context, to answer the research question stated in the Introduction, we propose a bibliometric analysis, taking as reference the PRISMA Statement (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for both DEA and SFA publications related to transportation systems, followed by a systematic review for DEA rail-related papers, founded on the steps proposed by Tranfield et al. [29], when possible and applicable.
The PRISMA Statement is an evidence-based minimum set of items aimed at helping researchers report a wide array of systematic reviews and meta-analyses. It consists of a 27-item checklist and three phase diagram [30]. The three phases are: (i) identification; (ii) screening; and (iii) included. The description of each phase and the 27-item checklist can be found in The PRISMA 2020 statement: an updated guideline for reporting systematic reviews (bmj.com accessed on 17 August 2022).
Tranfield et al. [29] proposed 3 stages and 9 phases for systematic reviews in management sciences. We highlight Stage II—Conducting a Review and its phases of selection of studies; study quality assessment, data extraction; and data synthesis, applied in this research.
When comparing the proposed methodology to the reviews mentioned in Section 2, the approaches are similar in essence, but we opt for a more formal systematic review, overcoming the limitation of analyzing only a limited number of publications in a specific segment of TS and proposing a more in-depth discussion of important issues.
In particular, Cavaignac and Petiot [21] provided a descriptive summary and commented analysis of a reduced sample of 22 papers published in 2014 on the airport and port sectors. Mahmoudi et al. [20] broadened the scope of analysis by assessing a limited number of papers in each pre-defined category. We provide a systematic review of all DEA rail-related papers.
For this work, we considered mainly research written in English. The database used as the main source of information was Web of Science (WoS), consulted on the 5th of august of 2022. WoS is a multidisciplinary global citation database originally developed by the Thomson Institute for Scientific Information (ISI), currently maintained by Clarivate Analytics and its platform allows for the search of almost 1.9 billion cited references from over 171 million records.
We have not included the Scopus database since, as presented by the R package “bibliometrix” documentation [31], “Scopus data needs a huge cleaning phase to match reference items (often the same reference is written in several different ways!)”, making it virtually impossible to conduct a citation and co-citation analysis on Scopus database.
At first, using the keywords (efficiency OR productivity) AND (transport OR transportation), WoS returned more than 12,000 results, with an substantial part dealing with energy or engine efficiency, much like the results from Yakath Ali et al. [32] when reviewing literature on air transportation efficiency. As energy or engine efficiency are not necessarily the scope of this work, we restricted the keywords to concentrate only on documents dealing with DEA and SFA in transport systems, with no date restriction.
The keywords used in WoS search engine were:
  • (“data envelopment analysis”) AND (transportation OR transport);
  • (“data envelopment analysis”) AND (road OR highway);
  • (“data envelopment analysis”) AND (rail OR railway OR railroad);
  • (“data envelopment analysis”) AND (“air transport” OR “air transportation” OR airport OR airline);
  • (“data envelopment analysis”) AND (maritime OR “port”);
  • (“stochastic frontier”) AND (transport OR transportation);
  • (“stochastic frontier”) AND (road OR highway);
  • (“stochastic frontier”) AND (rail OR railway OR railroad);
  • (“stochastic frontier”) AND (“air transport” OR “air transportation” OR airport OR airline);
  • (“stochastic frontier”) AND (maritime OR “port”).
The retrieved documents from the selected database contain the information registered in Table 1.
Figure 1 presents a modified version of the PRISMA flow diagram for updated systematic reviews which included searches of databases and registers only.
In identification phase shown in Figure 1, the 1910 identified registers from WoS’s database were analyzed by an automation tool to remove all books and conference papers.
In the screening phase, we checked both the articles’ titles and abstracts to identify registers that had no efficiency analysis or those that were not related to transportation systems. Then, the 1217 remaining articles assessed for eligibility were analyzed through publication-related metrics, citation-related metrics, and science mapping techniques. This Bibliometric analysis is an important intermediate step to locate efficiency research in transportation.
After the bibliometric analysis on DEA and SFA transport publications, we categorized the articles in 5 groups, representing each transportation system: highway/road transportation, air transportation, maritime/port transportation, railway transportation, and urban/bus transportation.
Then, we conducted a systematic review on DEA publications related to rail transportation and assessed the intellectual structure of the field through a co-citation, coupling, and keyword analysis. Citation analysis is a major bibliometric approach, as “a scientific paper does not stand alone” [33]. It shows the structure of a research field and is usually consists of two different analyses: coupling and co-citation [31], and can be applied to both authors and journals.
Bibliographic coupling is a similarity measure for clustering research papers [34]. It occurs when two papers reference a common third document in their bibliography and its strength increases as the number of references in common increases. Co-citation occurs when two documents are cited by a third document [35]. Co-citation is larger when two documents are cited by many other documents. Figure 2 illustrates a bibliographic coupling and a bibliographic co-citation, respectively.
Articles A and B are coupled when they cite papers 1, 2, and 3. Papers A and B are associated with each other because they are both cited by papers 1, 2, and 3.
This knowledge mapping is especially important, as it does not constitute the authors’ opinion, but a quantitative view of the intellectual structure of the field. In this work, we use both methods as it is our goal to explore older papers in different time periods, better represented by co-citation analysis, and explore current research subjects, better represented by bibliographic coupling [31].
Lastly, the categorized rail publications were reviewed to assess their objectives, used method for efficiency analysis, input–output variables, and results. With the proposed methodology, we intend to identify trends in research subjects, as well as gaps and future directions.

Data Treatment

With WoS database of DEA and SFA publications in transport systems, we proceeded a data treatment using the R Programming language. The first step is to adjust misspelled author names or differently written names in different documents. This is a known problem in digital bibliography databases and its non-treatment can compromise the bibliometric analysis [36], especially citation and productivity metrics, and invalidate conclusions.
For author name disambiguation, we used the algorithm proposed by Fournier et al. [37], operationalized in refsplitr package for the R programming language. The proposed approach, as cited by the package developers, is to identify clusters by iteratively building webs of authors using mainly ORCID and RID numbers, as well as other available information such as address, email, or middle name. If one of these variables match when comparing different spelling names, the package assumes it is the same author. If it doesn’t, the package calculates a confidence score from provided information and Jaro–Winkler textual matching. For this work, we used a confidence score of 5, cited by the package authors as “nearly always correct”.
Regarding citations, data cleaning was not necessary as WoS pre-processes databases’ reference lists, rewriting them as first author, year, journal, issue, and DOI, making it possible to perform citation and co-citation analysis.
Lastly, we analyzed author keywords and keywords plus to create clusters when the same word/idea were written in different ways. As a brief example, we considered the keywords, “data envelopment analysis”, “dea”, “data envelopment analysis (dea)” as the same keyword.

4. Results

As presented in Section 3, we identified 1910 documents resulting from the keywords used in WoS search engine. In PRISMA’s identification phase, 142 books and conference papers were removed and in the screening phase; another 551 papers were excluded as they do not present an efficiency analysis or are not transport related. This resulted in a total of 1217 articles, 1041 DEA papers and 318 SFA papers. It is important to mention that the sum of DEA and SFA papers did not result in the total 1217 papers, as some of the retrieved documents apply both DEA and SFA.
Thus, as stated in Item 3, we present a preliminary assessment of the main statistics regarding those 1217 papers, such as the number of publications, growth rate, most productive authors, most productive countries, and most cited articles. Before entering each specific mode of transport, we considered this a relevant intermediate step to locate efficiency research in transportation and its main actors.

4.1. Statistics on DEA Publications

4.1.1. Number of Publications

As stated, 1041 published articles were identified for DEA in transportation. The publications range from 1989 to 2022, with an annual growth rate of 15% and an average citation per year of 2.83. Figure 3 presents the publication time series of DEA documents in the transport sector.
From those 1041 published articles, there were 1020 articles and 21 reviews. The most productive year was 2021, with 114 published documents.
Regarding journals, we identified 283 sources with a less concentrated database when compared to Cavaignac and Petiot [21] findings. These authors verified that one publication out of three was published in a group of only five journals. This time around, we found that one paper out of three was published in a group of 26 journals.
It is also interesting to note that the five journals cited by Cavaignac and Petiot [21] as having the most published articles for DEA in transportation—Journal of Air Transport Management (JATM), Transportation Research Part E (TRE), Transportation Research Part A (TRA), International Journal of Transport Economics (IJTE), and Transport Policy (TP)—still constitute an significant part of DEA publications in this updated literature review.
However, we can identify a newcomer: Sustainability. This journal was not even cited by Cavaignac and Petiot [21] and appears with only eight publications in Mahmoudi et al.’s review [20], but has become the journal with the second-most DEA publications in transport, with 45 articles. Indeed, when looking at the retrieved database, it seems that operational research in transport was included as a topic of interest in Sustainability, with its first publication in 2015.
Furthermore, it seems that transportation journals in general have become more relevant over the years, and DEA publications also seem to have reached more relevant journals. In the Cavaignac and Petiot [21] review of journals with at least five DEA publications in transport, only two had an h-index (The h-index is an author and scholarly journal-level metric that measures the productivity and citation impact of publications, initially used for an individual scientist or scholar.) higher than 100. This time around, we found 8 out of the 15 journals had an h-index higher than 100.
Table 2 shows the top 15 journals in number of publications.
From the listed 15 journals, 12 are transport-specific and they represent 20% of all published DEA documents in TS. The mean impact factor (The impact factor (IF) or journal impact factor (JIF) of an academic journal is a scientometric index calculated by Clarivate that reflects the yearly mean number of citations of articles published in the last two years in a given journal, as indexed by Clarivate’s Web of Science.) (IF) 2021 of the 15 journals is 5, with only two presenting an IF lower than 1. This shows clear growth when compared to Cavaignac and Petiot [21] results, as they verified that the “average Impact Factor of the 23 most publishing journals in the field is rather low (1.5446 in 2015) which results in a small extra-sectorial diffusion”, and can be interpreted as increased academic importance regarding DEA publications in transport, reaching higher-impact-factor journals and increasing extra-sectorial diffusion.

4.1.2. Authors

For authors, we identified 2033 for 1041 documents, with an average of 3 co-authors per document and an international co-authorship of 29%. We identified a high concentration of publications when analyzing authors, where 30 authors comprise more than a third of all 1041 published documents, a result that can be compared to Cavaignac and Petiot [21], where they identified a quarter of the authors is involved in 61.4% of the articles. Figure 4 presents the top 30 most productive authors.

4.1.3. Countries

As identified in author analysis, it can also be said that publications are highly concentrated geographically, with China representing 27% of all the 1041 articles as shown in Figure 5. These results are also comparable to Cavaignac and Petiot [21] and Mahmoudi et al. [20].

4.1.4. Citation Order

Lastly, we present the 10 most cited DEA-transport publications in Table 3, arranged by total citations (TC).
The first application of DEA in the transport sector can be traced back to Adolphson et al. [48] in an attempt to measure obsolescence in railways. It uses the classic DEA–CCR model and derives best practices based on one input, rate of return, and one output, transportation performance. The authors compare the DEA approach to the Wisconsin approach, indicating that DEA allows for multiple inputs and outputs, as well as an evaluation of performance levels considering the resources required to reach the efficiency frontier. Since then, the number of DEA models applied to transport sector publications has grown rapidly, gaining importance and relevance, reaching higher impact factor journals.
From the articles listed in Table 3, two are literature surveys/reviews, including the first systematic review of DEA [38]. The other eight articles are all applications of different DEA models. Cullinane et al. [39] is the most cited between application articles, as it compares DEA and SFA efficiency results for container ports and concludes that the results are “relatively robust to the DEA models applied or the distributional assumptions under SFA”, with a high degree of correlation between efficiency scores from both models.

4.2. Statistics on SFA Publications

4.2.1. Number of Publications

For SFA publications in TS, 318 published documents were identified ranging from 1995 to 2022, an annual growth rate of 10.81% and an average citation per year of 2.2. Figure 6 presents the publication time series of SFA documents in transport sector. All the retrieved documents are articles, and the most productive year was 2021, with 35 published documents.
We identified 156 journals with a high concentration of publications, higher than DEA. Considering our database, half the published documents are concentrated in only 22 journals, as listed in Table 4. It is interesting to notice that from the top 15 journals listed in Table 4, 9 are also listed in Table 2 for DEA publications, showing that these transportation journals are model agnostic.
As SFA and DEA share most of their journals in terms of number of publications, they also share similar relevance and impact factor numbers. The mean impact factor 2021 of the 15 journals shown in Table 4 is 4.8, with only one presenting an IF lower than 1. Thus, in terms of academic importance and extra-sectorial diffusion, DEA and SFA seem to be on the same level for transportation systems.

4.2.2. Authors

For authors, we identified 642 for 318 documents, with an average of 2.7 co-authors per document and an international co-authorship of 27.36%. Like journals, we also identified a high concentration of publications when analyzing authors, appreciably greater than the concentration verified for DEA documents. 30 authors concentrate 45% of all 318 published documents. Figure 7 presents the top 30 most productive authors.
However, DEA and SFA do not share the same authors, with only Peter Wanke and Carlos Pestana Barros appearing in both most productive author lists. This may relate to the findings of Lampe and Hilgers [11], where the authors indicate that DEA seems to be mostly applied in operational research and SFA seems to be mostly applied in an econometrics context. Thus, they are two different research areas, even though both SFA and DEA deal with efficiency frontier analysis.

4.2.3. Countries

Regarding the geographical distribution of published SFA articles, China is the most productive country, but the distance between and the second place is much shorter than the one identified for DEA publications. Additionally, Brazil’s importance in SFA publications in transport is much less pronounced than for DEA publications, where Brazil is the third-most productive country. Figure 8 presents the geographical production.

4.2.4. Citation Order

Finally, we present the 10 most cited SFA-transport publications in Table 5, arranged by total citations (TC). It is interesting to note that two articles are in both DEA and SFA’s most cited tables: Cullinane et al. [39] and Coelli and Perelman [49].
The first SFA application to the transport sector when considering Scopus, WoS, Google Scholar, and Scielo databases can be traced back to 1987, by Greene [57] in an attempt to measure the technical improvements in automotive fuel efficiency by estimating stochastic frontier cost functions for automotive fuel economy in 1978 and 1985. Since then, SFA applications in the transport sector have increased, but have been largely outpaced by DEA publications.
From the listed papers, there is only one literature review that surveys both DEA and SFA production [11]. All of the other nine papers are stochastic frontier applications, with two of them proposing a methodological evolution and are both were applied to the railway sector [54,56]. It is also important to mention that four of the most cited articles deal with container port efficiency [39,50,51,55], in what seems to be an important subject in stochastic frontier analysis.

5. Applications in Transportation Systems

As described in Section 3, we separated the articles into five groups, representing each transportation system: highway/road transportation, air transportation, maritime/port transportation, railway transportation, and urban/bus transportation. This classification differs from the one proposed by Mahmoudi et al. [20] in two aspects. First, we did not create an exclusive category for “Green and environmental issues” as this seems to be a subcategory in transportation research rather than a main one. Our intention was to directly observe what mode of transport is more concerned with “Green and environmental issues” and whether it is a growing subject or a literature gap. Secondly, we added the category of urban/bus transportation, also known as urban mobility, as specialized literature regarding transportation tends to also separate road/highway from bus/urban transportation.
Figure 9 presents the proposed separation for DEA articles. The sum of articles will be greater than total of articles in our database, as some documents deal with more than one transportation mode.
Only DEA-rail related articles will be reported here.

5.1. DEA in Railway Transport

From those 135 articles, more than half were published in the last 10 years. From surveying all 135 DEA publications dealing with rail transportation, we identified that 31 are transport-related, but not rail-specific; three are not DEA-related; six are literature reviews; and we were not able to access 15 papers.
As a result, we read 83 papers and determined the DEA model used; the second-stage analysis, if any; the input–output variables; the model orientation; return-to-scale assumptions; and its methodological classification. As for the DEA models used, Figure 10 presents the main results.
The most common DEA model used in railway sector is the classic CCR, with constant returns to scale (CRS), and its variable returns to scale (VRS) counterpart as the second-most common, the BCC. These findings are in line with Mahmoudi et al. [20] results.
The third-most used model is the network DEA (NDEA), introduced by Färe and Grosskopf [58]. From the selected papers in this research, NDEA seems to be one of the most relevant DEA applications when considering the total citations number. From the five most cited rail-related papers, three of them apply the NDEA model, including a sector-seminal paper by Yu and Lin [45]. Its recent growth can be seen as a natural development of efficiency research in railways, especially in more complex production processes in which the final outputs depend on more than one stage of production or in a context where a DMU engages in simultaneous activities and its performance in each activity must be determined simultaneously, as its outputs cannot be stored [59]. Also, the NDEA addresses an innate problem of DEA regarding DMU treatment as “black-boxes”, and it is able to consider intermediate production phases.
This modelling is especially relevant in research regarding the environmental impact of rail activities [60,61,62].
In addition, from the 83 surveyed papers, only 2 used both DEA and SFA to analyze efficiency: Lerida-Navarro et al. [63] and Lan and Lin [64]. In this sense, rail transportation seems to take a mutually exclusive stance on methodology selection, even though some authors do use both approaches in transportation systems, including the second-most cited transportation-specific paper: Cullinane et al. [39].
With respect to returns to scale definition, even though there is a greater number of papers that assume CRS, there does not seem to be a clear-cut definition regarding the most adequate one, as some of the surveyed papers take an arbitrary approach to scale return assumptions. Growitsch and Wetzel [65] defend the use of the CRS approach because an efficiency comparison between firms must consider a long-term perspective. In this sense, the authors indicate that, in a European context, regulation and political influence warding off scale optimization will not stand in the long-run and sub-optimally-scaled railways should be identified as inefficient. On the contrary, Cowie [66] affirms that there is relevant evidence that variable returns-to-scale exist at what he calls “the lower end of the rail industry”.
Determining the underlying technological process as increasing, constant, or decreasing returns-to-scale is an essential part of investigating productive efficiency. The analysis of efficiency without an adequate testing on return-to-scale can warp efficiency scores and invalidate conclusions if the underlying technology displays a different return-to-scale than what is arbitrarily assumed [17], hence the importance of testing returns to scale in rail transportation.
Regarding the so-called second-stage analysis, the most common in rail-related papers is Tobit regression. However, the number of papers that do use the techniques presented in Figure 11 is considerably low, with most papers using only one DEA stage.
Fried et al. [67] suggest that non-parametric frontier models are deterministic, with no statistical interpretation, and founded on an unknown data generating process. In other words, all deviations from the frontier are interpreted as inefficiency, which is not often the case. In 1998, Simar and Wilson [13] proposed a bootstrap approach to manage the deterministic nature of DEA, invalidating one of DEA’s main critics. Also, regression analysis of efficiency scores based on additional contextual variables are an important part of this second-stage.
Yet, as stated by Simar and Wilson [17], papers published in relevant journals often ignore this statistical interpretation, and this seems to be the case for part of the collected database on rail efficiency research.
Regarding dynamic DEA, only nine papers used Malmquist indexes and one paper used Window analysis. Most of the surveyed papers use a cross-sectional approach, or a time series approach without measuring productivity change over time.
In line with the findings of Mahmoudi et al. [20], as shown in Figure 12, the most common input variables are labor, rolling stock, and line extension, with more than half of the 83 surveyed papers using at least one of these inputs. Regarding outputs, we verify that ton–km and passenger–km are also used in almost half the surveyed papers.
Apart from the mentioned variables, environmental/sustainability inputs and outputs are also relevant, as fuel consumption is the fourth-most used input. However, safety issues and accident analysis seem to be an underexplored topic in DEA research, with few very recent papers [68,69,70,71]. This seems to be a literature gap and an important area of development in rail research.
From this analysis, a variable selection discussion arises. Cullinane et al. [72] presented an extensive discussion on that matter, applied to the port sector, and stated that variable selection must reflect the processes and objectives of sector production, as the observed performance of a port is closely related to its objective. Cullinane et al. [72] also observed that input–output choice may change depending on the perspective, and variables that were considered as inputs in one model can be outputs in another.
When assessing transportation system performance, we must consider a multitude of factors and goals simultaneously. However, these goals may change from country to country, as rail transport can be of private, public, or mixed-provision. The variable choice is directly related to these factors and goals, as a strict market-oriented cost or technical model to assess performance and efficiency may misrepresent the goals of the system as a whole, especially when rail transportation service is of public or mixed-provision, operating in a broader social structure, where performance is also guided toward mobility, environmental improvements, land use, and financial commitments [73].
De Borger et al. [59] discusses this matter in a literature survey on production and cost frontiers models for public transit operators. The authors found that, similarly to rail transportation, the input selection consists mainly of capital, labor, and energy. What this group of variables does not consider is the differences between operators in the quality and composition of these inputs. Different locomotives with different purposes and different pattern of fuel consumption may be considered as the same when assessing rail efficiency. This is not a problem per se, but one must ask if this implicit assumption opposes the goal of the whole system. The same might be said about labor and its possible deterioration or rail extension shrinkage.
For outputs, De Borger et al. [59] brings a similar discussion that can be applied to the rail sector. There is a distinction between supply-sided indicators, often associated with service provision (number of formed trains, seat–km etc.) and demand-sided indicators, often associated with the product itself (ton–km, passenger–km etc.). From the reading of the DEA-related articles, authors rarely make this distinction clear or justify the use of one over the other.
Thus, a careful and detailed discussion must take place when choosing model variables at the risk of a biased analysis that misrepresents the processes and objectives of the sector.
Lastly, we present the publication time series of DEA rail-related papers to further assess the trends of research topics and how they have changed through time. We also highlight the research focus during each proposed period.
As seen in Figure 13, there is an initial period of slow adoption of DEA in railway performance analysis, from late 1980s to 2010. From then on, DEA solidifies itself as an important tool and its adoption in railway performance analysis begins an exponential growth. To better understand the presented results, we propose a three-period segmentation, as shown in Figure 13. Period 1: from late 1980s to 2010; Period 2: from 2011 to 2015; and Period 3: from 2015 to 2023.
There were 23 publications in Period 1. Four of them are not rail-specific and we had no access to two, resulting in seventeen remaining articles. The classic CCR and BCC models are used in almost all articles, with two important exceptions: Yu [74] and Yu and Lin [45], who applied network DEA models. As they were the first to adopt this model in railway efficiency analysis, these are highly cited articles with 96 and 200 citations, respectively. The other adopted models were used together with CCR and BCC.
As to variable choice, all but one used either train–km, ton–km, or passenger–km as outputs, and all but two used a combination of land, capital, and labor inputs, either as cost or physical values. The two notable exceptions to input selection are the work of Ramanathan [75,76], who used a measure of energy as input.
This initial period, from the late 1980s to 2010, is not characterized by great innovation, but rather by an early phase of efficiency assessment grounded on production theory classic variables and DEA classic models.
Period 2 has 31 publications from which 8 are not rail related, 3 were not accessible, and 1 is a literature review, with 18 remaining. In this phase, there is a greater adoption of second-stage methods such as regressions, bootstrap bias correction, and analytic hierarchy process (AHP) to efficiency assessment, while first-stage models are still classic CCR and BCC.
This second phase is an initial experimentation with different variables and techniques, benefiting from advances in DEA literature as well as better data on rail operation. In this sense, five papers adopted a measure of energy as input, while outputs remain mostly the same from Period 1.
Period 3 has 81 documents, from which 13 are not rail-specific, 4 have no DEA application, 5 are literature reviews, and 9 were not accessible, with 50 remaining. Giving continuity to the developments of Period 2, this phase further explores not previously discussed topics, such as carbon emissions as undesired outputs, input congestion, quality of service and, of great importance, rail safety, presenting a handful of innovative analyses. For first-stage efficiency measures, slack-based measure DEA gains importance as a more consistent alternative to BCC [77], as well as non-radial DEA models and fuzzy data treatment. In second-stage measures, there is a greater use of regression models to assess the impact of exogenous variables, most (8) of them with Tobit regressions but with beta regression and generalized additive models for location scale and shape (GAMLSS) are also used. As to variable choice, there is a greater diversity in both inputs and outputs. For inputs, we highlighed the use of energy measures, travel time, fare/tariff, government subsidy, grade crossings, operational capacity, number of stations, and dwell time. For outputs, service quality variables appear more prominently and are incorporated to production assessment models with punctuality, accidents, passenger satisfaction, wage growth, noise complaints, and decibel levels from train operation.

5.1.1. Co-Citation Network Analysis

For co-Citation analysis, we used the bibliometrix R package [30]. Figure 14 presents the author co-citation network.
The structure of the network illustrated in Figure 14, showing a high concentration of co-citations, as expected. It is worth mentioning that two papers are clearly emphasized in the network: Charnes et al. and Banker et al. [8,78]. It is also possible to verify a cluster on sector-seminal papers by Yu and Yu and Lin [45,74].
The four cited articles have indeed impacted the operational research field and corroborate the findings in Table 6, as [8,78] they introduce the BCC and CCR models, and [45] proposed a model that represents both production and consumption technologies in a unified framework, through network DEA. Coelli and Perelman [41] is also highlighted in the network and presents the first comparison between parametric and non-parametric distance function models in transport sector. Farrell [4] is also a relevant publication, as he presented the possibility of estimating an efficient productive frontier with best practices and, by calculating the distance of each productive unit from this frontier, estimating the relative efficiency, before the introduction of both DEA and SFA.
It is also worth mentioning that none of Simar and Wilson’s work regarding bootstrap DEA techniques, semiparametric second-stage DEA methods, or return-to-scale tests appears in the co-citation network, corroborating the finding that the number of papers that do use second-stage models is considerably low.
Lastly, the resulting co-citation network has two clearly defined clusters. Assessing the papers in each cluster, it becomes clear that the blue cluster is related to rail transportation applied studies [45,74,79,80,81,82,83,84], whereas the red cluster is related to theorical methodological papers and review/survey papers. Appendix A presents the coupling and keyword analysis.
Table 6. Most cited DEA rail papers from the last 5 Years.
Table 6. Most cited DEA rail papers from the last 5 Years.
DocumentTitleTC
[20]The Origins, Development And Future Directions Of Data Envelopment Analysis Approach In Transportation Systems46
[84]Non-Radial Dea Model: A New Approach To Evaluation Of Safety At Railway Level Crossings23
[85]Performance Evaluation Of Rail Transportation Systems By Considering Resilience Engineering Factors: Tehran Railway Electrification System21
[68]Evaluation Of Energy-Environment Efficiency Of European Transport Sectors: Non-Radial Dea And Topsis Approach14
[86]Efficiency, Effectiveness, And Impacts Assessment In The Rail Transport Sector: A State-Of-The-Art Critical Analysis Of Current Research14
[69]A Novel Entropy-Fuzzy Piprecia-Dea Model For Safety Evaluation Of Railway Traffic13
[87]Selection Of Efficient Types Of Inland Intermodal Terminals13
[88]Transportation Efficiency Evaluation Considering The Environmental Impact For China’s Freight Sector: A Parallel Data Envelopment Analysis12
[89]Multi-Output Efficiency And Operational Safety: An Analysis Of Railway Traffic Control Centre Performance12

5.1.2. Recent Relevant Publications

Finally, as a source of direction to recent DEA rail research, we present the 10 most cited papers published in the last five years in Table 6, considering that the most recent literature review analyzed published papers until 2018 [20].
From the listed publications, as well as from the analysis regarding input–output variables and the proposed three-period segmentation, it seems clear that safety research and sustainability research are emerging topics in DEA rail applications, as it is the main theme for six out of the ten most cited papers published in the last five years. Also, considering the presented papers in Table 6, along with the presented analysis from Figure 13, there seems to be a departure from the classic CCR and BCC models, with the adoption of more modern techniques.

6. Conclusions

This paper presented a bibliometric analysis of efficiency in transportation systems, including an overview of stochastic frontier analysis, a first regarding transportation literature reviews. The retrieved publications were separated in five groups: highway/road transportation, air transportation, maritime/port transportation, railway transportation, and urban/bus transportation.
Also, a systematic review of DEA rail-related papers was presented, where 83 rail-related publications were reviewed to assess model choice; second-stage analysis, if any; input–output variables; model orientation; return-to-scale assumptions; and their methodological classification.
The main results regarding the bibliometric analysis of DEA and SFA publications presented in Section 4.1 and Section 4.2 are listed below:
  • DEA in transportation systems has undergone exponential growth since 2008. The most productive year was 2021, with 114 published documents;
  • Concerning journals, when compared to the last literature review, publications of DEA in transportation systems are less concentrated and more relevant, with an average impact factor of 5;
  • Regarding author productivity, publications of DEA in transportation systems are also highly concentrated where 30 authors concentrate more than a third of all 1041 published documents;
  • For country productivity, publications of DEA in transportation systems are also highly concentrated, with China representing 27% of all the 1041 articles;
  • SFA in transportation systems has also undergone exponential growth since 2000. The most productive year was 2021 with 35 published documents;
  • Regarding journals, publications of SFA in transportation systems are more concentrated than DEA, half the published documents are concentrated in only 22 journals, and equally relevant, with an average impact factor of 4.8;
  • For authors, publications of SFA in transportation systems are highly concentrated, appreciably greater than the concentration verified for DEA documents; 30 authors concentrate 45% of all 318 published documents;
  • Regarding country productivity, publications of SFA in transportation systems are also highly concentrated, with China representing 22% of all the 318 articles.
For DEA in Railway transport, the main results from the systematic review of the 135 selected papers are listed below:
  • The most common DEA model used in the railway sector is the classic CCR, with constant returns-to-scale (CRS), and its variable returns-to-scale (VRS) counterpart as the second-most common, the BCC;
  • The third-most used model is the Network DEA, and is one of the most relevant DEA applications when considering the total citations number;
  • Regarding returns-to-scale, even though there is a greater number of papers that assume CRS, there does not seem to be a clear-cut definition regarding the most adequate one and most of the published documents do not test the data generating process for scale returns;
  • For second-stage analysis, the most common in rail-related papers is Tobit regression, but the number of papers that do use these techniques is considerably low, a finding corroborated by the co-citation network;
  • Regarding input variables, labor, rolling stock, and line extension are present in more than half of the reviewed papers;
  • Concerning output variables, ton–km and passenger–km are also used in almost half the surveyed papers;
  • Environmental/sustainability inputs and outputs are also relevant, as fuel consumption is the fourth-most used input;
  • Safety issues and accident analysis seems to be an underexplored topic in DEA research, with very little recent research, but is surely an emerging topic, as shown in Table 6;
Few publications explore rail quality of service, an important topic in countries where rail transportation is a public service.
From the listed results, an important conclusion is that efficiency research in transportation systems do not follow a structured path. As stated in Section 5, even though there is a greater number of papers that assume CRS, some of the surveyed papers take an arbitrary approach to scale return assumptions, despite the fact that there is a known test for the identification of the type of scale returns [17]. Also, some of the surveyed papers do not consider a second-stage analysis method such as bootstrap, Tobit regression, etc., as shown by the co-citation analysis. Furthermore, most of the documents do not propose a sensitivity analysis of the chosen input–output variables or a deeper discussion on the assumptions behind the variable selection. Lastly, only one rail-specific surveyed paper compares the efficiency results from DEA to other efficiency frontier models.
With this in mind, we propose a guided path to efficiency analysis in railway transportation, that can be extrapolated to other knowledge fields, when using the classic CRR and BCC models:
  • Preliminary analysis—careful and detailed discussion about a system’s objectives and variable choice, as well as a preliminary data-cleaning analysis;
  • 1st step—application of the classic CCR and BCC models;
  • 2nd step—super-efficiency and super-inefficiency using an inverted frontier to better explore outliers and possible data errors, along with other outlier detection measures;
  • 3rd step—stepwise/sensitivity analysis for a possible variable reduction or as an assessment of the importance of each variable;
  • 4th step—return-to-scale testing, such as that proposed by Simar and Wilson (2002);
  • 5th step—second-stage analysis, such as bootstrap and regressions on contextual variables;
  • 6th step—dynamic efficiency analysis using Malmquist productivity indexes to identify changes in efficiency and technological innovations over time;
  • 7th step—comparison with another relevant efficiency frontier model such as SFA.
It is important to mention that there are several limitations to this study. The most important is that all data were retrieved from the Web of Science database. Even though it is the largest and most important academic database available, the use of only one database excludes publications from journals not included in the WOS database. The second limitation, also mentioned by Lampe and Hilgers [11] and verified in this research, is the challenge of creating a complete dataset of SFA publications, as not all economic and econometric papers cite the SFA method, even though it is a frontier analysis. Lastly, as with most literature reviews, it is virtually impossible to cite each and every indirectly mentioned document.
We believe that the presented systematic review can support authors in advancing efficiency analysis in transportation systems, as well as reveal gaps in the literature, and emerging but underexplored themes.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/su151310300/s1, Table S1: Documents Database.

Author Contributions

Conceptualization, T.V. and C.R.P.; methodology, T.V.; software, T.V.; validation, T.V. and C.R.P.; formal analysis, T.V.; investigation, T.V.; resources, T.V. and C.R.P.; data curation, T.V.; writing—original draft preparation, T.V. and C.R.P.; writing—review and editing, T.V. and C.R.P.; visualization, T.V.; supervision, C.R.P. All authors have read and agreed to the published version of the manuscript.

Funding

The APC was funded by University of Brasília.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The documents database for this research is published as Supplementary Material.

Acknowledgments

We acknowledge the Projectum Research Group and the Research Support Fund (FAP/DF) for the financial support. We also thank the Assigned Editor and four anonymous reviewers for their constructive comments.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

For Coupling analysis we used the bibliometrix R package [31].
The author-coupling network in Figure A1 shows a much less concentrated graph than co-citation, with a degree of centralization of 0.23, compared to the 0.755 degree of centralization computed for the author co-citation analysis.
Figure A1. Author-coupling network. References: Brida jg, 2014 [90], Yao d, 2019 [91], Tang t, 2019 [88], Markovits-Somogyi r, 2011 [92], Cavaignac [21], Mahmoudi r, 2020 [20], Tavassoli m, 2015 [93], Mallikarjun s, 2014 [94], Kutlar a, 2013 [95], Bai x, 2021 [96], Djordjevic b, 2018 [84], Merkert r, 2010 [83], Jain p, 2008 [82], Wanke p, 2015 [97], Wanke p, 2018-1 [98], Wanke p, 2018-2 [99], Cullinane k, 2017 [100], Catalano g, 2019 [86], Bhatia v, 2021 [101], Michali m, 2021 [60], Marchetti d, 2017 [102], Marchetti d, 2019 [103], Sharma mg, 2016 [70], Holvad t, 2020 [104].
Figure A1. Author-coupling network. References: Brida jg, 2014 [90], Yao d, 2019 [91], Tang t, 2019 [88], Markovits-Somogyi r, 2011 [92], Cavaignac [21], Mahmoudi r, 2020 [20], Tavassoli m, 2015 [93], Mallikarjun s, 2014 [94], Kutlar a, 2013 [95], Bai x, 2021 [96], Djordjevic b, 2018 [84], Merkert r, 2010 [83], Jain p, 2008 [82], Wanke p, 2015 [97], Wanke p, 2018-1 [98], Wanke p, 2018-2 [99], Cullinane k, 2017 [100], Catalano g, 2019 [86], Bhatia v, 2021 [101], Michali m, 2021 [60], Marchetti d, 2017 [102], Marchetti d, 2019 [103], Sharma mg, 2016 [70], Holvad t, 2020 [104].
Sustainability 15 10300 g0a1
From the presented clusters, we can see both cited literature reviews, Cavaignac and Petiot (2017) [21] and Mahmoudi et al. (2020) [20], as well as a concentration of rail-applied publications in the blue cluster related to technical efficiency.
Lastly, for keyword analysis we used the bibliometrix R package [31].
As mentioned before from input–output variable analysis, most DEA rail research relates to technical efficiency. The keyword co-occurrences presented in Figure A2 corroborates these findings. They also corroborate the lack of safety-related research and the need for more sustainability-/emissions-related publications.
Figure A2. Keyword co-occurrence network.
Figure A2. Keyword co-occurrence network.
Sustainability 15 10300 g0a2

References

  1. Neely, A.; Bourne, M. Why Measurement Initiatives Fail. Meas. Bus. Excell. 2000, 4, 3–7. [Google Scholar] [CrossRef]
  2. Dattakumar, R.; Jagadeesh, R. A Review of Literature on Benchmarking. Benchmarking Int. J. 2003, 10, 176–209. [Google Scholar] [CrossRef]
  3. Bauer, P.W. Recent Developments in the Econometric Estimation. J. Econom. 1990, 46, 39–56. [Google Scholar] [CrossRef]
  4. Farrell, M.J. The Measurement of Productive Efficiency. J. R. Stat. Soc. Ser. A 1957, 120, 253. [Google Scholar] [CrossRef]
  5. Aigner, D.; Lovell, C.A.K.; Schmidt, P. Formulation and Estimation of Stochastic Frontier Production Function Models. J. Econom. 1977, 6, 21–37. [Google Scholar] [CrossRef]
  6. Meeusen, W.; van Den Broeck, J. Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error. Int. Econ. Rev. 1977, 18, 435. [Google Scholar] [CrossRef]
  7. Kumbhakar, S.C.; Parmeter, C.F.; Zelenyuk, V. Stochastic Frontier Analysis: Foundations and Advances I. In Handbook of Production Economics; Springer: Singapore, 2020; pp. 1–39. [Google Scholar]
  8. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the Efficiency of Decision Making Units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  9. Lovell, C.A.K.; Grosskopf, S.; Ley, E.; Pastor, J.T.; Prior, D.; Vanden Eeckaut, P. Linear Programming Approaches to the Measurement and Analysis of Productive Efficiency. Top 1994, 2, 175–248. [Google Scholar] [CrossRef]
  10. Coelli, T.; Rao, D.S.; O’Donnell, C.; Battese, G. An Introduction to Efficiency and Productivity Analysis; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2005; ISBN 978-0-7923-8062-7. [Google Scholar]
  11. Lampe, H.W.; Hilgers, D. Trajectories of Efficiency Measurement: A Bibliometric Analysis of DEA and SFA. Eur. J. Oper. Res. 2015, 240, 1–21. [Google Scholar] [CrossRef]
  12. Simar, L. Estimating Efficiencies from Frontier Models with Panel Data: A Comparison of Parametric, Non-Parametric and Semi-Parametric Methods with Bootstrapping. J. Product. Anal. 1992, 3, 171–203. [Google Scholar] [CrossRef]
  13. Simar, L.; Wilson, P.W. Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models. Manag. Sci. 1998, 44, 49–61. [Google Scholar] [CrossRef] [Green Version]
  14. Moradi-Motlagh, A.; Emrouznejad, A. The Origins and Development of Statistical Approaches in Non-Parametric Frontier Models: A Survey of the First Two Decades of Scholarly Literature (1998–2020). Ann. Oper. Res. 2022, 318, 713–741. [Google Scholar] [CrossRef]
  15. Simar, L.; Wilson, P.W. Estimation and Inference in Two-Stage, Semi-Parametric Models of Production Processes. J. Econom. 2007, 136, 31–64. [Google Scholar] [CrossRef]
  16. Simar, L.; Wilson, P.W. A General Methodology for Bootstrapping in Non-Parametric Frontier Models. J. Appl. Stat. 2000, 27, 779–802. [Google Scholar] [CrossRef]
  17. Simar, L.; Wilson, P.W. Non-Parametric Tests of Returns to Scale. Eur. J. Oper. Res. 2002, 139, 115–132. [Google Scholar] [CrossRef]
  18. Coelli, T.; Estache, A.; Perelman, S.; Trujillo, L. A Primer on Efficiency Measurement for Utilities and Transport Regulators; The World Bank: Washington, DC, USA, 2003; ISBN 978-0-8213-5379-0. [Google Scholar]
  19. Mirrlees-Black, J. Reflections on RPI-X Regulation in OECD Countries. Util. Policy 2014, 31, 197–202. [Google Scholar] [CrossRef] [Green Version]
  20. Mahmoudi, R.; Emrouznejad, A.; Shetab-Boushehri, S.-N.; Hejazi, S.R. The Origins, Development and Future Directions of Data Envelopment Analysis Approach in Transportation Systems. Socioecon. Plann. Sci. 2020, 69, 100673. [Google Scholar] [CrossRef]
  21. Cavaignac, L.; Petiot, R. A Quarter Century of Data Envelopment Analysis Applied to the Transport Sector: A Bibliometric Analysis. Socioecon. Plann. Sci. 2017, 57, 84–96. [Google Scholar] [CrossRef]
  22. Su, H.-N.; Lee, P.-C. Mapping Knowledge Structure by Keyword Co-Occurrence: A First Look at Journal Papers in Technology Foresight. Scientometrics 2010, 85, 65–79. [Google Scholar] [CrossRef]
  23. Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to Conduct a Bibliometric Analysis: An Overview and Guidelines. J. Bus. Res. 2021, 133, 285–296. [Google Scholar] [CrossRef]
  24. Donthu, N.; Kumar, S.; Pattnaik, D. Forty-Five Years of Journal of Business Research: A Bibliometric Analysis. J. Bus. Res. 2020, 109, 1–14. [Google Scholar] [CrossRef]
  25. Donthu, N.; Kumar, S.; Pattnaik, D.; Lim, W.M. A Bibliometric Retrospection of Marketing from the Lens of Psychology: Insights from Psychology & Marketing. Psychol. Mark. 2021, 38, 834–865. [Google Scholar] [CrossRef]
  26. Khan, M.A.; Pattnaik, D.; Ashraf, R.; Ali, I.; Kumar, S.; Donthu, N. Value of Special Issues in the Journal of Business Research: A Bibliometric Analysis. J. Bus. Res. 2021, 125, 295–313. [Google Scholar] [CrossRef]
  27. Aromataris, E.; Pearson, A. The Systematic Review. AJN Am. J. Nurs. 2014, 114, 53–58. [Google Scholar] [CrossRef] [Green Version]
  28. Tahirov, N.; Glock, C.H. Manufacturer Encroachment and Channel Conflicts: A Systematic Review of the Literature. Eur. J. Oper. Res. 2022, 302, 403–426. [Google Scholar] [CrossRef]
  29. Tranfield, D.; Denyer, D.; Smart, P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. Br. J. Manag. 2003, 14, 207–222. [Google Scholar] [CrossRef]
  30. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  31. Aria, M.; Cuccurullo, C. Bibliometrix: An R-Tool for Comprehensive Science Mapping Analysis. J. Informetr. 2017, 11, 959–975. [Google Scholar] [CrossRef]
  32. Yakath Ali, N.S.; Yu, C.; See, K.F. Four Decades of Airline Productivity and Efficiency Studies: A Review and Bibliometric Analysis. J. Air Transp. Manag. 2021, 96, 102099. [Google Scholar] [CrossRef]
  33. Osareh, F. Bibliometrics, Citation Analysis and Co-Citation Analysis: A Review of Literature I. Libri 1996, 46, 149–158. [Google Scholar] [CrossRef]
  34. Kessler, M.M. Bibliographic Coupling between Scientific Papers. Am. Doc. 1963, 14, 10–25. [Google Scholar] [CrossRef]
  35. Small, H. Co-Citation in the Scientific Literature: A New Measure of the Relationship between Two Documents. J. Am. Soc. Inf. Sci. 1973, 24, 265–269. [Google Scholar] [CrossRef]
  36. De Souza Rodrigues, N.; Costa, A.R.; Lemos, L.C.; Ralha, C.G. Multi-Strategic Approach for Author Name Disambiguation in Bibliography Repositories. In Information Management and Big Data, Proceedings of the 7th Annual International Conference, 2020, Lima, Peru, 1–3 October 2020; Springer: Cham, Switzerland, 2021; pp. 63–76. [Google Scholar]
  37. Fournier, A.; Boone, M.; Stevens, F.; Bruna, E. Refsplitr: Author Name Disambiguation, Author Georeferencing, and Mapping of Coauthorship Networks with Web of Science Data. J. Open Source Softw. 2020, 45, 2028. [Google Scholar] [CrossRef]
  38. Liu, J.S.; Lu, L.Y.Y.; Lu, W.-M.; Lin, B.J.Y. A Survey of DEA Applications. Omega 2013, 41, 893–902. [Google Scholar] [CrossRef]
  39. Cullinane, K.; Wang, T.-F.; Song, D.-W.; Ji, P. The Technical Efficiency of Container Ports: Comparing Data Envelopment Analysis and Stochastic Frontier Analysis. Transp. Res. Part A Policy Pract. 2006, 40, 354–374. [Google Scholar] [CrossRef]
  40. Kuosmanen, T.; Kortelainen, M. Measuring Eco-Efficiency of Production with Data Envelopment Analysis. J. Ind. Ecol. 2005, 9, 59–72. [Google Scholar] [CrossRef]
  41. Coelli, T.; Perelman, S. Comparison of Parametric and Non-Parametric Distance Functions: With Application to European Railways. Eur. J. Oper. Res. 1999, 117, 326–339. [Google Scholar] [CrossRef]
  42. Kahraman, C.; Onar, S.C.; Oztaysi, B. Fuzzy Multicriteria Decision-Making: A Literature Review. Int. J. Comput. Intell. Syst. 2015, 8, 637–666. [Google Scholar] [CrossRef] [Green Version]
  43. Gillen, D.; Lall, A. Developing Measures of Airport Productivity and Performance: An Application of Data Envelopment Analysis. Transp. Res. Part E Logist. Transp. Rev. 1997, 33, 261–273. [Google Scholar] [CrossRef]
  44. Tongzon, J. Efficiency Measurement of Selected Australian and Other International Ports Using Data Envelopment Analysis. Transp. Res. Part A Policy Pract. 2001, 35, 107–122. [Google Scholar] [CrossRef]
  45. Yu, M.-M.; Lin, E.T.J. Efficiency and Effectiveness in Railway Performance Using a Multi-Activity Network DEA Model. Omega 2008, 36, 1005–1017. [Google Scholar] [CrossRef]
  46. Sarkis, J. Analysis of the Operational Efficiency of Major Airports in the United States. J. Oper. Manag. 2000, 18, 335–351. [Google Scholar] [CrossRef]
  47. Adler, N.; Golany, B. Evaluation of Deregulated Airline Networks Using Data Envelopment Analysis Combined with Principal Component Analysis with an Application to Western Europe. Eur. J. Oper. Res. 2001, 132, 260–273. [Google Scholar] [CrossRef]
  48. Adolphson, D.L.; Cornia, G.C.; Walters, L.C. Railroad Property Valuation Using Data Envelopment Analysis. Interfaces 1989, 19, 18–26. [Google Scholar] [CrossRef]
  49. Coelli, T.; Perelman, S.; Romano, E. Accounting for Environmental Influences in Stochastic Frontier Models: With Application to International Airlines. J. Product. Anal. 1999, 11, 251–273. [Google Scholar] [CrossRef]
  50. Tongzon, J.; Heng, W. Port Privatization, Efficiency and Competitiveness: Some Empirical Evidence from Container Ports (Terminals). Transp. Res. Part A Policy Pract. 2005, 39, 405–424. [Google Scholar] [CrossRef]
  51. Cullinane, K.; Song, D.-W.; Gray, R. A Stochastic Frontier Model of the Efficiency of Major Container Terminals in Asia: Assessing the Influence of Administrative and Ownership Structures. Transp. Res. Part A Policy Pract. 2002, 36, 743–762. [Google Scholar] [CrossRef]
  52. Pels, E.; Nijkamp, P.; Rietveld, P. Inefficiencies and Scale Economies of European Airport Operations. Transp. Res. Part E Logist. Transp. Rev. 2003, 39, 341–361. [Google Scholar] [CrossRef]
  53. Oum, T.H.; Yan, J.; Yu, C. Ownership Forms Matter for Airport Efficiency: A Stochastic Frontier Investigation of Worldwide Airports. J. Urban Econ. 2008, 64, 422–435. [Google Scholar] [CrossRef] [Green Version]
  54. O’Donnell, C.J.; Coelli, T.J. A Bayesian Approach to Imposing Curvature on Distance Functions. J. Econom. 2005, 126, 493–523. [Google Scholar] [CrossRef] [Green Version]
  55. Cullinane, K.; Song, D.-W. A Stochastic Frontier Model of the Productive Efficiency of Korean Container Terminals. Appl. Econ. 2003, 35, 251–267. [Google Scholar] [CrossRef]
  56. Filippini, M.; Greene, W. Persistent and Transient Productive Inefficiency: A Maximum Simulated Likelihood Approach. J. Product. Anal. 2016, 45, 187–196. [Google Scholar] [CrossRef]
  57. Greene, D.L. Advances in Automobile Technology and The Market for Fuel Efficiency, 1978–1985. Transp. Res. Rec. 1987, 1155, 18–27. [Google Scholar]
  58. Färe, R.; Grosskopf, S. Network DEA. Socioecon. Plann. Sci. 2000, 34, 35–49. [Google Scholar] [CrossRef]
  59. De Borger, B.; Kerstens, K.; Costa, Á. Public Transit Performance: What Does One Learn from Frontier Studies? Transp. Rev. 2002, 22, 1–38. [Google Scholar] [CrossRef]
  60. Michali, M.; Emrouznejad, A.; Dehnokhalaji, A.; Clegg, B. Noise-Pollution Efficiency Analysis of European Railways: A Network DEA Model. Transp. Res. Part D Transp. Environ. 2021, 98, 102980. [Google Scholar] [CrossRef]
  61. Tang, L.; Cai, F.; Ouyang, Y. Applying a Nonparametric Random Forest Algorithm to Assess the Credit Risk of the Energy Industry in China. Technol. Forecast. Soc. Chang. 2019, 144, 563–572. [Google Scholar] [CrossRef]
  62. Tavassoli, M.; Saen, R.F. A New Fuzzy Network Data Envelopment Analysis Model for Measuring Efficiency and Effectiveness: Assessing the Sustainability of Railways. Appl. Intell. 2022, 52, 13634–13658. [Google Scholar] [CrossRef]
  63. Lerida-Navarro, C.; Nombela, G.; Tranchez-Martin, J.M. European Railways: Liberalization and Productive Efficiency. Transp. Policy 2019, 83, 57–67. [Google Scholar] [CrossRef]
  64. Lan, L.W.; Lin, E.T.J. Measuring Railway Performance with Adjustment of Environmental Effects, Data Noise and Slacks. Transportmetrica 2005, 1, 161–189. [Google Scholar] [CrossRef]
  65. Growitsch, C.; Wetzel, H. Testing for Economies of Scope in European Railways an Efficiency Analysis. J. Transp. Econ. Policy 2009, 43, 1–24. [Google Scholar]
  66. Cowie, J. The Technical Efficiency of Public and Private Ownership in the Rail Industry: The Case of Swiss Private Railways. J. Transp. Econ. Policy 1999, 33, 241–252. [Google Scholar]
  67. Fried, H.O.; Lovell, C.A.K.; Schmidt, S.S. The Measurement of Productive Efficiency: Techniques and Applications; Oxford University Press: Oxford, UK, 1993. [Google Scholar]
  68. Djordjević, B.; Krmac, E. Evaluation of Energy-Environment Efficiency of European Transport Sectors: Non-Radial DEA and TOPSIS Approach. Energies 2019, 12, 2907. [Google Scholar] [CrossRef] [Green Version]
  69. Blagojević, A.; Stević, Ž.; Marinković, D.; Kasalica, S.; Rajilić, S. A Novel Entropy-Fuzzy PIPRECIA-DEA Model for Safety Evaluation of Railway Traffic. Symmetry 2020, 12, 1479. [Google Scholar] [CrossRef]
  70. Sharma, M.G.; Debnath, R.M.; Oloruntoba, R.; Sharma, S.M. Benchmarking of Rail Transport Service Performance through DEA for Indian Railways. Int. J. Logist. Manag. 2016, 27, 629–649. [Google Scholar] [CrossRef]
  71. Krmac, E.; Djordjević, B. Evaluation of the Levels of Safety at Railway Level Crossings Using Data Envelopment Analysis (DEA) Method: A Case Study on Slovenian Railways. Eur. Transp. Trasp. Eur. 2018, 67, 1. [Google Scholar]
  72. Cullinane, K.; Song, D.-W.; Ji, P.; Wang, T.-F. An Application of DEA Windows Analysis to Container Port Production Efficiency. Rev. Netw. Econ. 2004, 3, 2. [Google Scholar] [CrossRef] [Green Version]
  73. Sheth, C.; Triantis, K.; Teodorović, D. Performance Evaluation of Bus Routes: A Provider and Passenger Perspective. Transp. Res. Part E Logist. Transp. Rev. 2007, 43, 453–478. [Google Scholar] [CrossRef]
  74. Yu, M.-M. Assessing the Technical Efficiency, Service Effectiveness, and Technical Effectiveness of the World’s Railways through NDEA Analysis. Transp. Res. Part A Policy Pract. 2008, 42, 1283–1294. [Google Scholar] [CrossRef]
  75. Ramanathan, R. A Holistic Approach to Compare Energy Efficiencies of Different Transport Modes. Energy Policy 2000, 28, 743–747. [Google Scholar] [CrossRef]
  76. Ramanathan, R. Estimating Energy Consumption of Transport Modes in India Using DEA and Application to Energy and Environmental Policy. J. Oper. Res. Soc. 2005, 56, 732–737. [Google Scholar] [CrossRef]
  77. Zarrin, M.; Brunner, J.O. Analyzing the Accuracy of Variable Returns to Scale Data Envelopment Analysis Models. Eur. J. Oper. Res. 2023, 308, 1286–1301. [Google Scholar] [CrossRef]
  78. Banker, R.D.; Charnes, A.; Cooper, W.W. Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis. Manag. Sci. 1984, 30, 1078–1092. [Google Scholar] [CrossRef] [Green Version]
  79. Graham, D.J. Productivity and Efficiency in Urban Railways: Parametric and Non-Parametric Estimates. Transp. Res. Part E Logist. Transp. Rev. 2008, 44, 84–99. [Google Scholar] [CrossRef]
  80. Chang, Y.-T.; Zhang, N.; Danao, D.; Zhang, N. Environmental Efficiency Analysis of Transportation System in China: A Non-Radial DEA Approach. Energy Policy 2013, 58, 277–283. [Google Scholar] [CrossRef]
  81. Cantos, P.; Maudos, J. Regulation and Efficiency: The Case of European Railways. Transp. Res. Part A Policy Pract. 2001, 35, 459–472. [Google Scholar] [CrossRef]
  82. Jain, P.; Cullinane, S.; Cullinane, K. The Impact of Governance Development Models on Urban Rail Efficiency. Transp. Res. Part A Policy Pract. 2008, 42, 1238–1250. [Google Scholar] [CrossRef]
  83. Merkert, R.; Smith, A.S.J.; Nash, C.A. Benchmarking of Train Operating Firms—A Transaction Cost Efficiency Analysis. Transp. Plan. Technol. 2010, 33, 35–53. [Google Scholar] [CrossRef]
  84. Djordjević, B.; Krmac, E.; Mlinarić, T.J. Non-Radial DEA Model: A New Approach to Evaluation of Safety at Railway Level Crossings. Saf. Sci. 2018, 103, 234–246. [Google Scholar] [CrossRef]
  85. Azadeh, A.; Salehi, V.; Kianpour, M. Performance Evaluation of Rail Transportation Systems by Considering Resilience Engineering Factors: Tehran Railway Electrification System. Transp. Lett. 2018, 10, 12–25. [Google Scholar] [CrossRef]
  86. Catalano, G.; Daraio, C.; Diana, M.; Gregori, M.; Matteucci, G. Efficiency, Effectiveness, and Impacts Assessment in the Rail Transport Sector: A State-of-the-Art Critical Analysis of Current Research. Int. Trans. Oper. Res. 2019, 26, 5–40. [Google Scholar] [CrossRef] [Green Version]
  87. Tadić, S.; Krstić, M.; Brnjac, N. Selection of Efficient Types of Inland Intermodal Terminals. J. Transp. Geogr. 2019, 78, 170–180. [Google Scholar] [CrossRef]
  88. Tang, T.; You, J.; Sun, H.; Zhang, H. Transportation Efficiency Evaluation Considering the Environmental Impact for China’s Freight Sector: A Parallel Data Envelopment Analysis. Sustainability 2019, 11, 5108. [Google Scholar] [CrossRef] [Green Version]
  89. Roets, B.; Verschelde, M.; Christiaens, J. Multi-Output Efficiency and Operational Safety: An Analysis of Railway Traffic Control Centre Performance. Eur. J. Oper. Res. 2018, 271, 224–237. [Google Scholar] [CrossRef]
  90. Brida, J.G.; Deidda, M.; Pulina, M. Tourism and Transport Systems in Mountain Environments: Analysis of the Economic Efficiency of Cableways in South Tyrol. Journal of Transport Geography 2014, 36, 1–11. [Google Scholar] [CrossRef]
  91. Yao, D.; Xu, L.; Li, J. Evaluating the Performance of Public Transit Systems: A Case Study of Eleven Cities in China. Sustainability 2019, 11, 3555. [Google Scholar] [CrossRef] [Green Version]
  92. Markovits-Somogyi, R. Measuring Efficiency in Transport: The State of the Art of Applying Data Envelopment Analysis. Transport 2011, 26, 11–19. [Google Scholar] [CrossRef] [Green Version]
  93. Tavassoli, M.; Faramarzi, G.R.; Saen, R.F. A Joint Measurement of Efficiency and Effectiveness Using Network Data Envelopment Analysis Approach in the Presence of Shared Input. OPSEARCH 2015, 52, 490–504. [Google Scholar] [CrossRef]
  94. Mallikarjun, S.; Lewis, H.F.; Sexton, T.R. Operational Performance of U.S. Public Rail Transit and Implications for Public Policy. Socio-Econ. Plan. Sci. 2014, 48, 74–88. [Google Scholar] [CrossRef]
  95. Kutlar, A.; Kabasakal, A.; Sarikaya, M. Determination of the Efficiency of the World Railway Companies by Method of DEA and Comparison of Their Efficiency by Tobit Analysis. Qual. Quant. 2013, 47, 3575–3602. [Google Scholar] [CrossRef]
  96. Bai, X.; Jin, Z.; Chiu, Y.-H. Performance Evaluation of China’s Railway Passenger Transportation Sector. Res. Transp. Econ. 2021, 90, 100859. [Google Scholar] [CrossRef]
  97. Wanke, P.; Barros, C.P. Slacks Determinants in Brazilian Railways: A Distance Friction Minimization Approach with Fixed Factors. Appl. Econ. 2015, 47, 5103–5120. [Google Scholar] [CrossRef]
  98. Wanke, P.; Kalam Azad, M.d.A. Efficiency in Asian Railways: A Comparison between Data Envelopment Analysis Approaches. Transp. Plan. Technol. 2018, 41, 573–599. [Google Scholar] [CrossRef]
  99. Wanke, P.; Chen, Z.; Liu, W.; Antunes, J.J.M.; Azad, M.d.A.K. Investigating the Drivers of Railway Performance: Evidence from Selected Asian Countries. Habitat Int. 2018, 80, 49–69. [Google Scholar] [CrossRef]
  100. Cullinane, K.; Bergqvist, R.; Cullinane, S.; Zhu, S.; Wang, L. Improving the Quality of Sweden’s Rail Freight Rolling Stock. Benchmarking Int. J. 2017, 24, 1552–1570. [Google Scholar] [CrossRef]
  101. Bhatia, V.; Sharma, S. Expense Based Performance Analysis and Resource Rationalization: Case of Indian Railways. Socio-Econ. Plan. Sci. 2021, 76, 100975. [Google Scholar] [CrossRef]
  102. Marchetti, D.; Wanke, P. Brazil’s Rail Freight Transport: Efficiency Analysis Using Two-Stage DEA and Cluster-Driven Public Policies. Socio-Econ. Plan. Sci. 2017, 59, 26–42. [Google Scholar] [CrossRef]
  103. Marchetti, D.; Wanke, P.F. Efficiency in Rail Transport: Evaluation of the Main Drivers through Meta-Analysis with Resampling. Transp. Res. Part A Policy Pract. 2019, 120, 83–100. [Google Scholar] [CrossRef]
  104. Holvad, T. Efficiency Analyses for the Railway Sector: An Overview of Key Issues. Res. Transp. Econ. 2020, 82, 100877. [Google Scholar] [CrossRef]
Figure 1. PRISMA’s Flow Chart. * Books and conference papers were removed.
Figure 1. PRISMA’s Flow Chart. * Books and conference papers were removed.
Sustainability 15 10300 g001
Figure 2. Bibliographic coupling and bibliographic co-citation.
Figure 2. Bibliographic coupling and bibliographic co-citation.
Sustainability 15 10300 g002
Figure 3. DEA publications time-series.
Figure 3. DEA publications time-series.
Sustainability 15 10300 g003
Figure 4. Productivity by author.
Figure 4. Productivity by author.
Sustainability 15 10300 g004
Figure 5. Productivity by country.
Figure 5. Productivity by country.
Sustainability 15 10300 g005
Figure 6. SFA publications time-series.
Figure 6. SFA publications time-series.
Sustainability 15 10300 g006
Figure 7. Productivity by Author.
Figure 7. Productivity by Author.
Sustainability 15 10300 g007
Figure 8. Productivity by Country.
Figure 8. Productivity by Country.
Sustainability 15 10300 g008
Figure 9. Proposed separation for TS publications.
Figure 9. Proposed separation for TS publications.
Sustainability 15 10300 g009
Figure 10. Most recurrent DEA models in rail research.
Figure 10. Most recurrent DEA models in rail research.
Sustainability 15 10300 g010
Figure 11. Most recurrent second-stage models in rail research.
Figure 11. Most recurrent second-stage models in rail research.
Sustainability 15 10300 g011
Figure 12. 20 Most Recurrent Input and Output Variables in Rail Research.
Figure 12. 20 Most Recurrent Input and Output Variables in Rail Research.
Sustainability 15 10300 g012
Figure 13. DEA rail-related publications time series and most recurrent models in each period.
Figure 13. DEA rail-related publications time series and most recurrent models in each period.
Sustainability 15 10300 g013
Figure 14. Author Co-Citation Network.
Figure 14. Author Co-Citation Network.
Sustainability 15 10300 g014
Table 1. WoS Retrieved Variables.
Table 1. WoS Retrieved Variables.
VariableDescription
AUAuthors
TIDocument title
SOPublication name (or source)
JIIso source abbreviation
DTDocument type
DEAuthors’ keywords
IDKeywords associated by scopus or isi database
ABAbstract
C1Author address
RPReprint address
CRCited references
TCTimes cited
PYYear
SCSubject category
UTUnique article identifier
DBBibliographic database
Table 2. Journals with the most DEA-TS publications.
Table 2. Journals with the most DEA-TS publications.
SourcesArticlesImpact Factor 2021H-Index 2021
Journal Of Air Transport Management765.9782
Sustainability454.17109
Transport Policy426.36103
Transportation Research Part A-Policy And Practice425.59142
Maritime Economics & Logistics313.1255
Transportation Research Part E-Logistics And Transportation Review2910.75122
Transportation Research Part D-Transport And Environment267.04113
European Journal Of Operational Research216.39274
Journal Of Cleaner Production1910.96232
Maritime Policy & Management163.4161
Accident Analysis And Prevention156.49164
International Journal Of Transport Economics150.1824
Journal Of Transport Economics And Policy140.6557
International Journal Of Shipping And Transport Logistics131.3125
Journal Of Advanced Transportation132.4751
Table 3. Most cited DEA publications.
Table 3. Most cited DEA publications.
DocumentTitleTCTCperYear
[38]A Survey of Dea Applications42442.40
[39]The Technical Efficiency of Container Ports: Comparing Data Envelopment Analysis and Stochastic Frontier Analysis34820.47
[40]Measuring Eco-Efficiency of Production with Data Envelopment Analysis33518.61
[41]A Comparison Of Parametric and Non-Parametric Distance Functions: With Application to European Railways30712.79
[42]Fuzzy Multicriteria Decision-Making: A Literature Review27334.12
[43]Developing Measures of Airport Productivity and Performance: An Application Of Data Envelopment Analysis26210.08
[44]Efficiency Measurement of Selected Australian and Other International Ports Using Data Envelopment Analysis25111.41
[45]Efficiency and Effectiveness in Railway Performance Using a Multi-Activity Network Dea Model20013.33
[46]An Analysis of the Operational Efficiency of Major Airports in the United States1988.61
[47]Evaluation of Deregulated Airline Networks Using Data Envelopment Analysis Combined With Principal Component Analysis with An Application to Western Europe1808.18
Table 4. Journals with the most SFA-TS publications.
Table 4. Journals with the most SFA-TS publications.
SourcesArticlesImpact Factor 2021H-Index 2021
Transportation Research Part A-Policy And Practice225.59142
Transport Policy136.36103
Transportation Research Part E-Logistics And Transportation Review1210.75122
Journal Of Productivity Analysis112.5784
Maritime Economics & Logistics113.1255
Maritime Policy & Management113.4161
European Journal Of Operational Research76.39274
Journal Of Air Transport Management75.9782
Utilities Policy73.3554
International Journal Of Shipping And Transport Logistics61.3125
International Journal Of Transport Economics60.1824
Research In Transportation Economics62.7552
Applied Economics52.0191
Journal Of Cleaner Production510.96232
Energy Policy47.37234
Table 5. Most Cited SFA Publications.
Table 5. Most Cited SFA Publications.
DocumentTitleTCTCperYear
[39]The Technical Efficiency Of Container Ports: Comparing Data Envelopment Analysis And Stochastic Frontier Analysis34820.47
[50]Port Privatization, Efficiency And Competitiveness: Some Empirical Evidence From Container Ports (Terminals)34219.00
[51]A Stochastic Frontier Model Of The Efficiency Of Major Container Terminals In Asia: Assessing The Influence Of Administrative And Ownership Structures1888.95
[52]Inefficiencies And Scale Economies Of European Airport Operations1688.40
[53]Ownership Forms Matter For Airport Efficiency: A Stochastic Frontier Investigation Of Worldwide Airports16410.93
[49]Accounting For Environmental Influences In Stochastic Frontier Models: With Application To International Airlines1616.71
[12]Trajectories Of Efficiency Measurement: A Bibliometric Analysis Of Dea And Sfa14518.12
[54]A Bayesian Approach To Imposing Curvature On Distance Functions1317.28
[55]A Stochastic Frontier Model Of The Productive Efficiency Of Korean Container Terminals1246.20
[56]Persistent And Transient Productive Inefficiency: A Maximum Simulated Likelihood Approach10515.00
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Victorino, T.; Peña, C.R. The Development of Efficiency Analysis in Transportation Systems: A Bibliometric and Systematic Review. Sustainability 2023, 15, 10300. https://doi.org/10.3390/su151310300

AMA Style

Victorino T, Peña CR. The Development of Efficiency Analysis in Transportation Systems: A Bibliometric and Systematic Review. Sustainability. 2023; 15(13):10300. https://doi.org/10.3390/su151310300

Chicago/Turabian Style

Victorino, Thiago, and Carlos Rosano Peña. 2023. "The Development of Efficiency Analysis in Transportation Systems: A Bibliometric and Systematic Review" Sustainability 15, no. 13: 10300. https://doi.org/10.3390/su151310300

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop