Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Analyzing drivers’ perceived service quality of variable message signs (VMS)

  • Zhuanglin Ma,

    Roles Conceptualization, Funding acquisition, Investigation, Writing – review & editing

    Affiliation College of Transportation Engineering, Chang’an University, Xi’an, China

  • Mingjie Luo ,

    Roles Conceptualization, Data curation, Methodology, Writing – original draft

    15653562523@163.com

    Affiliation College of Transportation Engineering, Chang’an University, Xi’an, China

  • Steven I-Jy Chien,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliations College of Transportation Engineering, Chang’an University, Xi’an, China, John A. Reif, Jr. Department of Civil and Environmental Engineering, New Jersey Institute of Technology, Newark, NJ, United States of America

  • Dawei Hu,

    Roles Funding acquisition, Investigation

    Affiliation College of Transportation Engineering, Chang’an University, Xi’an, China

  • Xue Zhao

    Roles Conceptualization, Investigation

    Affiliation School of Science, Xi’an Shiyou University, Xi’an, China

Abstract

Recent advance in VMS technology has made it viable to ease traffic congestion and improve road traffic efficiency. However, the drivers’ low compliance with the posted information may limit its performance to ease traffic congestion and improve traffic safety. This paper explores drivers’ attitude to the service quality of VMS system resulted from the identified predominant influencing factors. A questionnaire is developed and used for surveying 9,600 drivers in Beijing, China. The collected data are analyzed with a multiple indicators and multiple causes (MIMIC) model considering different driver categories (e.g., private car driver, office car driver, taxi driver). The results show that the causal relationships between latent variables and socio-demographic characteristic is significant. Driving frequency, attitude towards contents of VMS, drivers’ decision-making and the effectiveness of VMS message can directly and indirectly affect driver’s perceived quality of service. The attitude towards formats of VMS indirectly affect their QoS resulting from the effectiveness of VMS message, while there is no indirect impact for taxi drivers. Besides, the drivers’ decision-making directly affects the perceived quality of service for private car drivers and office car drivers, but there is no impact for taxi drivers. The findings of this study can provide guidance and reference for urban authorities to perform the relevant actions required to meet user expectations.

Introduction

Variable message sign (VMS), also known as changeable message sign (CMS) or dynamic message sign (DMS), has been applied to disseminate guidance information (e.g., traffic information, road condition, parking and public transport information, etc.) to road users. The VMS information plays a significant role to guide vehicles away from a congested route caused by recurring and non-recurring events. Unlike highway advisory radios (HAR) and smartphones, VMS can be used without any equipment on the driver’s side, hence it is an effective traffic management measure for alleviating traffic congestion caused by roadworks, special events, incidents, effectively distributing traffic flow and reducing traffic safety risks [14].

While VMS have been widely used for disseminating road information, the problems of instantaneous information, unreasonable layout and drivers’ poor compliance to the VMS information still exist, which leads to a decrease in traffic induction efficiency and the extent of their capabilities for improving network performance under incident/congested situations has not been exploited sufficiently [5]. Therefore, this paper aims to study how to improve the driver’s obedience to the VMS information.

Because VMS panels are often costly to design, install and maintain, drivers’ perception becomes an important indicator of potential demand and is often cited by agencies as a means to justify the implementation of a new system or improve existing ones [6]. Whether drivers can comply with the VMS information, and whether the VMS effectively distributing traffic flow depend largely on the drivers’ perception and attitude of the VMS information. Therefore, it is essential to understand drivers’ perception of VMS system and identify the predominant factors influencing drivers’ perceived quality of service.

Most previous studies were focusing on the layout and setting of VMS, while there was a dearth of research on evaluating the service quality of VMS system from the perspective of driver perception. The purpose of this study is to explore drivers’ attitude to service quality of VMS system and identify the predominant influencing factors, thereby allowing agencies to undertake appropriate measures to further improve drivers’ compliance with information provided by VMS.

One contribution is that this paper is the first study to develop a holistic model which can be applicable to three types of drivers, and use a multiple indicators and multiple causes (MIMIC) model to investigate the factors influencing drivers’ attitude to service quality of VMS system according to different driver categories in order to explore the differences between different drivers. Additionally, from a practical point of view, this study will provide guidance and reference for other urban authorities to perform the relevant actions required to meet user expectations.

Literature review

Development status of VMS

At present, with the rapid development of modern communication technology and Internet technology, VMS has been widely used in China. VMS is one of the main means to ease traffic congestion, ensure vehicle safety and improve road traffic efficiency. Its main function is to display various traffic-related guidance information in time according to the collected real-time traffic information and the command and dispatch instructions of traffic management departments, which induces drivers to make correct route decisions and makes the traffic network evenly distributed, thus improving road traffic efficiency and reducing the travel time of travelers [7].

However, there are still some gaps in layout, operation and management compared with developed countries. Problems such as unreasonable layout of VMS, poor accuracy of VMS information, inconsistent display of information and low driver compliance still exist [8]. In addition, with the installation of VMS in more cities, the research on VMS has gradually become a craze. The research and application of VMS mainly focus on route decision, information display and layout setting. However, it is rare to study the application and optimization of VMS system and the service effect of VMS. Therefore, the research and construction of VMS still have huge development potential and wide space.

Factors affecting driver’s perceived quality of service

A high-quality traffic information system, from the road users’ perspective, should provide accurate, reliable and easy-to-understand traffic information, which enables drivers to make correct decisions on departure time as well as route choice [6]. In addition, the displayed contents and formats must meet the driver’s expectations. One might therefore refer to the constructs “attitude towards formats of VMS”, “attitude towards contents of VMS”, “driver decision-making” and “effectiveness of VMS message”, as determinants as they directly or indirectly explain driver’s perceived quality of service [6, 9, 10].

Some studies have used the drivers’ decision to change route upon receiving a set of traffic information provided by the VMS as the sole surrogate for perceived system quality to evaluate the effect of the VMS [3, 11, 12]. However, this measure does not consider the many externalities that can also affect driver’s perceived quality of service, including the perceived accuracy and reliability of traffic information, and drivers’ attitudes towards the attributes of VMS. By studying the drivers’ attitudes towards the attributes of VMS, the perceived quality of service system can then be estimated. Accordingly, Zhang and Li (2018) in the aspect of public transport released by VMS are the main factors affecting the driver’s route decision [13]. Li (2010) found that the driver’s route decision would be significantly affected by the contents and formats of VMS [10]. In addition, some studies have provided evidence that the effectiveness of VMS message can significantly affects driver’s perceived quality of service. For example, Xu et al. (2010) suggested that effectiveness of VMS message could significantly affect drivers’ acceptance of the traffic information [14]. Khoo and Ong (2013) also concluded that a better perception of ATIS system effectiveness, accuracy and reliability can well indicate a high perceived quality of service [6].

However, some studies indicate that the socio-economic attributes and travel characteristics are also considered as important factors for evaluating service quality of VMS. Peeta and Ramos (2006) found that the driver’s reaction and behavior under the traffic information provided by VMS were influenced by the driver’s socio-economic attributes and travel characteristics [5]. Zhong et al (2012) suggested that the driver’s route choice behavior is related to age, driving age, income and road network familiarity [15]. Cao et al (2014) indicated that driver’s route change frequency was affected by gender, educational background, vehicle type and travel activity [16].

Analysis methods for measuring drivers’ perceived quality of devices

Previous scholars mainly used questionnaire survey to evaluate the service quality of VMS. One is to investigate the traffic operation effect, for example, how installation of VMS along the road affects the average driving speed or average delay? The evaluation does not consider the transportation users, such as how users perceive the service quality of these devices or the satisfaction of users with the services they receive [2, 17]. The second is a sample survey of drivers, which investigates users’ satisfaction with the traffic services provided by VMS based on a sample survey of drivers by asking users’ opinions on the traffic service information they use [18, 19]. However, Lee et al (2004) pointed out that it is difficult to describe the survey results quantitatively and objectively and to analyze the key factors affecting users’ perception of ATIS service quality only by using surveys. Accordingly, Lee et al. (2005) proposed a method based on fuzzy aggregation to evaluate VMS service quality [20]; Shao et al (2010) evaluates VMS information service based on the multinomial Logit model. However, little of these methods have been used to develop a structure model to exploring the latent relationship between variables [21].

To make up for this deficiency, the structural equation modelling (SEM) has been used to evaluate perceived service quality in the aspect of public transport [22, 23], rail transit [24], water transit [25], as well as traffic information system [26]. However, SEM is difficult to deal with individual characteristics because they affect perceived quality as casual variables rather than indicator variables. A multiple indicators and multiple causes (MIMIC) model can cope with casual variables (i.e. gender, age, et al.) and indicator variables (i.e. service quality) concurrently and capture the heterogeneous individual characteristics in different groups of individual characteristics [27]. Hence, MIMIC has been widely utilized to measure service quality and satisfaction [28]. To explore the relationship between variables, and the relationship between socio-demographic variables and potential variables, a MIMIC is therefore developed in this paper to study the factors affecting driver’s perceived quality.

Methodology

This section first describes the stated preference (SP) questionnaire in detail, and introduces the specific process of sample investigation, then sets out the basic principle of MIMIC model, and finally puts forward the corresponding research hypothesis according to the research content.

Ethics statement

Ethics statement was approved by the Beijing Traffic Management Bureau, Beijing, China. The study was also approved by the College of Transportation Engineering of Chang’an Univeristy. All respondents provided written informed consent.

Questionnaire describing

A stated preference (SP) questionnaire survey is designed to identify factors influencing drivers’ perceived quality of VMS, which consists of 17 questions classified into four sections (S1 File). Section I is related to socio-demographic characteristics (i.e., gender, age, driving experience and driver type), in which drivers are classified by three modes: private car, office car and taxi. Particularly, the term “office car” generally refers to vehicles owned or contracted by government agencies, institutions, and state-owned enterprises for their staff to perform official duties. The variable definitions under this section are listed in Table 1.

thumbnail
Table 1. Definitions of socio-demographic characteristics.

https://doi.org/10.1371/journal.pone.0239394.t001

Section II addresses questions on travel-related characteristics. For this section, respondents are asked to rate the weekly frequency of driving from one place to another into five levels, including “never”, “rarely”, “occasionally”, “very often” and “always”.

Section III is related to attitude towards the formats of VMS. The drivers are asked to express their attitude towards the format of information, including text-only, graph-only, and text-graph. In addition, attitude towards the contents of VMS, including length of congested road, travel time, reduced travel time and increased travel distance of detour routes, are considered. The attitude is ranked on a five-point scale, where 1 means strongly dissatisfied and 5 means strongly satisfied.

In Section IV, decision-making is regarded by whether VMS has ever changes drivers departure time and/or route choice, which is classified into three levels: “never”, “possible change”, and “change”. In addition, the perception of VMS information and service quality are ranked on a five point scale (strongly disagree = 1; disagree = 2; neutral = 3; agree = 4; strongly agree = 5) towards three aspects “intelligibility”, “accuracy” and “usefulness”. The variable definitions related to questions in Sections II, III and IV are listed in Table 2.

thumbnail
Table 2. Definitions of travel-related characteristics and attitude towards VMS.

https://doi.org/10.1371/journal.pone.0239394.t002

Survey implementation

The on-site survey was performed because of the high questionnaire return rate. The on-site survey is a fact-of-fact interview, so the probability of completing the survey is high. Meanwhile, surveyors randomly selected not only the local drivers but also out-of-town drivers who was traveling through the surveyed districts, which could avoid the shortage of the low representative of the sample. In order to obtain more reliable drivers perception data, an on-site survey was therefore conducted to private car drivers, office car drivers and taxi drivers in this study.

The questionnaires were distributed to a total of 9,600 drivers at public parking lots covering 6 districts in Beijing (e.g., Dongcheng district, Xicheng district, Haidian district, Chaoyang district, Fengtai district and Shijingshan district) (See Fig 1). There were 9,242 returned questionnaires (96.27% return rate), in which 8477 of them were valid (e.g., 5,137 from private car drivers, 1,906 from office car drivers and 1,437 from taxi drivers).

Multiple indicators multiple causes (MIMIC) model

The MIMIC model was first proposed by Goldberger (1972) [29, 30], and then Gertler (1988) extended the model well and obtained ideal empirical results [31]. Actually, it is a measurement model with observed covariates, which can be used to study not only the relationships between latent variables and observed covariates, but also measurement invariance and population heterogeneity [32]. The MIMIC model has no strict constraints and allows measurement errors between exogenous variables and endogenous index variables, so it is more flexible than other indirect measurement methods [33]. The model generally consists of a measurement model and a structure model. The measurement model describes the relations between latent variables and indicator variables, while the structure model indicates the relations between latent variables and causal variables. The MIMIC model was formulated by Rose & Spiegel (2011) [34]: (1) (2) where yi,j is an observation of indicator j of construct i that represents the measurement of the construct; βj is an estimated coefficient associated with indicator j; ξi is a latent variable of construct i; υi is the error term of the ith latent variable and casual variables; γk is an estimated coefficient of covariate k; xi,k is an observation associated with covariate k that affecting construct i, representing the cause of construct i; ζi is the error term the ith latent variable and covariates.

In Eq (1), we specify ξi (i = 6) to include driving frequency, attitude towards formats of VMS, attitude towards contents of VMS, drivers’ decision-making, effectiveness of VMS message, and perceived quality of service. In Eq (2), we define xi,k (k = 3) to include age, gender, and driving experience.

Research hypotheses

The perceived quality of service can be treated as a latent variable since it cannot be directly observed but can be inferred by a set of variables which can be either determined or measured, including driving frequency, attitude towards formats of VMS, attitude towards contents of VMS, driver decision-making, and effectiveness of VMS message. In general, drivers with high travel frequency believe that VMS is effective and then tend to have positive perception of VMS. If the drivers are satisfied with the formats and contents of VMS, they are likely to recognize the effectiveness of VMS and therefore are positive about the quality of VMS. The high utilization level (i.e. drivers are more inclined to change routes or times after receiving relevant traffic information) also means that drivers are convinced of the information provided by the VMS system and are more willing to adjust their itinerary. If drivers believe that VMS is more effective, they likely believe that the VMS service can yield their needs. Therefore, the following hypotheses are put forward (See purple lines with an arrow in Fig 2):

  1. H11: Driving frequency directly affects perceived quality of service.
  2. H12: Attitude towards formats of VMS directly affects perceived quality of service.
  3. H13: Attitude towards contents of VMS directly affects perceived quality of service.
  4. H14: Drivers’ decision-making directly affects perceived quality of service.
  5. H15: Effectiveness of VMS message directly affects perceived quality of service.

Besides, these latent variables are somehow affecting each other and thus might indirectly affect the perceived quality of service. It is of importance to investigate these relations using the proposed MIMIC model. The effectiveness of VMS message is assumed to be an intermediary variable, which would directly affect perceived quality of service, but also allow other factors to indirectly affect perceived quality of service through it. Therefore, the following hypotheses are also tested (See orange lines with arrow in Fig 2):

  1. H21: Driving frequency indirectly affects perceived quality of service via effectiveness of VMS message.
  2. H22: Attitude towards formats of VMS indirectly affects perceived quality of service via effectiveness of VMS message.
  3. H23: Attitude towards contents of VMS indirectly affects perceived quality of service via effectiveness of VMS message.
  4. H24: Drivers’ decision-making indirectly affects perceived quality of service via effectiveness of VMS message.

This paper further propose that several socio-demographic characteristics such as age, gender and driving experience are regarded as control variables significant affecting latent variables (See bold arrows in Fig 2).

To verify the stability of the hypothetical model structure across driver types, the hypothetical framework structure is used for all drivers, and by analyzing each driver type separately, it is possible to compare differences across drivers specifically. Driver types are defined according to the type of vehicle used by drivers for daily travel, which can be divided into private car drivers, office car drivers and taxi drivers.

Results

Descriptive statistics

According to the collected data, it was found that the number of male drivers is greater than female drivers. For office cars and taxis as shown in Table 3, male drivers account for 81.7% and 84.1%, respectively, which is relatively larger than that of private cars (67.7%). Most of private car drivers are under the age of 46 (90.2%), while 71.4% of office car drivers are aged 26–45 and 70.0% of taxi drivers are over 36 year old, which indicates that middle-aged and young people prefer to drive private cars, and most of office car drivers are middle-aged people, while most of taxi drivers are middle-aged and older people. The possible reason is that some government agencies require office car drivers to be between 26 and 45 years old. Taxi driver is a hard job with low income and long working hours, so young people do not want to drive a taxi. In brief, the age distribution of drivers is different due to the types of drivers. The driving experience of majority private car drivers is less than 10 years, while office car and taxi drivers seem more experienced (e.g., almost 30% of them have greater 10 years’ experience). This may be related to the professional attribute of the driver. Due to the particularity of the profession, office car and taxi drivers are usually required to be experienced drivers, while drivers of private cars do not have such requirements.

thumbnail
Table 3. Descriptive statistics of socio-demographic characteristics.

https://doi.org/10.1371/journal.pone.0239394.t003

After analyzing the collected data, we found that the percentages of drivers who are satisfied, dissatisfied, and neutral with the existing VMS are 45.4%, 16.6%, and 38.0%, respectively (See Fig 3). The overall satisfaction rate is not high. Interestingly, taxi drivers responded the highest dissatisfaction rate (24.0%), which is consistent with the findings concluded by Zhou et al [45], indicating that taxi drivers seem favorable to make travel decisions based on the VMS information (See Fig 4). Private car drivers yielded the highest VMS rate (45.9%), followed by office car drivers (44.1%) and taxi drivers (40.1%). Drivers with a neutral attitude account for 38.1%, 39.1% and 36.0% of the three types of drivers respectively, indicating that a considerable number of drivers have a low awareness of VMS and have no clear judgment of the quality of VMS system.

thumbnail
Fig 3. Proportional distribution of perceived quality of service.

https://doi.org/10.1371/journal.pone.0239394.g003

thumbnail
Fig 4. Proportional distribution of perceived quality of service by different types of drivers.

https://doi.org/10.1371/journal.pone.0239394.g004

Reliability and validity test

In order to test the reliability and validity of the supposed latent relationship between items, the confirmatory factor analysis (CFA) is employed. The reliability measures included Canbrach’s α and construct reliability (CR), while the validity measure is average variance extracted (AVE). Canbrach’s α is a coefficient applied to evaluate the internal consistency of latent factors, which increases as the correlations between items increase. CR is used to measure of reliability and internal consistency of the measured variables representing a latent construct. Additionally, AVE is calculated to test the validity of the values, which reflects the predictive interpretation ability of the observed variable to the latent variable. The values of Canbrach’s α, CR and AVE are shown in Table 4.

From Table 4, all Canbrach’s α are greater than 0.701, indicating that the reliability of these variables can be accepted [35]. All CR values are above 0.6 (range from 0.639 to 1.000), reflecting a good internal consistency [36]. The minimum AVE is larger than 0.5 (e.g. 0.711), indicating that the constructs have high validity [37]. Since all parameters exceed their respective critical values, the developed MIMIC model is reliable, and the explored relations among latent variables are statistically significant.

Parameter estimation and hypothesis testing

To explore the factors affecting driver’s perception of VMS quality, MIMIC is employed to examine the causal relationships between potential variables and socio-demographic characteristic, and the path relations among latent variables. Considering the diversity of driver groups, it is necessary to establish three models for private car drivers, office car drivers and taxi drivers respectively. The estimated results of causal analysis summarized according to different driver categories are shown in Table 5 and the estimated path relations are shown in Figs 57, respectively.

thumbnail
Fig 5. Estimated results of MIMIC for private car drivers (Model I).

Notes: Coefficients are statistically significant at the 5% level (⁎ p < 0.05, ⁎⁎ p < 0.01).

https://doi.org/10.1371/journal.pone.0239394.g005

thumbnail
Fig 6. Estimated results of MIMIC model for office car owners (Model II).

Notes: ** Coefficients are statistically significant at the 5% level (⁎ p < 0.05. ⁎⁎ p < 0.01).

https://doi.org/10.1371/journal.pone.0239394.g006

thumbnail
Fig 7. Estimated results of MIMIC model for taxi drivers (Model III).

Notes: ** Coefficients are statistically significant at the 5% level (⁎ p < 0.05, ⁎⁎ p < 0.01).

https://doi.org/10.1371/journal.pone.0239394.g007

thumbnail
Table 5. The estimation results between socio-demographic characteristics and latent variables.

https://doi.org/10.1371/journal.pone.0239394.t005

As illustrated Fig 5, four variables, including travel frequency (coefficient = 0.156, p < 0.01), attitude towards contents of VMS (coefficient = 0.184, p < 0.01), decision-making (coefficient = 0.16 0, p < 0.01) and perceived effectiveness (coefficient = 0.397, p < 0.01), directly affect perceived quality of service, while attitude towards formats of VMS (coefficient = 0.072, p = 0.087) does no. Therefore, the hypotheses H11, H13, H14 and H15 are accepted, but H12 is rejected. Besides, driving frequency (coefficient = 0.110, p < 0.05), attitude towards formats of VMS (coefficient = 0.102, p < 0.05), attitude towards contents of VMS (coefficient = 0.148, p < 0.01) and drivers’ decision-making (coefficient = 0.143, p < 0.01) indirectly affect drivers’ perceived quality of service via effectiveness of VMS message. Hence, H21, H22, H23 and H24 are accepted. In conclusion, there are three of the five variables, namely driving frequency, attitude towards contents of VMS and drivers’ decision-making, having both direct and indirect effects on perceived quality of service, while attitude towards formats of VMS only indirectly influence perceived quality of service. Effectiveness of VMS message not only directly influence perceived quality of service, but also allow other four variables to indirectly affect perceived quality of service via it.

From Fig 6, there are four variables, namely driving frequency (coefficient = 0.137, p < 0.01), attitude towards contents of VMS (coefficient = 0.156, p < 0.05), drivers’ decision-making (coefficient = 0.126, p < 0.05) and effectiveness of VMS message (coefficient = 0.417, p < 0.01), directly affecting perceived quality of service, while attitude towards formats of VMS (coefficient = 0.076, p = 0.073) does no. Therefore, the hypotheses H11 H13, H14, and H15 are accepted, but H12 is rejected. In addition, driving frequency (coefficient = 0.111, p < 0.01), attitude towards formats of VMS (coefficient = 0.109, p < 0.05), attitude towards contents of VMS (coefficient = 0.222, p < 0.01) and driver decision-making (coefficient = 0.135, p < 0.01) indirectly influence perceived quality of service via effectiveness of VMS message, hence H21, H22, H23 and H24 are accepted. To sum up, there are three of the five variables, namely driving frequency, attitude towards contents of VMS and drivers’ decision-making, having both direct and indirect effects on perceived quality of service, while attitude towards formats of VMS only indirectly influence perceived quality of service. Effectiveness of VMS message not only directly influence perceived quality of service, but also allow other four variables to indirectly affect perceived quality of service via it.

From Fig 7, driving frequency (coefficient = 0.183, p < 0.01), attitude towards contents of VMS (coefficient = 0.260, p < 0.01) and effectiveness of VMS message (coefficient = 0.433, p < 0.01) can influence perceived quality of service, while attitude towards formats of VMS (coefficient = 0.029, p = 0.658) and drivers’ decision-making (coefficient = 0.029, p = 0.496) do not. Therefore, the hypotheses H11, H13, H15 are accepted, but H12 and H14 are rejected. In addition, driving frequency (coefficient = 0.172, p < 0.05), attitude towards contents of VMS (coefficient = 0.278, p < 0.01) and drivers’ decision-making (coefficient = 0.170, p < 0.05) indirectly affected driver’s perceived quality of service via effectiveness of VMS message, thus H21 H23 and H24 are accepted. However, H22 is rejected because attitude towards formats of VMS (coefficient = 0.044, p = 0.166) has no indirect effect on driver’s perceived quality of service via effectiveness of VMS message. To sum up, there are two of the five variables, namely driving frequency and attitude towards contents of VMS, having both direct and indirect effects on perceived quality of service, while attitude towards formats of VMS has no effect on perceived quality of service, drivers’ decision-making only indirectly influence perceived quality of service. Effectiveness of VMS message not only directly influence perceived quality of service, but also allow other four variables to indirectly affect perceived quality of service via it.

The hypothesis test results of the three models are shown in Table 6.

In summary, there are some differences and commonalities in estimated results of model among three type of drivers. What they have in common is that driving frequency, attitude towards contents of VMS and effectiveness of VMS message can directly affect driver’s perceived quality of service and attitude towards formats of VMS has no direct effect on perceived quality of service for the three type of drivers. In addition, driving frequency, attitude towards contents of VMS and drivers’ decision-making can also indirectly influence perceived quality of service through effectiveness of VMS message. The difference is that the drivers’ decision-making can directly affect the perceived quality of service for private car drivers and office car drivers, but there is no impact for taxi drivers. Also, attitude towards formats of VMS can indirectly impact on perceived quality of service through effectiveness of VMS message for private car drivers and office car drivers, while there is no indirect impact for taxi drivers.

Five goodness-of-fit indicators, including the ratio of chi-square to the degree of freedom (χ2/df), comparative fit index (CFI), tucker-lewis index (TLI), root mean square error of approximation (RMSEA) and root mean residual (RMR), are selected to test the three developed models. The goodness-of-fit test results of all models are presented in Table 7.

From Table 7, χ2/df of three models is 2.506, 2.287 and 2.811, respectively, which are less than the standard threshold of 3, indicating that indicator is acceptable [3841]. CFI and TLI all exceed the acceptable threshold of 0.9 [38]. Other fitting indicators, such as RMR and RMSEA, are also found to be acceptable by model fit criteria [42]. On the whole, all goodness-of-fit indices of the three models meet the suggested criteria, indicating that all models obtained are statistically appropriate, and the hypothetical framework model is therefore suitable for analyzing driver’s perceived quality of service.

Discussion

Analysis of the relationship between socio-demographic characteristics and potential variables

As seen from Table 5, gender and driving experience have a significant effect on driving frequency of private car drivers (coefficient = -0.171, p < 0.05; coefficient = 0.387, p < 0.01), suggesting well experienced male private owner travel more frequently. the gender of private car drivers positively affects their attitude towards formats and contents of VMS (coefficient = 0.143, p < 0.01; coefficient = 0.554, p < 0.01), while driving experience has a negative effect on their attitude towards formats and contents of VMS (coefficient = -0.194, p < 0.05; coefficient = -0.409, p < 0.01), which indicated that female drivers with little driving experience tend to be satisfied with the formats and contents of VMS. This may be related to the fact that inexperienced female drivers have higher demand for traffic information than men [43]. Gender negatively influence driver decision-making (coefficient = -0.385, p < 0.01), while driving experience positively affects driver decision-making (coefficient = 0.420, p < 0.01), indicating that well experienced and female private car owner is inclined to change their travel decisions. This result is supported by previous studies [3, 44]. In addition, gender positively affect private car drivers’ perceived effectiveness and quality of VMS (coefficient = 0.105, p < 0.05; coefficient = 0.165, p < 0.01), while driving experience has a negative impact on the perceived effectiveness and quality and of VMS (coefficient = -0.149, p < 0.05; coefficient = -0.264, p < 0.01). This result suggests that female and less experienced drivers can perceive the effectiveness of VMS and believe that the traffic information provided by VMS is necessary and accurate, which may because that female drivers are more conservative and risk-conscious than male drivers, so they tend to rely on and trust traffic information provided by VMS to ensure traffic safety [45].

For office car drivers, age and driving experience positively influence driving frequency (coefficient = 0.329, p < 0.01; coefficient = 0.294, p < 0.05), suggesting male office car drivers with well driving experience tend to have a high driving frequency. One possible explanation is that skilled and experienced drivers are safer drivers, worthy of the trust of the company’s bosses, and thus have more opportunities to travel. Similar to private car drivers, driving experience of office car driver negatively affect their attitude towards formats and contents of VMS (coefficient = -0.506, p < 0.01; coefficient = -0.427, p < 0.01). This may be related to the fact that inexperienced office car drivers have higher demand for traffic information than well experienced ones [45], hence they are satisfied with the formats and contents of VMS. In addition, the drivers’ decision-making of office car drivers is affected by gender and driving experience (coefficient = 0.605, p < 0.01; coefficient = 0.314, p < 0.01), a finding which confirms the conclusion reached by Zhao et al [23], who concluded that less experienced and young drivers are more likely to divert to an alternative route. Driving experience has a negative impact on the perceived effectiveness and quality of VMS (coefficient = -0.171, p < 0.05; coefficient = -0.355, p < 0.01), implying that office car drivers with less driving experience often think that the information provided by VMS is accurate, reliable and necessary for travelers.

As for taxi drivers, there is no factor affecting driving frequency and drivers’ attitude towards formats and contents of VMS, which may be related to the nature of taxi drivers’ work. According to Zhou et al (2005) conclusion, taxi drivers are generally male, with driving experience for about 10 years a higher familiarity with the road network [45]. Therefore, the statistical correlation between the factors in this paper is not significant. Gender and driver experience have an effect on drivers’ decision-making (coefficient = -0.411, p < 0.01; coefficient = 0.301, p < 0.01), which is consistent with Zhou et al (2005), who concluded that well experienced male taxi drivers are more familiar with the road network, hence they are more inclined to rely on their own experience to make travel decisions [44]. In addition, age negatively affect taxi drivers’ perceived effectiveness and quality of VMS (coefficient = -0.232, p < 0.01; coefficient = -0.319, p < 0.01), and driving experience also has a negative impact on the perceived effectiveness and quality of VMS (coefficient = -0.261, p < 0.05; coefficient = -0.442, p < 0.01).

Discussion on influencing factors of drivers’ perceived quality of service

From the structural models of the three driver categories developed in the study, it is obvious that the perceived quality of service cannot be evaluated independently of the driver’s driving frequency, attitude towards the formats and contents of VMS, drivers’ decision-making and effectiveness of VMS message. All the factors assumed in this study contribute directly or indirectly to the assessment of perceived service of quality. The relationship between determinants and perceived quality of service is discussed as follow.

One the one hand, as for private car drivers, office car drivers and taxi drivers, driving frequency, attitude towards contents of VMS and effectiveness of VMS message can directly affect perceived quality of service, and attitude towards formats of VMS has no direct effect on perceived quality of service. First, driving frequency directly affects perceived quality of service (H11), a finding which confirms the conclusion reached by Khoo and Ong (2013) [6], and one possible reason is that drivers who travel frequently need to obtain more information about their trip either pre-trip or en-route in order to enjoy smoother rides. Second, attitude towards contents of VMS also directly affects perceived quality of service (H13). This can perhaps be explained that travelers’ satisfaction with the contents of the VMS indicates that the service level of the VMS system is acceptable, and thus higher satisfaction may lead to higher perceived quality of service. Third, effectiveness of VMS message is the most important factor that affects driver’s perceived quality of service (H15), a finding which confirms the conclusion reached by Khoo and Ong (2013), who concluded that a better perception of ITIS system effectiveness, accuracy and reliability can well indicate a high perceived quality of service [6]. Attitude towards formats of VMS has no direct effect on perceived quality of service (H12) and this may because that drivers attach importance to the contents released by the VMS system and the detail of the contents, but pay less attention to the format of contents presentation.

Besides, driving frequency, attitude towards contents of VMS and drivers’ decision-making can indirectly affect driver’s perceived quality of service for the three driver types (H21, H23, H24). This result suggests that drivers who have high driving frequency and are satisfied with the contents of VMS system can better perceive the intelligibility, accuracy and usefulness of VMS system, thus resulting in higher perceived quality of service. Besides, driver who make route changes under the real-time traffic information provided by VMS generally think that the information is reliable and accurate, and then VMS system is considered to have higher service quality.

On the other hand, there are some differences between the three types of drivers. The drivers’ decision-making directly affect the perceived quality of service for private car drivers and office car drivers(H14), which is supported by Khoo and Ong (2013), who concluded that if drivers are more willing to accept and utilize the information obtained, this may indicate that the VMS system is operating at a specific service level acceptable to the user [6]. But there is no impact for taxi drivers and this may be because taxi drivers are usually familiar with the road traffic due to the particularity of their profession, and they do not trust the information provided by VMS and change their travel routes [45], thus making the survey data not statistically significant. As for private car drivers and office car drivers, attitude towards formats of VMS has an indirect impact on perceived quality of service through effectiveness of VMS message (H22), while there is no indirect impact in the model of taxi drivers. This may be because taxi drivers usually have low dependence and cognition on VMS system, which confuses the relationship between formats of VMS and the effectiveness of VMS.

Conclusions

There is a dearth of research on evaluating the service quality of VMS system from the perspective of driver perception, therefore, this paper presents the modeling of perceived quality of service using MIMIC, which is used to explore drivers’ attitude to service quality of VMS system and identify the predominant influencing factors. To compare differences across drivers specifically and verify the stability of the hypothetical model across driver categories, the perceived quality of service is analyzed for private car drivers, office car drivers and taxi drivers, respectively.

The research results show that the proposed hypothetical model allows a holistic interpretation on perceived quality of service. Through the analysis of the relationship between socio-economic characteristics and latent variables, it is found that gender, age and driving experience have significant effects on latent variables. Driving experience is the most important factor, followed by gender. Driving frequency, attitude towards contents of VMS, and effectiveness of VMS message can direct and indirectly affect driver’s perceived quality of service and attitude towards formats of VMS has no direct effect on perceived quality of service for the three driver types. The drivers’ decision-making directly affects the perceived quality of service for private car drivers and office car drivers, but there is no impact for taxi drivers. Besides, attitude towards formats of VMS indirectly impact on perceived quality of service through effectiveness of VMS message, while there is no indirect impact for taxi drivers.

Based on the results and contributions, some recommendations to improve the VMS system are put forward. First of all, it is necessary to develop smart phone applications considering personal demands that would allow users to obtain real time traffic information. Secondly, it is important to optimize the content provided by VMS, such as providing advice on the best departure time and routes to choose, providing predicted travel times and delays on VMS messages. Last but not the least, it is necessary to improve the quality of service, such as providing more reliable and accurate travel time by VMS, and improving VMS coverage to include traffic conditions on alternate routes. In summary, the research can provide some insights to future VMS planning, design and operation in Beijing and thus has potential to improve the usage efficiency and service quality of VMS based on the available resources and design effective in-vehicle advanced driver assistance systems.

The following limitations need to be noted and addressed in future research.

First, there are some areas of development to be considered in designing and implementing the questionnaire. The questionnaire included no open-ended questions, leading to the phenomenon that participants may be forced to choose an option that does not fully represent their real opinion, and little feedback as to how the VMS system might be improved in the future. Besides, there is only one driving frequency for the driver’s travel characteristic variables. Other variables, such as travel distance and travel purpose, can be considered in the future study.

Then, the ordinal data we collected using Likert-scale items cannot be subject to addition, subtraction, means, or standard deviation calculation. This further restricts comparison or other quantitative analysis which could be done with interval or ratio data.

Finally, the purpose of this study is to develop a holistic model which can be applicable to three types of drivers, and use a MIMIC model to qualitative analyze impact on driver’s perceived service quality and interaction between variables according to different driver categories in order to explore the differences between different drivers. Therefore, one of the defects of the research is that there is no specific and quantitative analysis of the changes of independent variables on driver’s perceived service quality. In the future, the hybrid method integrating the MIMIC model and a generalized ordered response model [46, 47] will be used to explore the relations between independent variables and driver’s perceived service quality, and then elasticity analysis will also be adopted to study the changes of independent variables on driver’s perceived service quality.”

Supporting information

S1 File. Questionnaire on perceived service quality of VMS.

https://doi.org/10.1371/journal.pone.0239394.s001

(DOCX)

References

  1. 1. Mammar S, Messmer A, Jensen P. Papageorgiou M. Haj-Salem H, Jensen L. Automatic control of variable message signs in Aalborg. Transport Research Part C: Emerging Technologies. 1996; 4 (3): 131–150.
  2. 2. Yim Y, Ygnace JL. Link Flow Evaluation Using Loop Detector Data: Traveler Response to Variable-Message Signs. Transportation Research Record. 1996; (1550): 58–64.
  3. 3. Ma Z, Shao C, Song Y, Chen J. Driver response to information provided by variable message signs in Beijing. Transportation Research Part F: Traffic Psychology and Behavior. 2014; 26: 199–209.
  4. 4. Nnaji C, Gambatese J, Lee HW, Zhang F. Improving construction work zone safety using technology: A systematic review of applicable technologies. Journal of Traffic and Transportation Engineering. 2020; 7(1): 61–75.
  5. 5. Peeta S, Ramos JL. Driver response to variable message signs-based traffic information. IEE Proceedings Intelligent Transport Systems. 2006; 153(1): 2–10.
  6. 6. Khoo HL, Ong GP. Evaluating perceived quality of traffic information system using structural equation modeling. KSCE Journal of Civil Engineering. 2013; 17(4): 837–849.
  7. 7. Chen F, Zhang W, Ding H. Research on VMS induction strategy based on traveler route decision behavior. System Engineering Theory and Practice. 2008; 38(05): 1263–1276.
  8. 8. Jiang X. Research on Driver Path Selection Mechanism and Information Dissemination Strategy under the Influence of VMS. Southeast University. 2017. Available from: http://cdmd.cnki.com.cn/Article/CDMD-10286-1018041085.htm
  9. 9. Gan H. Analysis of Path Selection Behavior under the Influence of VMS Induced Information. Systems Engineering. 2008; 26(3): 11–16.
  10. 10. Li P. Evaluation method of VMS induction effect based on SP questionnaire. Beijing Jiaotong University. 2010. Available from: http://cdmd.cnki.com.cn/Article/CDMD-10004-1011051084.htm
  11. 11. Lee C, Choi K, Lee S. Evaluation of drivers’ responses to ATIS: a practical VMS based analysis. KSCE Journal of Civil Engineering. 2004; 8(2): 233–237.
  12. 12. Antoniou C, Spyropoulou I. Determinants of driver response to variable message sign information in Athens. IET Intelligent Transport Systems. 2015; 9(4): 453–466.
  13. 13. Zhang W, Li M. Study on Driver’s Route Choice Behavior Induced by Different Traffic Information. Journal of Chongqing Jiaotong University (Natural Science Edition). 2018; 37(10): 86–93.
  14. 14. Xu C, Wang W, Chen J, Wang W, Yang C, Li Z. Analyzing travelers’ intention to accept travel information: Structural equation modeling. Transportation Research Record. 2010; 2156: 93–100.
  15. 15. Zhong S, Zhou L, Ma S, Jia N. Effects of different factors on drivers’ guidance compliance behaviors under road condition information shown on VMS. Transportation research part A: Policy and Practice. 2012; 46(9): 1490–1505.
  16. 16. Cao Y, Li X, Jia B, Xie D. Modeling of driver path choice behavior under induced information. Shandong Science. 2014; 27(2): 83–92.
  17. 17. Kraan M, Der Zijpp, NV, Tutert B, Vonk T, Megen DV. Evaluating Networkwide Effects of Variable Message Signs in the Netherlands. Transportation Research Record. 1999; 1689: 60–67.
  18. 18. Patten ML, Pribyl O, Goulias KG. Evaluation of The Pennsylvania Turnpike’s Advanced Traveler Information System (ATIS) Project Phase III. Pennsylvania Transportation Institute. 2003.
  19. 19. Ran B, Barrett B, Johnson E. Evaluation of Variable Message Signs in Wisconsin: Driver Survey. Washington, DC, Transport Research Board. 2004.
  20. 20. Lee D, Pietrucha MT, Sinha SK. Use of Fuzzy Sets to Evaluate Driver Perception of Variable Message Signs. Transportation Research Record. 2005; 1937: 96–104.
  21. 21. Shao C, Dong C, Zheng C, Qiao L. Evaluation model of variable message signs information service. Control Theory & Applications. 2010; 27(12): 1681–1685.
  22. 22. Munim Z, Noor T. Young people’s perceived service quality and environmental performance of hybrid electric bus service. Travel Behaviour and Society. 2020; 133–143.
  23. 23. Zhao W, Quddus M, Huang H, Lee J, Ma Z. Analyzing drivers’ Attitude and choices for the content and formats of variable message signs (VMS). Transportation research part C: Emerging Technologies. 2019; 100: 1–14.
  24. 24. Shen W, Xiao W, Wang X. Passenger satisfaction evaluation model for urban rail transit: A structural equation modeling based on partial least squares. Transport Policy. 2016; 20–31.
  25. 25. Tanko M, Cheemarkurthy H, Hall KS, Garme K. Water transit passenger perceptions and planning factors: A Swedish perspective. Travel Behavior & Society. 2019; 16: 23–30.
  26. 26. Zhang C, Liu Y, Lu W, Xiao G. Evaluating passenger satisfaction index based on PLS-SEM model: evidence from Chinese public transport service. Transport Research Part A: Policy and Practice. 2019; 120: 149–164.
  27. 27. Allen J, Bellizzi MG, Eboli L, Forciniti C, Mazzulla G. Service quality in a mid-sized air terminal: a SEM-MIMIC ordinal Probit accounting for travel, socio-demographic, and user-type heterogeneity. Journal of Air Transport Management. 2020; 84.
  28. 28. Allen J, Eboli L, Mazzulla G, De Dios Ortúzar J. Effect of critical incidents on public transport satisfaction and loyalty: An ordinal probit SEM-MIMIC approach. Transportation. 2018; 47: 827–863.
  29. 29. Ingvardson J, Nielsen O. The relationship between norms, satisfaction and public transport use: a comparison across six European cities using structural equation modelling. Transport Research Part A: Policy & Practice. 2019; 126: 37–57.
  30. 30. Goldberger A. Structural equation methods in the social sciences. Econometrica. 1972; 40(6): 979–1001.
  31. 31. Gertler P. Latent-variable model of quality determination. Journal of Business and Economic Statistics. 1988. 6(1): 97–107.
  32. 32. Wang J, Wang X. Structural Equations with Latent Variables. Wiley Series in Probability and Statistics. 2012; 90–140.
  33. 33. Schneider F, Enste DH. Shadow Economies around the World: Size, Causes and Consequences. IMF Working Papers. 1999.
  34. 34. Rose K, Spiegel M. Cross-country causes and consequences of the crisis: An update. European Economic Review. 2011; 55(3): 309–324.
  35. 35. Hair J, Black W, Babin B, Anderson R, Tatham R. Advanced Diagnostics for Multiple Regression: A Supplement to Multivariate Data Analysis. 2010.
  36. 36. Bagozzi R, Yi Y. On the evaluation of structural equation models. Journal of the Academy of Marketing Science.1988; 16(1): 74–94.
  37. 37. Fornell C, Larcker D. Evaluating structural equation models with unobservable variables and measurement error. Journal of Market Research. 1981; 18: 39–50.
  38. 38. Kline R. Principles and Practice of Structural Equation Modeling. Guilford Press. 1998.
  39. 39. Bowen D, Ma X, Chen F, Chen S. Investigating the differences of single- and multi-vehicle accident probability using mixed logit model. Journal of Advanced Transportation. 2018; 1–9.
  40. 40. Chen F, Chen S, Ma X. Analysis of hourly crash likelihood using unbalanced panel data mixed logit model and real-time driving environmental big data. Journal of Safety Research. 2018; 65: 153–159. pmid:29776524
  41. 41. Chen F, Song M, Ma X. Investigation on the injury severity of drivers in Rear-End collisions between cars using a random parameters bivariate ordered probit model. International Journal of Environmental Research and Public Health. 2019; 16(14), 2632.
  42. 42. Browne M, Cudeck R. Alternative ways of assessing model fit. Sociological Methods & Research. 1993; 21(2): 230–258.
  43. 43. Tang L, Zhou H, Zhang X. An Orderly Choice Model of Travel Information Demand Based on Scale Type Selection Sets. Journal of Traffic and Transportation Engineering. 2019; 19(4): 151–160.
  44. 44. Kattan L, Habib K, Islam T. Modeling travelers’ response to incident information provided by variable message signs in Calgary, Canada. Transportation Research Record. 2010; 2185: 71–80.
  45. 45. Zhou Y, Wu J, Sun X, Guan J. A preliminary study on the influence of VMS on the route choice of taxi drivers in Beijing. Cross-strait intelligent transportation system academic seminar and the second Tongzhou transportation forum. 2005.
  46. 46. Zeng Q, Gu W, Zhang X, Wen H, Lee J, Hao W. Analyzing freeway crash severity using a bayesian spatial generalized ordered logit model with conditional autoregressive priors. Accident Analysis & Prevention. 2019; 127: 87–95.
  47. 47. Zeng Q, Hao W, Lee J, Chen F. Investigating the impacts of real-time weather conditions on freeway crash severity: a Bayesian spatial analysis. International Journal of Environmental Research and Public Health. 2020; 17(8), 2768.