Next Article in Journal
An Overview on Image-Based and Scanner-Based 3D Modeling Technologies
Previous Article in Journal
High-Speed Fully Differential Two-Step ADC Design Method for CMOS Image Sensor
Previous Article in Special Issue
Efficacy and Damage Diagnosis of Reinforced Concrete Columns and Joints Strengthened with FRP Ropes Using Piezoelectric Transducers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Synthetic Data Generation Technique for Enhancement of Prediction Accuracy of Electric Vehicles Demand

by
Subhajit Chatterjee
1 and
Yung-Cheol Byun
2,*
1
Department of Computer Engineering, Jeju National University, Jeju 63243, Republic of Korea
2
Department of Computer Engineering, Major of Electronic Engineering, Jeju National University, Institute of Information Science & Technology, Jeju 63243, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(2), 594; https://doi.org/10.3390/s23020594
Submission received: 11 November 2022 / Revised: 24 December 2022 / Accepted: 30 December 2022 / Published: 4 January 2023

Abstract

:
In terms of electric vehicles (EVs), electric kickboards are crucial elements of smart transportation networks for short-distance travel that is risk-free, economical, and environmentally friendly. Forecasting the daily demand can improve the local service provider’s access to information and help them manage their short-term supply more effectively. This study developed the forecasting model using real-time data and weather information from Jeju Island, South Korea. Cluster analysis under the rental pattern of the electric kickboard is a component of the forecasting processes. We cannot achieve noticeable results at first because of the low amount of training data. We require a lot of data to produce a solid prediction result. For the sake of the subsequent experimental procedure, we created synthetic time-series data using a generative adversarial networks (GAN) approach and combined the synthetic data with the original data. The outcomes have shown how the GAN-based synthetic data generation approach has the potential to enhance prediction accuracy. We employ an ensemble model to improve prediction results that cannot be achieved using a single regressor model. It is a weighted combination of several base regression models to one meta-regressor. To anticipate the daily demand in this study, we create an ensemble model by merging three separate base machine learning algorithms, namely CatBoost, Random Forest (RF), and Extreme Gradient Boosting (XGBoost). The effectiveness of the suggested strategies was assessed using some evaluation indicators. The forecasting outcomes demonstrate that mixing synthetic data with original data improves the robustness of daily demand forecasting and outperforms other models by generating more agreeable values for suggested assessment measures. The outcomes further show that applying ensemble techniques can reasonably increase the forecasting model’s accuracy for daily electric kickboard demand.

1. Introduction

A viable alternative that could help achieve the aims of sustainable urban transportation is EVs. Because they do not release polluting gas into the air, EVs are considered eco-friendly. Due to rapid economic and social development, climate change, environmental degradation, and other challenges have drawn continued attention from governments and academics worldwide [1]. Today, many nations see it as a key mission to achieve sustainable transportation to meet future energy requirements. Using EVs significantly improves energy security and lowers greenhouse gas and other pollutant emissions. Imports meet about 97% of South Korea’s primary energy needs due to a lack of native resources.
An evolutionary force in contemporary transportation is shared mobility. Bike sharing, electric kickboards, and electric bicycles are available options. Travelers and students like to avail of a comfortable transportation system. Unfortunately, the drive for private cars has produced some negative environmental side effects, including lengthy delays and congestion. Traffic congestion grows along with population density. In response to this obstacle, shared mobility has come to be recognized as the key paradigm for reducing traffic jams, lowering emissions, and improving accessibility for commuters and students. Making sense of the current data statistically can help manage ride-sharing operations. Finding patterns and drawing lessons from the current data are necessary for demand prediction using various data. Weather information and geographic coordinates may be included in this data for better understanding [2].
To meet the demand for education and travel-centric areas, businesses specializing in electric kickboards have been established in recent years. The high demand penetration may have some significant adverse effects on the new business systems because of the high demand penetration, which includes inconsistent service and fewer number of kickboards in the specific region; most of the kickboards are distributed in a scattered manner. The widespread usage of electric kickboards encourages the implementation of daily demand in a particular industry, which can help the company function safely.
A rapidly developing nation such as South Korea places more emphasis on local market sustainability. Numerous fundamental business presumptions, such as turnover, total revenues, income, capital consumption, etc., are supported by demand prediction. The accuracy of the models can be improved by external factors that can affect demand, such as weather and locational data. A type of time-based data that may be used to visualize various media is time series modeling. However, because conventional statistical methods continue to dominate it, time series analysis has yet to reach its peak. Previous data are investigated, examined, and organized during forecasting to predict the future. However, most extant publications use just one machine-learning model for short-term forecasting techniques. The benefits of mixing many machine learning models, known as ensemble learning, have yet to be thoroughly researched for challenges relating to shared mobility, such as predicting the demand for electric kickboards. This research proposes a brand-new ensemble learning-based method for anticipating daily demand for electric kickboards.
At the beginning of the start-up business module, it is impossible to grow the business significantly, so the data generated by a start-up company should be fewer data compared with existing businesses that have been running their business for 5–10 years in the industry market. Generating synthetic data that are indistinguishable from real data and can be utilized for research and investigation is one approach to resolving the problem of data scarcity. The GAN technique is the most innovative way to deal with this small training data size issue to accomplish considerable prediction results. In some recent work published by the authors, they solved issues such as the data scarcity problem [3,4] and imbalanced data issues solved by a hybrid-GAN approach [5], and the effectiveness of generating synthetic data to improve the accuracy of prediction models has been shown in the articles [6,7]. In this study, we concentrated on creating synthetic time-series data using improved conditional tabular generative adversarial networks (CTGAN), which addressed the following research section.
The summary of the contribution follows:
  • This paper mainly emphasizes synthetic time-series data generation techniques using conditional generative adversarial networks for improving the forecasting accuracy of electric kickboards.
  • The proposed conditional tabular-GAN (CTGAN) model improved the generation of synthetic time-series data that are further combined with original data to enhance the prediction accuracy.
  • An ensemble method was employed to capture uncertainty in forecasting with a single regressor model that is compared on the same dataset with the same preprocessing under the same experimental condition.
  • The importance of the suggested ensemble forecasting model, a comparison with single models and alternative ensemble approaches, and the superiority of the produced forecasting model’s stability are discussed.
The paper’s organization is divided into five sections: The related study, cutting-edge methods for creating various time-series synthetic data, and their implications for prediction are also covered in Section 2. Section 3 provides a summary of the suggested methodology. Analysis and explanation of the experimental demand forecast are in Section 4. We have discussed the present work’s concept and the proposed framework’s predictive performance in Section 5. The conclusion and additional recommendations for future works are described in Section 6.

2. Related Works

Forecasting demand for an electric vehicle company is crucial since an electric vehicle-based company planning process is based on the data to be produced. Accurate demand forecasting is needed to fulfill the rising demand. The work completed to forecast daily demand for electric mobility in several fields will be covered in this section along with numerous exemplary studies. Researchers have invested much time and effort in advancing time-series analysis models and forecasting accuracy over the years. To forecast the observed historical data, researchers have put tremendous effort into solving time-series prediction issues. The anticipation of demand for electric mobility has drawn greater attention. They are comparable in terms of data processing, how rental systems are designed to solve problems, and how electric vehicle availability issues vary by location. Therefore, one forecasting technique might be useful for resolving these issues. This section will discuss the associated works with demand forecasting for electric mobility.
The focus is on studies that have predicted the demand for electric vehicles (EVs) at charging stations, parking lots, or traffic situations. The places are pre-labeled and consist of parking lots, charging stations, and traffic situations. Additionally, most publications focus on the impact of prediction passenger demand. Only a few studies, meanwhile, have focused on predicting daily mobility needs. Problems, including a weak billing infrastructure, have also emerged to meet the expanding demand in the EV sector. Effective commercial EV bill demand forecasting enables investment planning and resource allocation for long-term infrastructure bills while ensuring the dependability and stability of short-term network utilities. As a result, we point out a research hole in the daily demand for electric kickboards. Specifically, the technique first determines the important location according to the rent pattern and then foretells the daily requirement for electric kickboards in that location.
Shared electric dockless scooters, often known as e-scooters, provide a convenient mode of transportation for quick trips and are especially well-suited for fostering multimodal interactions [8]. Recent exponential growth was seen in these services, and their rate of adoption was higher than that of other shared modes such as bike and auto sharing [9]. Similar research was also put out [10], employing trip trajectory data from an e-scooter service company and spatial inventory data on the infrastructure to integrate e-scooters into Austin, Texas’s urban infrastructure. They discovered that it uses more than eleven million location points from roughly 80,000 e-scooter rides over the course of a year or 1.4% of all e-scooter trips in the city during the same time period. According to the technique results, a typical e-scooter trip distance is divided between sidewalks (18%), bike lanes (11%), and streets (33%).
A multi-step ride-hailing demand prediction model was developed by Wang et al. [11] using a convolutional neural network (CNN). In this article, the authors show that CNN is 30% faster in the training and prediction process than another deep learning (DL) model, long short-term memory (LSTM). To increase the prediction performance, the author separated the Chinese metropolis Chengdu into smaller zones and afterward added background information, such as weather data. In order to tackle short-term passenger demand forecasting, [12] this study suggests a unique DL method called the fusion convolutional long short-term memory network (FCL-Net). The authors suggested that exogenous, geographical, and temporal dependencies made forecasting models more difficult. In Hangzhou, China, data were gathered for the experiment’s short-term passenger demand forecasting under an on-demand ride service platform.
The hybrid model was proposed [13] using the autoregressive integrated moving average (ARIMA) to obtain higher forecasting accuracy. In the article [14], the hybrid model was superior to the individual ML models in terms of error metrics for predicting short-term traffic flow. The prediction of traffic states is a significant issue with significant consequences for contemporary traffic management. Using a neural network, a local traffic status estimate and prediction method are provided [15]. To explain endogenous links between variables in the taxi market under the two-sided market equilibrium, a model was created [16]. The waiting time of passengers and the cost of a cab impact accurate passenger demand on the demand side. The authors [17] propose using real-time taxicab data to estimate passenger demand and taxicab supply across urban regions. The authors’ [18] primary goal is to show that maximum predictability can be attained by utilizing appropriate measures when choosing prediction algorithms. They used two sets of real-world data from Uber and yellow cab rides in New York City. In the experiment, they first measured the demand uncertainty at the building block level using entropy and the temporal correlation of human mobility. Second, the outcomes of the three prediction algorithms were contrasted. Regarding prediction accuracy and calculation time comparison, the Markov predictor performs well.
On-demand transportation service platforms can link waiting for passengers with available registered vehicles efficiently because of the quickly developing internet technology. The demand service market is dependent on customers and their actual riding experiences in the various modes, just like the electric mobility service. The waiting time and fare of the customers had an impact on accurate passenger demand on the demand side. On the other hand, the predicted seeking time on the supply side altered the rider’s behavior or where to park the electric kickboard and reduced the rent. Xu et al. [19] proposed a taxi demand service based on a neural network for the prediction demand of taxis in a specific area. Amini et al. [20] introduce electric vehicle charging demand forecasting depending on historical driving data. By fusing CNN and RNN, numerous spatiotemporal prediction methods were used to describe the predicted trip demand’s temporal and spatial correlation [21,22,23].
A model was put forth to increase the effectiveness of the taxi service or bike-sharing systems by forecasting the demand for pick-up or drop-off the next time by merging the spatiotemporal neural network with the LSTM model [24]. Using a neural network-based approach enables short-term multi-zone passenger demand prediction. The Didi Chuxing, Chengdu, China, car-calling demand data and the New York City taxi demand data were the sources of the information used for the experiment [25].
A variety of ensemble approaches were used in a recent study on demand prediction to anticipate the charging time for EVs [26]. Eddine et al. [27] suggested a new deep learning method for charging demand predicting for EVs that achieved good prediction results by experimenting with two datasets. The location chosen for the study was based on how frequently cars were utilized. A complete charging demand prediction model is established [28], taking into account the charging factors of electric vehicles, and the travel behavior of electric vehicles under various spatiotemporal distributions in the Second Ring Road area of Chengdu is simulated by Monte Carlo. The study is divided into functional areas based on the urban point-of-interest data crawled by Python. The simulation results demonstrate the effectiveness of the suggested strategy for predicting charging demand in various contexts and circumstances.
Data scarcity is considered one of the most significant challenging issues in machine learning. Developing a demand prediction model needs a good chunk of data for training a machine learning model. Real-time data always have a drawback, which is small data. Little research has been developed for generating synthetic data for improving prediction performance. Predicting the consequences of energy production and consumption becomes increasingly important with the growing share of renewable sources in electricity generation. Due to privacy issues, the historical data that the models are based on is constrained. GAN has been used to create synthetic new data and is a promising approach for producing realistic synthetic time-series data. The authors [29] created synthetic data for predicting wind power series using the GAN model. Solutions include generating realistic time series with the aid of generative models, augmenting real-world financial data taken from the US stock market, and demonstrating the value of daily market prediction findings [30]. In this study [31], pairing the actual data with created synthetic data using the GAN model could lower the prediction error of electricity consumption. To close the gap in the production of synthetic data in a data center that will impact forecasting in the energy industry, time-series data augmentation based on GANs is used [32].

3. Methodology

A brief explanation of the information and methodology is provided in this section. This study aims to improve forecasting precision for the daily demand for electric kickboards among local service providers. In this study, we create a new ensemble forecasting model that combines the advantages of individual forecasting models to produce forecasts with improved accuracy and stability. This study suggests a new method for predicting daily demand for an electric kickboard startup business in the province of Jeju Island. We have built a system for developing synthetic data to address the data scarcity issue, which could be helpful in our research. The dataset for real-world electric kickboards is used to implement the framework. Initially, we faced problems achieving noticeable results because we needed more training data. We require a lot of data to produce a solid prediction result. We employed the GAN-based approach for generating synthetic time-series data. The original data have been preprocessed before being sent to the proposed GAN model, which will create synthetic data to improve the prediction model’s performance. We have used conditional synthetic data generation for those rent stations where the actual rent is lower on the side. That model will generate synthetic data only for those conditional rent stations. This study also examines the capability of predictive regression ensemble models by contrasting the ensembles and considering the single reference models to estimate the demand. Figure 1 shows the proposed framework’s overall layout. We considered current information from the regional business in South Korea’s Jeju province.
The subsequent step is preprocessing, when we prepare the data for our experiment by combining the data from many sources into a single final data set. Then, we determine whether or not there is a null value. The prediction’s importance and utility were considered when choosing the data features. We used a customized version of the k-means clustering module. The data distribution has led to the selection of four clusters. We first trained the model using the original data to obtain the prediction result. The GAN model was then trained to produce synthetic data using the input from the original data. Then, we blended the original and synthetic data using the original date distribution. Before training a final model with these chosen settings on the entire training set, cross-validation (CV) finds the settings that produce the least amount of error. This function uses cross-validation to train and assess the performance of each estimator in the model library. Models were developed and evaluated using 10-fold cross-validation. All of the estimators in the model library are trained and evaluated using cross-validation using the compare_model function in PyCaret. This function produces a scoring grid with typical cross-validated scores as its result. We create an ensemble regressor technique that uses machine learning models with the best hyperparameters as the base model and evaluation metrics to assess the accuracy of the prediction made using the suggested framework.

3.1. Data Analysis

The experiment’s data collection is briefly described in this section. We used data from a local electric kickboard service provider on Jeju Island. The dataset collected the rent details from 16 April 2019 to 11 June 2021, including the spatial and temporal data events. Additionally, meteorological data were imported via the Korea Meteorological Administration. We considered external factors that affect how kickboard services are used, such as average daily temperature, rainfall, and the separation of weekends and weekdays. The dataset contains original real-time electric mobility data (CSV), temporal data (CSV), and spatial data (CSV) obtained by the local company. Several processes were involved in preprocessing the complete data. To ensure data consistency, we have also eliminated the rows with missing data, decreased inconsistent values, and removed duplicate data. The data are meticulously examined before the experiment, and the date format conversion is completed before using the final data. Saturday and Sunday are regarded as holidays in the later preprocessing on the day when weekdays and weekends are filtered. Using the preprocessed data, we use the k-means clustering algorithm to identify several clusters on Jeju Island. The features were chosen based on how useful and significant they were for forecasting daily demand. After feature selection, a total of 13 features were utilized. Figure 2 shows the rental locations of electric kickboards, where the x-axis depicts the latitude as xpos, and the y-axis indicates the longitude as ypos. The parameters or coordinates latitude and longitude are used to pinpoint the position of any site.
The regional data were divided into four clusters according to the rental location data distribution. First, we divided Jeju Island into Jeju City and the Seogwipo City region. Jeju city is further divided into three clusters. To cluster the data in accordance with the rent pattern, we used k-means clustering as shown in Figure 3, four clusters with the names sector 0 through sector 3 have been chosen as a result of the data distribution, where xpos represent latitude over the x-axis and ypos represent longitude over the y-axis. Other selected features are temperature, insulation, humidity, day, month, year, weekend, rain, and holiday. Figure 3 displays the variation in dot size based on the total number of rentals at each Jeju Island rental station over the data collection. Figure 4 depicts sector-wise rent demand by the passenger. Electric kickboard rentals are most popular in sector 1, while the demand for kickboards is lowest in sector 0. The y-axis lists the total rent for each sector, and the x-axis lists the various sector numbers.

3.2. Generative Adversarial Networks

In 2014, Goodfellow et al. [33] created generative adversarial networks, which is a kind of neural network utilized in unsupervised learning methods. Image, tabular, and time-series data fields have been expanded using the GAN technique. In this study, we used GAN to create synthetic time-series data and enhance the performance of the regression model. GANs are composed of two neural network models that are in competition with one another for superior prediction accuracy. The discriminator and generator are the names of the two neural networks. A deconvolutional neural network serves as the discriminator, and a convolutional neural network serves as the generator. The generator aims to produce outputs that may be mistaken for real data. The discriminator aims to distinguish between the real and artificial data it receives.
Equation (1) illustrates a mathematical function regarding the cross-entropy minmax game between these two networks.
min G max D R ( D , G ) = E x P d a t a ( x ) [ l o g D ( x ) ] + E r z P r z ( r z ) [ l o g ( 1 D ( G ( r z ) ) ) ]
Data are generated by generator G using inputs of real data x and random noise variable r z . The produced data returned by this process, G ( r z ) , should match the actual data distribution. D ( x ) represents the probability that discriminator D would identify and classify x as actual data, where E denotes the expectation. D ( G ( r z ) ) is the probability that D will classify the data as having been generated by G. The objectives of the generator and discriminator are in opposition. By making D ( G ( r z ) ) approach 0, which shows that D can precisely identify fake data from real data, D seeks to enhance this error while G seeks to reduce it. Figure 5 depicts the GAN’s basic architecture.

3.3. Conditional Generative Adversarial Networks

When in terms of time-series tabular data, the algorithms can only produce data with the same distribution as the real data if there are concurrently discrete and continuous variables in the actual data. In 2019, Xu et al. [34] suggested the CTGAN model, an upgrade above TGAN, to address this issue. The goals of CTGAN are very similar to those of TGAN [35]. CTGAN is different because it is more ambitious. It seeks to preserve the joint distribution of all columns rather than merely the correlation between any two columns in the synthetic data. Learning the true distribution of data is one of the conditional generator’s most crucial jobs. Given a constraint on a certain discrete value, the generator’s goal is to change the input to the original distribution as Equation (2).
P ( row ) = k C i * P G row C i = k P C i = k
where i stands for a particular discrete attribute, while k represents values from the discrete column C i .
Synthetic data generated using the improved CTGAN model’s configuration are shown in Table 1. The residuals determine the size of the output samples, in this case, g e n e r a t o r d i m . These residuals will increase when more numbers are added to the list: one for each number. This has the same effect as deepening the generator. The size of the output samples for each linear discriminator layer is also represented by d i s c r i m i n a t o r d i m . As for the quantity of training iterations the model will experience, we have chosen 600 epochs for more appropriate training. A larger epoch number will generally lead to longer training times but better synthetic data.

3.4. Ensemble Learning Model

With the ensemble method, learning tasks are accomplished by assembling and combining a number of weak learners. The primary learners are trained using the two well-known techniques, bagging and boosting. Bagging reduces variance, which enhances the generalization of the model. To increase the model’s accuracy, boosting uses a variety of machine learning (ML) approaches to turn a number of weak learners into strong learners. The ensemble approach is chosen because it is adaptable and has high computational throughput for large-scale dataset prediction operations. Due to their benefits, the ensemble approach has drawn a lot of interest in recent years. Voting regressors are ensemble models that combine many base models’ predictions into a single, final forecast. The ensemble’s base estimators average predicted target value serves as the final forecast. Using a mean and weighted average is the most straightforward way to group regression ensembles. To increase the predicted accuracy of the chosen models, the regression ensemble models build a collection of models. The predictive regression ensemble models have the ability to estimate demand by contrasting the individual models and considering the meta-model.
Using the ensemble approach, a model is created to predict the daily demand for electric kickboards. This strategy’s fundamental tenet is to combine basic models to produce a composite prediction model. To create the ensemble model [36], we used the CatBoost, RF, and XGBoost machine learning algorithms to predict the daily demand for electric kickboards.

3.4.1. CatBoost

Prokhorenkova et al. [37] developed the gradient boosting decision tree (GBDT) technique into categorical boosting (CatBoost). It utilizes category features efficiently and with the least amount of information loss. It is distinct from other gradient boosting techniques and starts using ordered boosting, which is a successfully adapted method. This method can handle category features and does well with small datasets. This procedure, frequently carried out during preprocessing, mainly entails replacing the original category features with numerical values.
It has recently been used in various industries, including finance, and in different data sources, including time-series data. Although CatBoost may not be the greatest learner for homogeneous data, it is an excellent answer for heterogeneous data issues. In CatBoost, a new binary feature is added in place of the original variable for each category. It chooses the tree structure using random permutations to determine leaf values and prevent overfitting by conventional gradient-boosting methods.

3.4.2. Random Forest

Using random forests (RF), ref. [38] is a common ensemble method. It is frequently applied to classification and regression issues. During training, the RF algorithm aggregates decision trees and produces the mean forecast for each tree (regression). The model generates a massive forest of arbitrary, uncorrelated decision trees to find the best possible solution in RF. By only choosing a portion of the feature space at each split, RF makes an effort to overcome the correlation problem. The RF method functions effectively on enormous data sets for various applications and has the highest accuracy of the known algorithms. Without destroying any of them, it can handle a huge variety of input variables. A straight inside estimation of the generalization error is produced as the forest expands. Numerous separate decision trees are used in the RF technique, each formed from a different subset (bootstrap sample) of the training data. In the tree-building process, the best split for each node is chosen by randomly choosing candidate variables.

3.4.3. Extreme Gradient Boosting

The “boosting” idea, which combines the prediction of numerous weak learners with additive training methods to create a strong learner, is the foundation of the extreme gradient boosting (XGBoost) technique, which was put forth by Chen et al. [39] in 2016. This freshly created algorithm has found widespread use in many different industries. XGBoost uses a regularized technique, formalization, to prevent overfitting and achieve better performance. The integrated framework employs a random sampling strategy to lower variance and improve the final model’s predictive capability.

4. Results and Discussion

Algorithms for ML were developed utilizing the google collaborative framework. To read the data and implement the models, several ML packages, including NumPy, pandas, sklearn [40], seaborn, etc., were imported.

4.1. Accuracy Measurement Metrics

The discrepancies between the actual observations in the test set and the predictions made by the final model are used to assess a model’s accuracy. R 2 and MAPE are the evaluation measures applied in this work. Every regression study uses R 2 as a critical performance parameter to quantify model prediction. In contrast, a model with a zero R 2 generates poor forecasts, and one with a value close to one R 2 yields good predictions. A simple average of absolute percentage errors is known as MAPE. Equations (3) and (4) are written in the section below.
R 2 = 1 k = 1 m y k y ^ k 2 k = 1 m y k y ¯ k 2
M A P E = 1 m k = 1 m y k y ^ k y k · 100 %
where y k is the actual value of the k t h sample case, y ^ k is the predicated value of k t h sample case, y ¯ k is the average value, and m is the sample size.
The objective of the current study is to evaluate the efficacy of the suggested model in estimating the daily demand for electric kickboards using real-time data. The dataset was divided into training (90%) and testing (10%) for the original data and combined synthetic and original data. The parameter settings that directly impact the model’s performance are essential. The choice of appropriate parameter tuning may considerably affect the predictive model’s performance. Using scikit-learn and a grid search method, the ideal parameters that lead to the most incredible performance for the methods have been found. The ideal key parameter for the methods applied in this investigation is shown in Table 2.

4.2. Model Performance Comparison

A thorough comparative analysis was completed to compare the proposed model’s applicability and effectiveness for predicting daily demand for electric kickboards with other ML models. Various evaluation metrics, such as MAPE and R 2 , are used to evaluate the performance of the suggested model. A higher R 2 score and a low MAPE score can be used to describe the model’s performance. Table 3 compares the proposed model for predicting daily demand for electric kickboards with other single ML models. The proposed model also incorporates elements from other ML models. In comparison to previous individual-based models, the suggested ensemble model fits the data the best and has the lowest errors in terms of MAPE value. It also has the highest R 2 value of any model. As shown in Table 3, the findings indicate that the suggested model outperforms basic models such as CatBoost, RF, XGBoost, ET, and LGBM.
Table 4 lists the outcomes based on two evaluation indicators ( R 2 and MAPE). As seen in Table 4, the ensemble models with the highest R 2 and lowest MAPE are compared. For the test data set, distinct ensemble models were created for this investigation. The suggested method outperformed all ensemble approaches in a detailed comparison of findings with the lowest MAPE (21.22) and highest R 2 (0.79) values for combined data. The proposed model has the highest R 2 (0.64) and lowest MAPE (24.51) values compared to the original data. The proposed model is the best algorithm for predicting daily demand for electric kickboards in all the situations taken into account, according to the thorough analysis based on evaluation metrics ( R 2 and MAPE).
Figure 6 shows a correlation between the actual and predicted demand. Using the test set illustrates the link between actual and predicted demand. The date is shown by the x-axis, while the y-axis represents the rent count value. The visual depiction of Figure 6 illustrates how the original data forecast result fell short of expectations. On the other hand, the prediction accuracy increased when we used the combined data. The outcome illustrates the suggested model’s improved prediction ability.

5. Discussion

At the beginning of every business, a reliable business model must be built to meet everyday demand while offering excellent customer service. Businesses need help to meet demand at the right location, and machine learning can aid by precisely forecasting the demand for electric kickboards. This study provided an electric kickboard demand forecasting model that took into account actual rent data, weather data, and condition data processing together with real-world weather data. These process data also comprise a cluster analysis to categorize clusters according to rental locations. We need a significant amount of data to train a machine-learning model. However, this study initially needs to improve in terms of small data size because a new business is starting. In order to improve prediction accuracy, this study suggests using a conditional tabular-GAN (CTGAN) model to create synthetic time-series data and further blend it with original data. We looked into whether using synthetic data improved prediction accuracy.
Figure 6 illustrates how models can learn from data behavior when they can make predictions using combined data that are consistent with the measured values. The regression ensemble methodology is dependable in reaching predetermined predictions because the increased performance gained during the training stages with combined data is maintained during the test phases. Additionally, the proposed demand forecasting model would make it possible for electric mobility service providers to plan future production and operation. The proposed demand prediction model may also help formulate investment and operation strategies for flexible electric mobility infrastructures based on the demand for electric vehicles.

6. Conclusions

The main goal of this study was to predict the daily demand for electric kickboards based on the historical pattern of rental payments using real-world data from a local Jeju Island electric kickboard service provider. The collected data were merged into one single final data for the start of the development. Later, we employed the GAN method for the data scarcity issue that will generate synthetic data as learned from the original data distribution. Integrating the produced synthetic data with the actual data will boost the prediction accuracy of the daily demand for kickboards. The objective of this study was to forecast the daily demand for kickboards using an ensemble model technique. There were three ML algorithms used: RF, CatBoost, and XGBoost. The suggested ensemble method’s prediction performance was evaluated using a variety of measures. The proposed method’s prediction performance was assessed based on the test dataset. The results demonstrated that the proposed ensemble model outperformed other chosen ML models. When we integrated synthetic data with the original data, the performance of the suggested ensemble approach improved, according to a thorough comparison with the original and combined data. The original data produced the highest MAPE value (24.51) and the lowest value of R 2 (0.64). The model also produced the highest R 2 (0.79) and lowest MAPE (21.22) values for combined synthetic and original data.
Future research can examine a few potential limitations of this work. To generate synthetic time-series data, we can utilize a more advanced GAN model, various optimization methods, and improved hyperparameter settings for the different ML models. Future studies that consider these variables may offer fascinating insights into predicting daily demand. Furthermore, future studies may use other sophisticated machine and deep learning models.

Author Contributions

: Conceptualization, S.C.; Formal analysis, S.C.; Funding acquisition, Y.-C.B.; Methodology, S.C.; Writing—review and editing, S.C.; Investigation, Y.-C.B.; Resources, Y.-C.B.; Project administration, Y.-C.B.; Supervision, Y.-C.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was financially supported by the Ministry of Small and Medium-sized Enterprises (SMEs) and Startups (MSS), Korea, under the “Regional Specialized Industry Development Plus Program (R&D, S3246057)” supervised by the Korea Institute for Advancement of Technology (KIAT). This work was also supported by the Korea Institute for Advancement of Technology (KIAT) grant funded by the Korea Government (MOTIE) (P0016977, The Establishment Project of Industry-University Fusion District).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EVsElectric Vehicles
MLMachine Learning
DLDeep Learning
CNNConvolutional Neural Network
LSTMLong Short-Term Memory
GANGenerative Adversarial Networks
CTGANConditional Tabular GAN
RFRandom Forest
XGBoostExtreme Gradient Boosting
ARIMAAutoregressive Integrated Moving Average
CatBoostCategorical Boosting
GBDTGradient Boosting Decision Tree
KNNK-Nearest Neighbors
DTDecision Tree
ETExtra Tree
LGBMLight Gradient Boosting Machine

References

  1. Świąder, M. The implementation of the concept of environmental carrying capacity into spatial management of cities: A review. Manag. Environ. Qual. Int. J. 2018, 29, 1059–1074. [Google Scholar] [CrossRef]
  2. Stevenson, W.J.; Hojati, M.; Cao, J.; Mottaghi, H.; Bakhtiari, B. Operations Management; McGraw-Hill Irwin: Boston, MA, USA, 2007. [Google Scholar]
  3. Baasch, G.; Rousseau, G.; Evins, R. A Conditional Generative adversarial Network for energy use in multiple buildings using scarce data. Energy AI 2021, 5, 100087. [Google Scholar] [CrossRef]
  4. Fekri, M.N.; Ghosh, A.M.; Grolinger, K. Generating energy data for machine learning with recurrent generative adversarial networks. Energies 2019, 13, 130. [Google Scholar] [CrossRef] [Green Version]
  5. Shafqat, W.; Byun, Y.C. A Hybrid GAN-Based Approach to Solve Imbalanced Data Problem in Recommendation Systems. IEEE Access 2022, 10, 11036–11047. [Google Scholar] [CrossRef]
  6. Hazra, D.; Shafqat, W.; Byun, Y.C. Generating Synthetic Data to Reduce Prediction Error of Energy Consumption. CMC 2022, 70, 3151–3167. [Google Scholar] [CrossRef]
  7. Hazra, D.; Byun, Y.C. Generating synthetic fermentation data of Shindari, a traditional Jeju beverage, using multiple imputation ensemble and generative adversarial networks. Appl. Sci. 2021, 11, 2787. [Google Scholar] [CrossRef]
  8. Zuniga-Garcia, N.; Machemehl, R. Dockless electric scooters and transit use in an urban/university environment. In Proceedings of the 99th Annual Meeting of the Transportation Research Board, Washington, DC, USA, 12–16 January 2020; Volume 2, p. 4. [Google Scholar]
  9. Clewlow, R.R. The Micro-Mobility Revolution: The Introduction and Adoption of Electric Scooters in the United States; Technical Report; National Academy of Sciences: Washington, DC, USA, 2019. [Google Scholar]
  10. Zuniga-Garcia, N.; Juri, N.R.; Perrine, K.A.; Machemehl, R.B. E-scooters in urban infrastructure: Understanding sidewalk, bike lane, and roadway usage from trajectory data. Case Stud. Transp. Policy 2021, 9, 983–994. [Google Scholar] [CrossRef]
  11. Wang, C.; Hou, Y.; Barth, M. Data-driven multi-step demand prediction for ride-hailing services using convolutional neural network. In Proceedings of the Science and Information Conference, Las Vegas, NV, USA, 25–26 April 2019; Springer: Berlin/Heidelberg, Germany, 2019; pp. 11–22. [Google Scholar]
  12. Ke, J.; Zheng, H.; Yang, H.; Chen, X.M. Short-term forecasting of passenger demand under on-demand ride services: A spatio-temporal deep learning approach. Transp. Res. Part Emerg. Technol. 2017, 85, 591–608. [Google Scholar] [CrossRef] [Green Version]
  13. Khashei, M.; Bijari, M.; Ardali, G.A.R. Hybridization of autoregressive integrated moving average (ARIMA) with probabilistic neural networks (PNNs). Comput. Ind. Eng. 2012, 63, 37–45. [Google Scholar] [CrossRef]
  14. Zhang, N.; Zhang, Y.; Lu, H. Seasonal autoregressive integrated moving average and support vector machine models: Prediction of short-term traffic flow on freeways. Transp. Res. Rec. 2011, 2215, 85–92. [Google Scholar] [CrossRef]
  15. Antoniou, C.; Koutsopoulos, H.N.; Yannis, G. Dynamic data-driven local traffic state estimation and prediction. Transp. Res. Part Emerg. Technol. 2013, 34, 89–107. [Google Scholar] [CrossRef]
  16. Yang, H.; Wong, S.C.; Wong, K.I. Demand–supply equilibrium of taxi services in a network under competition and regulation. Transp. Res. Part Methodol. 2002, 36, 799–819. [Google Scholar] [CrossRef]
  17. Zhang, D.; He, T.; Lin, S.; Munir, S.; Stankovic, J.A. Taxi-passenger-demand modeling based on big data from a roving sensor network. IEEE Trans. Big Data 2016, 3, 362–374. [Google Scholar] [CrossRef]
  18. Zhao, K.; Khryashchev, D.; Freire, J.; Silva, C.; Vo, H. Predicting taxi demand at high spatial resolution: Approaching the limit of predictability. In Proceedings of the 2016 IEEE International Conference on Big Data, Washington, DC, USA, 5–8 December 2016; pp. 833–842. [Google Scholar]
  19. Xu, J.; Rahmatizadeh, R.; Bölöni, L.; Turgut, D. Real-time prediction of taxi demand using recurrent neural networks. IEEE Trans. Intell. Transp. Syst. 2017, 19, 2572–2581. [Google Scholar] [CrossRef]
  20. Amini, M.; Moghaddam, M.P. Probabilistic modelling of electric vehicles’ parking lots charging demand. In Proceedings of the 2013 21st Iranian Conference on Electrical Engineering (ICEE), Mashhad, Iran, 14–16 May 2013; pp. 1–4. [Google Scholar]
  21. Chu, K.F.; Lam, A.Y.; Li, V.O. Travel demand prediction using deep multi-scale convolutional LSTM network. In Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA, 4–7 November 2018; pp. 1402–1407. [Google Scholar]
  22. Yao, H.; Wu, F.; Ke, J.; Tang, X.; Jia, Y.; Lu, S.; Gong, P.; Ye, J.; Li, Z. Deep multi-view spatial-temporal network for taxi demand prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, Wellington, New Zealand, 11–14 December 2018; Volume 32. [Google Scholar]
  23. Liu, L.; Qiu, Z.; Li, G.; Wang, Q.; Ouyang, W.; Lin, L. Contextualized spatial–temporal network for taxi origin-destination demand prediction. IEEE Trans. Intell. Transp. Syst. 2019, 20, 3875–3887. [Google Scholar] [CrossRef] [Green Version]
  24. Ye, J.; Sun, L.; Du, B.; Fu, Y.; Tong, X.; Xiong, H. Co-prediction of multiple transportation demands based on deep spatio-temporal neural network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA, 4–8 August 2019; pp. 305–313. [Google Scholar]
  25. Zhang, K.; Liu, Z.; Zheng, L. Short-term prediction of passenger demand in multi-zone level: Temporal convolutional neural network with multi-task learning. IEEE Trans. Intell. Transp. Syst. 2019, 21, 1480–1490. [Google Scholar] [CrossRef]
  26. Ullah, I.; Liu, K.; Yamamoto, T.; Zahid, M.; Jamal, A. Prediction of electric vehicle charging duration time using ensemble machine learning algorithm and Shapley additive explanations. Int. J. Energy Res. 2022, 46, 15211–15230. [Google Scholar] [CrossRef]
  27. Eddine, M.D.; Shen, Y. A deep learning based approach for predicting the demand of electric vehicle charge. J. Supercomput. 2022, 78, 14072–14095. [Google Scholar] [CrossRef]
  28. Zhang, K.; Tian, Y.; Shi, S.; Su, Y.; Xu, L.; Zhang, M. Electric Vehicle Charging Demand Forecasting Based on City Grid Attribute Classification. In Proceedings of the 2021 11th International Conference on Power and Energy Systems (ICPES), Shanghai, China, 18 December 2021; pp. 592–597. [Google Scholar]
  29. Jürgens, M.; Scholz, C. Synthetic Time Series Generation Using GANs with Application in Energy Economics. Master Thesis, University of Göttingen, Göttingen, Germany, 2022. [Google Scholar]
  30. Dogariu, M.; Ştefan, L.D.; Boteanu, B.A.; Lamba, C.; Kim, B.; Ionescu, B. Generation of realistic synthetic financial time-series. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 2022, 18, 1–27. [Google Scholar] [CrossRef]
  31. Yilmaz, B.; Korn, R. Synthetic demand data generation for individual electricity consumers: Generative Adversarial Networks (GANs). Energy AI 2022, 9, 100161. [Google Scholar] [CrossRef]
  32. Pérez, J.; Arroba, P.; Moya, J.M. Data augmentation through multivariate scenario forecasting in Data Centers using Generative Adversarial Networks. Appl. Intell. 2022, 1–18. [Google Scholar] [CrossRef]
  33. Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial networks. Commun. ACM 2020, 63, 139–144. [Google Scholar] [CrossRef]
  34. Xu, L.; Skoularidou, M.; Cuesta-Infante, A.; Veeramachaneni, K. Modeling tabular data using conditional gan. Adv. Neural Inf. Process. Syst. 2019, 32, 7333–7343. [Google Scholar]
  35. Xu, L.; Veeramachaneni, K. Synthesizing tabular data using generative adversarial networks. arXiv 2018, arXiv:1811.11264. [Google Scholar]
  36. Sagi, O.; Rokach, L. Ensemble learning: A survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2018, 8, e1249. [Google Scholar] [CrossRef]
  37. Prokhorenkova, L.; Gusev, G.; Vorobev, A.; Dorogush, A.V.; Gulin, A. CatBoost: Unbiased boosting with categorical features. Adv. Neural Inf. Process. Syst. 2018, 31, 6639–6649. [Google Scholar]
  38. Wang, X.; Liu, T.; Zheng, X.; Peng, H.; Xin, J.; Zhang, B. Short-term prediction of groundwater level using improved random forest regression with a combination of random features. Appl. Water Sci. 2018, 8, 1–12. [Google Scholar] [CrossRef]
  39. Chen, T.; Guestrin, C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
  40. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
Figure 1. Proposed methodology overview of the study.
Figure 1. Proposed methodology overview of the study.
Sensors 23 00594 g001
Figure 2. Distribution of rental locations between Jeju City and Seogwipo City.
Figure 2. Distribution of rental locations between Jeju City and Seogwipo City.
Sensors 23 00594 g002
Figure 3. Visualization graph for sectors divided using the clustering method.
Figure 3. Visualization graph for sectors divided using the clustering method.
Sensors 23 00594 g003
Figure 4. Sector wise rent demand graph.
Figure 4. Sector wise rent demand graph.
Sensors 23 00594 g004
Figure 5. GAN architecture.
Figure 5. GAN architecture.
Sensors 23 00594 g005
Figure 6. Plot of the proposed regression model prediction for test data compared with the original data and combined synthetic with original data.
Figure 6. Plot of the proposed regression model prediction for test data compared with the original data and combined synthetic with original data.
Sensors 23 00594 g006
Table 1. Synthetic data generated using the improved CTGAN model’s configuration are shown below.
Table 1. Synthetic data generated using the improved CTGAN model’s configuration are shown below.
ModelGenerator_dimDiscriminator_dimBatch_sizeEpochsGenerator_lrDiscriminator_lrOptimizer
Improved CTGAN[1024, 1024][1024, 1024]6006000.00010.00033Adam
Table 2. Parameter settings for model tuning.
Table 2. Parameter settings for model tuning.
Modelsk-FoldMax-DepthLearning-Raten-Estimators
Catboost10030.3300
RF10120.2200
XGBoost10100.1100
Table 3. Performance comparison with different single machine learning models.
Table 3. Performance comparison with different single machine learning models.
ModelsOriginal DataCombined Data (Original + Synthetic)
R 2 MAPE R 2 MAPE
RF0.5829.210.6725.61
CatBoost0.5730.730.6327.11
XGBoost0.5829.730.6925.15
Extra Tree (ET)0.5131.380.4932.14
LGBM0.4439.890.4634.12
Proposed Model0.6424.510.7921.22
Table 4. Performance comparison with different ensemble approaches.
Table 4. Performance comparison with different ensemble approaches.
Ensemble ModelsOriginal DataCombined Data (Original + Synthetic)
R 2 MAPE R 2 MAPE
RF + CatBoost + LightGBM0.6226.210.7222.93
Stacking (KNN + DT + RF)0.5928.730.7024.11
Stacking (KNN + DT + RF + XGBoost)0.6128.250.6925.15
Extra Tree + XGBoost + RF0.6226.730.7123.14
Proposed Model0.6424.510.7921.22
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chatterjee, S.; Byun, Y.-C. A Synthetic Data Generation Technique for Enhancement of Prediction Accuracy of Electric Vehicles Demand. Sensors 2023, 23, 594. https://doi.org/10.3390/s23020594

AMA Style

Chatterjee S, Byun Y-C. A Synthetic Data Generation Technique for Enhancement of Prediction Accuracy of Electric Vehicles Demand. Sensors. 2023; 23(2):594. https://doi.org/10.3390/s23020594

Chicago/Turabian Style

Chatterjee, Subhajit, and Yung-Cheol Byun. 2023. "A Synthetic Data Generation Technique for Enhancement of Prediction Accuracy of Electric Vehicles Demand" Sensors 23, no. 2: 594. https://doi.org/10.3390/s23020594

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop