A New Weighting Scheme in Weighted Markov Model for Predicting the Probability of Drought Episodes

Drought is a complex stochastic natural hazard caused by prolonged shortage of rainfall. Several environmental factors are involved in determining drought classes at the specific monitoring station. Therefore, efficient sequence processing techniques are required to explore and predict the periodic information about the various episodes of drought classes. In this study, we proposed a new weighting scheme to predict the probability of various drought classes under Weighted Markov Chain (WMC) model. We provide a standardized scheme of weights for ordinal sequences of drought classifications by normalizing squared weighted Cohen Kappa. Illustrations of the proposed scheme are given by including temporal ordinal data on drought classes determined by the standardized precipitation temperature index (SPTI). Experimental results show that the proposed weighting scheme for WMC model is sufficiently flexible to address actual changes in drought classifications by restructuring the transient behavior of a Markov chain. In summary, this paper proposes a new weighting scheme to improve the accuracy of the WMC, specifically in the field of hydrology.


Introduction
Drought, a highest ranked natural hazard, is the main source of severe destructive effects on the planet [1]. In particular, its sustained consequences lead to sterilization of agricultural land and initiation of diseases. Factors associated with higher risk of drought are long duration of comparatively less rainfall, high rate of evapotranspiration, low relative humidity, high temperature, and high wind speed [2]. Moreover, many other environmental and ecological factors are also responsible for the recurrent occurrences of drought hazard. However, drought intensity, duration, and severity may vary from region to region. In recent decades, almost all the developing countries are facing water shortage due to continued expansion in agriculture, industrial, and energy sectors. Consequently, a perpetual increase in difference between water demand and renewable freshwater resources will lead to major social and economic issues [3].
To avoid and overcome the adverse effects of drought hazard, numerous studies have been conducted in various climatic regions. Several studies have proposed drought monitoring tools and forecasting methods to predict and quantify the risk associated with the recurrent occurrences of drought. Drought indices are the most frequently used ones around the world among various available tools due to their simplicity in structure, robustness, and popularity.
A list of drought indices along with its variable requirement is available in the literature [4]. Beside drought monitoring tools, a number of drought forecasting methods have been developed to assess the risk of future drought conditions [5,6]. However, the tendency of using stochastic process to model uncertain phenomena is rapidly increasing, such as Markov chain is a promising approach to model dynamic activities [7]. A Markov chain is a discrete time stochastic process, which has the property that the future state of the process is independent from the past state, given the present state [8]. Furthermore, Markov chain models can be useful for forecasting future drought classes due to their multifaceted nature to enumerate uncertainties associated with these hydrometeorological variables [9][10][11]. However, it is difficult to adjust the transition probability matrix of Markov chain for the precise forecasting of succeeding events at short time scale.
To handle this structural issue, several studies used weights in Markov chain models to improve model accuracy and precision [12][13][14][15][16]. However, the selection of weights is purely a subjective approach. e assignment of these weights depends on the type of data or purely subjective. Dynamic weighting schemes are proposed to adjust Markov chain model [17][18][19][20][21][22]. Furthermore, an error and trial methodology can be used to increase the performance of the weighted Markov chain [23].
In this study, we aimed to develop a new weighting method to address the structural difficulties in traditional Markov chain while forecasting short-term drought states. We use the standardized precipitation temperature index (SPTI) for drought classification. As SPTI produces drought severity level (highest to lowest), therefore, prediction of highest severity to lowest severity and vice versa is questionable in the traditional Markov chain setting. e rationale of this study is to use interrater reliability measures of association as weights for accurate and precise forecasting of drought classification states under Weighted Markov Chain (WMC) setting. We use our proposed weighting scheme for one-month ahead forecasting of drought states of five meteorological stations in Pakistan.

Methodology
Nowadays, drought indices play a substantial role in determining drought classes. However, the methodological configuration of each index solely depends on the availability of climatic data and its prior historical data. In the current scenario, the uses and application of multiscalar drought indices, being more flexible and having the characteristics to determine drought at various time scales, are very common. In this paper, monthly drought classifications determined by the multiscalar drought indices are assumed to follow firstorder Markov chain. To predict the probability of onemonth ahead drought classes, a new weighting scheme to determine the weights for WMC model is provided by aligning the role of autocorrelation and Cohen Kappa measure. e detail on the methodological structure of the proposed model weighting schemes is explained in the subsequent subsection.

2.1.
e Multiscalar Drought Indices. ere are several procedures to report drought severity using multiscalar drought index. McKee et al. [24] developed SPI drought index, which is based on long-term precipitation record to quantify the precipitation scarcity for different time scales. One of the major advantages of using SPI index is that it can be used to monitor drought for various time scales.
Vicente-Serrano et al. [25] developed a new multiscalar drought index: the standardized precipitation evapotranspiration index (SPEI). In SPEI, the water balance model based on the difference between precipitation and potential evapotranspiration (PET) is used with similar estimation procedure of SPI. One major advantage of SPEI over SPI is inclusion of the effect of evaporation in rainfall data to characterize the regions under study.
Following the same methodology of SPI and SPEI, Ali et al. [26] developed standardized precipitation temperature index (SPTI) drought index to capture drought characterization in both cold and hot climate regions. However, appropriate selection of drought indices also depends on the availability of data and the nature of climatic zone. In this study, we employed SPTI methodology to characterize monthly historical behavior of drought hazard. Stepwise mathematical procedure of SPTI methodology is discussed in [27].
In this paper, we followed the classification criteria provided by McKee et al. [24] and Vicente-Serrano et al. [25]. Table 1 shows the ranges of SPTI values associated with drought classes.

Drought Classes as a Markov Chain.
A discrete Markov chain is a random process that describes a sequence of events from a set of finite possible states, whereas current event depends only on the preceding event. It has been commonly used to model uncertain events in various fields such as, engineering [28], economics [29], and physics [30]. In recent decades, the use of Markov chain is common in many applications to capture the behavior of drought classification states using multiscalar drought indices [31,32]. For example, Mishra et al. [33] examined the distribution of drought interval time and mean drought interarrival time by their joint probability density functions and Markov chain approach. Shatanawi et al. [34] found that exact prediction of drought index values is impossible based on ARIMA model. However, early warning of drought can be detected from monthly Markov transition probabilities. erefore, in drought modeling context, time series data SPTI drought classes for a single station can be considered as a sequence of ordinal drought classes. Consequently, historical series of drought classification states for a specified station can be embodied as a discrete Markov chain process. Here, we assume that any single class of drought in time series of SPTI depends on its previous class and then proceed to the construction of the transition probability matrix. It is just a statistical compliance that allows us to consider each drought class as a 1st order Markov chain. However, if each class depends on its previous two classes or nth order class, it is recommended to use 2nd order or higher order Markov model accordingly.

e Proposed Weighting Scheme.
In this study, time series data on drought classes Z t determined by the SPTI drought index at one-month time scale are assumed as a series of ordinal correlated random variables. In this situation, instead of using traditional correlation between the quantitative series of SPTI at various time lags, interrater reliability measure Kappa is suggested to assess the relationship between stochastic processes of Z t and Z t−1 of SPTI. Moreover, on the same rationale of using autocorrelation as weight, interrater reliability measure among the time series of ordinal classification of the SPTI index at various time lags can be considered in advance to predict the present drought class. In previous studies, Sengupta et al. [23] showed that the WMC method can make accurate predictions when the time series data exhibit its stochastic nature. Hereafter, in order to predict the occurrence of next drought class, the weighted average of interrater reliability coefficient at various lags as a weight is suggested to adjust the predictive probabilities. erefore, instead of using correlation, the idea of using an interrater reliability measure for the ordinal classification is more rational. e basic steps of the proposed weighting scheme in the WMC-based prediction of drought classes are as follows: (1) Drought classification states and transition probability matrix: Let X k be the time series of drought classes, where X k may assume the nominal droughts classes c 1 , c 2 , c 3 , . . ., c n depending on the classification criteria of the SPTI drought index. e transient behavior of each drought class can be represented by transition probability matrix in the following ways where c 1 , c 2 , c 3 , . . ., c n represent drought classes corresponding to their transient probabilities matrix.
(2) Construction of transition probability matrix: In this step, we classify SPTI drought index with estimated one-month time scale according to the classification criteria (see Table 1).
Furthermore, let Y t ij be the number of transitions from the state S i to S j through t steps in time series length of drought classes X k calculated from one-month time scale. Here, the transition probabilities for various time steps and various drought classes can be obtained by the following equation: where t represents the order of the Markov chain. Here, the transition probability matrix for various existing drought classes at the previous t time step is represented as (3) Interrater reliability measures as weights: Let p ij denote the proportion of drought classes i and j determined by the SPTI at lag t − 1, where i and j represent time series on drought classes and t represents time point. en, the weighted Kappa at time t lag as a measure of association for ordinal categorical sequence is defined as where and where w ij is the squared weighted function in Cohen Kappa [35,36] as suggested by Robieson [37]and King and Chinchilli [38] and p i and p j represent the marginal proportion that assigned to the drought classes i and j. In this study, the formula of weighted Kappa is modified on the same rationale of autocorrelation. We used irr [39] R package to compute the values of weighted kappa at various time lags.
(4) Standardization of weights: e weights for the weighted Markov chain model are computed by standardizing Kappa coefficient K wt computed by the following equation: At this moment, the time step for weighted Kappa is decided according to the steady state nature of the transition probability matrix. If transition probability matrix approaches their steady state at s time point, then, we calculate weighted Kappa from 1 to s steps accordingly.

(5) Prediction
In this step, we assume recent past states of drought classification states as an initial drought class and combine it with the row vectors of their corresponding transition probability matrix. Here, the state transition probability vectors can be expressed in the following form.
where i represents the drought classes and t represents the order of Markov chain. Furthermore, those transition probability vectors that are in acceding power for all the previous candidate of drought classes are selected. e following mth order transition probability matrix shows how one can understand the above stated argument: (1) . . pξm (1) pλ1 (2) pλ2 (2) . . pλm (2) .
Here, ζ, λ, and ρ show the previous candidate drought classes and m represents the order of Markov chain corresponding to each candidate drought classes. Finally, by Equation (10), we assigned the weights to each vector of candidate drought classes and get the predicted probabilities for each drought class. ose drought classes which have a maximum prediction probability max P i ∈ S are then selected as predicted drought classes. Additionally, by iterating this algorithm, we can forecast n-time drought classes under the WMC framework.
Amalgamation of the proposed weighting scheme with SPTI-based historical drought classification is validated based on five meteorological stations located in various regions of Pakistan. We used secondary data on monthly total precipitation and mean temperature data to illustrate WMC based on the prediction process. ese datasets were obtained from the Karachi Data Processing Center through Pakistan Meteorological Department. A brief description of the study area and the application of the proposed framework for one-step ahead prediction of drought are provided in the following section.

Study Area.
Illustration of the proposed weighting scheme accomplished for the five meteorological stations of Pakistan includes Astor, Chilas, Cherat, Skardu, and Peshawar. Figure 1 shows the location map of the study area. ese stations have high variability in rainfall throughout the season. In each season, some of the stations are continuing to bear extremely vulnerable drought conditions. e drought has become a recurrent phenomenon in the country. In the recent decade, due to severe drought hazard, the economic system of the country was badly disturbed. Most parts of the country are arid to semiarid, with large spatial variability in the temperature, except the southern slopes of the Himalayas and the submountain region where the annual rainfall ranges from 760 mm to 2000 mm [40]. Pakistan has four well-marked seasons: cold, from November to February; premonsoon (hot), from March to mid of June; monsoon, from mid of June to mid of September; postmonsoon, from mid of September to October [41]. Summer season is extremely hot and the relative humidity ranges from 25% to 50%. e major part of Pakistan is arid to semiarid with large spatial variability in the temperature. In recent decades, several authors had been working to explore the geographical and hydrological importance of these stations. Awan [42] and Archer and Fowler [43] explored and inferred different climatic variables in terms of regression, spatial correlation, and temporal variation. Ahmad et al. [44] evaluated the significance of these mountainous areas that have a substantial potential in hydropower production and water resources. Ali et al. [26] compared the performance of SPTI with SPI and SPEI using time series data on precipitation and temperature on these stations. We applied our proposed model on long-term time series data monthly precipitations, minimum and maximum rainfall that was recorded during January 1955 to December 2017. e data were collected from Karachi Data Processing Center (KDPC) through Pakistan Meteorological Department (PMD).
is dataset fulfills the WMO requirements, where errors, scrutiny, tabulation, and quality control are done by KDPC http://www.pmd.gov.pk/rmc/RMCK /Services_Climatology.html. e following two steps describe the detailed procedure for the estimation of SPTI. e first step consists on the searching of appropriate probability distributions of DAI as suggested by Stagge et al. [45]. erefore, the entire computational procedure of SPTI values is based on varying probability model for each station. Consequently, the estimation procedure consists of the searching of appropriate candidate distribution using Kolmogorov-Smirnov and Chi-Square, Anderson-Darling tests at the most commonly used level of significance � 0.5 by using easyfit software [46].
In the second step, several parameter estimation methods (method of moments, method of maximum likelihood estimation, and method of L-moments) are incorporated using R package lmom [47]. Probability distributions that have minimal value of the Akaike information criteria (AIC) is then standardized to obtain temporal values of each index accordingly. Figures 2 and 3 represent the fitted probability distribution and their corresponding temporal values of SPTI for Astor and Cherat stations, respectively. e resulting values of SPTI are classified according to its classification criteria. To see the exploratory behavior of various drought classes, Figures 4 and 5 represent the cumulative frequencies of drought classes and its transition behavior of moving one drought class to another at Astor observatory. In this station, most of the month continued to bear near-normal weather conditions; however, as compared with other drought categories, extremely dry and severe dry drought classes are quite high.

Results.
To test and infer the proposed framework of WMC-based prediction, we first compute transition probability matrix at various order form historical classifications of drought classes. In the current research, we use Markovian chain [48] R package to construct the transition probability matrices for all the stations. Secondly, weights at various lags are computed from ordinal categorical data on historical classification of drought classes by using Equations (4) and (7). To illustrate the steps associated with proposed framework, we provide the stepwise numerical results of Astor station. erefore, Table 2 is especially prepared to show the value of Kappa associated with weights that are computed from the temporal classification of ordinal drought classes for Astor station. To predict future drought class, the original data on drought classes from June 2017 to December 2017 is arranged in chronological order. For example, June 2017 to December 2017, each month bears near normal situation. ese drought classes are taken from the original classification of the SPTI drought index. To infer the probabilities of next drought classes, transition probability vector for each order is organized in matrix form. Table 3 shows the transition probability matrix in varying order with corresponding weights.
In the next step, according to the Equation (10), the weighted sums of the probabilities are computed for each drought class. In this numerical example, near normal drought class receives a maximum probability of occurrences (P � 0.7146) in January 2018. e actual drought category is also near normal. Hence, the method performs correct prediction. However, the next tentative class is moderately wet with a probability of 0.1146. Following Zhou et al. [16] and Zhang et al. [49], by taking predicted drought class as a reference category, the whole process may iterate to predict drought classes for March 2018 and so forth. Here, interrater reliability measure Kappa playing a role to adjust the long run convergence error in the Markov chain.
In line with Astor station, numerical investigations are carried out for Skardu, Chilas, Cherat, and Peshawar stations. A visual representation of one-step transition probability matrix can be seen in Figure 6, where the temporal profiles of drought classes in Peshawar and Cherat are explored. In these stations, each drought class has a high probability to transit in near-normal drought class. To adjust the temporal behavior of the Markov chain, it is assumed that by assigning appropriate weights to each drought classification, accurate forecasting of one or n month ahead may conclude under the weighted Markov chain framework. erefore, accuracy of the proposed model is assessed by cross-validation of the predicted drought class with original classification. Consequently, we left January 2018 for the validation phase of the proposed framework for all the stations. Table 4 shows the values of squared Kappa with corresponding P values in each time lag, its standardized values (weights), and the one-month ahead predicted probabilities of each drought class, where Chilas station has a high probability (P � 0.4869) of near-normal drought class on January 2018. In the same way, Cherat and Peshawar also have the same drought classification with probabilities 0.6948 and 0.6623, respectively. Since in these stations, the observed quantities of rainfall and the historical time series of rainfall quantities are quite high in December and January. Moreover, the original series of SPTI drought classes depicted wet classes for these two months in all stations. Contrary to the near normal drought class, Skardu observatory will bear severe drought class with a probability of 0.5003.

Discussion
is paper provides a new procedure to handle the prediction problem of ordinal categorical series of drought classes determined by SPTI drought index. For assessing the proposed method, we took five meteorological stations located in different climatology of Pakistan (see Figure 1). In this research, time series data of rainfall and temperature ranges from 1955 to 2017 recorded at monthly time scale were used to classify according to the classification criterion given in Ali et al. [26]. By assuming each temporal series of drought classes as a first-order Markov chain, the current research employed Markovian chain [48] R package to construct the transition probability matrices. According to the setting of WMC, the proposed weighted schemes were used to predict future drought condition of all the stations. We provide stepwise procedure for Astor station (see Table 2 Advances in Meteorology and 3). However, prediction results are given for all the stations (see Table 4).
For assessing the consistency of the proposed method, we compared our prediction results with the steady state probabilities of each drought class. ese long-term probabilities can also be viewed to cross validate the observed probabilities. It is observed that, in Chilas, Cherat, and Peshawar, the predicted drought classes are consistent with its long-term probabilities. However, in Skardu, a significant difference is observed, where long-term probability of nearnormal drought class is 0.0563 and the predicted probability is 0.2483. is reflects the appropriateness of the proposed weighting scheme for ordinal classification of discrete stochastic process.
In summation, outcomes associated with this research show that the proposed weighting scheme may incorporate to adjust the structure of traditional Markov chain for shortterm prediction. Additionally, our detailed analysis has also proved the suitability using interrater reliability instead of autocorrelation, as a weight in the WMC model. erefore, trend from high to low accuracy can be controlled by adjusting the structural behavior of transition probability vectors from the proposed weighting scheme. However, the limitation of the proposed methods is not to consider the nonstationary behavior of Markov chain. Moreover, in the computations, the study assumed each Markov chain as first-order Markov process.

Conclusion
Prediction and forecasting play a very important role, especially in early warning situations. Consequently, accurate and precise techniques of drought forecasting may reduce their severe effect by making effective drought mitigation policies. In this article, the SPTI drought index being a more comprehensive drought monitoring    Advances in Meteorology procedure is used to classify historical monthly drought profile. Outcomes show that by introducing standardized squared weighted Kappa as a weight, the research suggests a new way to get adjusted prediction probabilities under WMC framework. Furthermore, it is observed that the advantage of n step forecasting can be achieved by just changing the transition probability vector and rearranging vectors of weights. erefore, among numerous other studies and forecasting framework, the uniqueness of this research is to introduce ordinal measure of association at various lags in WMC-based prediction method. Consequently, by using SPTI or other multiscalar drought indices such as SPI and SPEI, where meteorological stations are characterized monthly ordinal drought classification, it is more reasonable to use ordinal measure of association, instead of correlation.

Data Availability
e data used to support the findings of this study are available from the corresponding author upon request.
Ethical Approval e manuscript is prepared in accordance with the ethical standards of the responsible committee on human

Conflicts of Interest
e authors declare that there are no conflicts of interest regarding the publication of this paper.