Abstract

Satellite-based real-time and post-real-time precipitation estimates of Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA-3B42) were evaluated during an extreme heavy precipitation event (on 28–30 July 2010) over Swat River Basin and adjacent areas in Hindukush Region. Observations of 15 rain gauging stations were used for the evaluation of TMPA products. Results showed that the spatial pattern of precipitation in the event was generally captured by post-real-time product (3B42V7) but misplaced by real-time product (3B42RT), witnessed by a high spatial correlation coefficient for 3B42V7 (CC = 0.87) and low spatial correlation coefficient for 3B42RT (CC = 0.20). The temporal variation of the storm precipitation was not well captured by both TMPA products. 3B42V7 product underestimated the storm accumulated precipitation by 32.15%, while underestimation by 3B42RT was 66.73%. Based on the findings of this study, we suggest that the latest TMPA-based precipitation products, 3B42RT and 3B42V7, might not be able to perform well during extreme precipitation events, particularly in complex terrain regions like Hindukush Mountains. Therefore, cautions should be considered while using 3B42RT and 3B42V7 as input data source for the modelling, forecasting, and monitoring of floods and potential landslides in Hindukush Region.

1. Introduction

Extreme precipitation events are very common in Pakistan. The monsoon currents developed on 24 July 2010, in the Bay of Bengal, and reached the northwestern region of Pakistan on the 27th of July 2010, which caused unprecedented precipitation event. This unprecedented intense event brought the worst flooding of the last 80 years in the region [1]. The storm caused 2,000 deaths and a cumulative direct economic loss of US$ 10 billion. 17,553 villages were destroyed/damaged, and an overall 20% area (160,000 km2) of the country was inundated. It is a matter of immense interest for the benefit of the region to monitor the extreme precipitation events that led to the severe floods and landslides [24].

Acquiring accurate precipitation estimates is one of the key prerequisites for reliable modelling and monitoring of floods. However, for the hydrologists, it has been very difficult to simulate the flash floods over regions where rain gauge networks are not available or very sparse, particularly over complex topography or remote areas. With the availability of real-time and post-real-time satellite precipitation estimates, there are tremendous opportunities for the improvement of hydrological simulations and enhancement of flood forecasting capacity in medium to large river basins, exclusively in the less developed and remote areas [58]. Previously, many researchers have used satellite-based precipitation products for hydrological modelling, drought monitoring, prediction and monitoring of flash floods, and climate-related research because of their global coverage [915]. Several satellite-based precipitation products, utilizing thermal infrared (IR) and/or passive microwave (PMW) sensors for quantitative estimation of precipitation, are available for the research community. Among them, in order to estimate the precipitation at 3-hourly temporal and spatial resolution, the advantages of both IR and PWM sensing techniques are combined in the algorithm of Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA). The upgraded version 7 (V7) of TMPA was released by the National Aeronautics and Space Administration (NASA) Goddard Earth Sciences Data and Information Services Centre (GESDISC) in May 2012. The real-time product, TMPA-3B42RT, was available in October 2012 while gauge adjusted post-real-time product, TMPA-3B42V7, was available in July 2012. These products are available for the period of 17 years (January 1998 to April 2015) and, after a gap of two years, they will continue to be produced through the mid of 2017. The instantaneous availability, high orientation, and calibration of satellite-based precipitation products exposed new horizons for researchers in the understanding and application of this information for regional and global hydrological applications.

Although satellite-based precipitation estimates are readily available, their reliability is still under question because space-based information is often influenced by the atmospheric and/or topographic effects and other technical factors [16]. Moreover, the use of satellite-based precipitation information for flood prediction and monitoring cannot be obtained without evaluating the performance of these estimates [17]. Several researchers have evaluated the performance of satellite-based precipitation products using rain gauge observations over complex topographic regions [18, 19]. Earlier, it was observed that it is essential to evaluate the performance of satellite-based precipitation products by using in situ rain gauge data before the application of these products with great confidence in a specific area [20]. In another study, the performance of satellite-based precipitation estimates over northwestern Europe, including TMPA-3B42RT, has been evaluated [21]. They concluded that the precipitation magnitudes were substantially underestimated by using the satellite data over the most complex geography. In Chinese Mainland, the performance of four high-resolution satellite-based precipitation products including real-time and post-real-time version 7 TMPA products was evaluated by Qin et al. [22]. They reported that the post-real-time TMPA product overestimates the precipitation magnitudes while real-time TMPA estimates agreed well with the rain gauge observations. Prakash et al. [23] compared the satellite-based precipitation estimates of TMPA and Global Precipitation Management (GPM) with rain gauge observations to evaluate the performance of these products during heavy precipitation events. They reported that the TMPA products overestimate the heavy precipitation events as compared to GPM. Chen et al. [24] evaluated the performance of CMORPH and PERSIANN-CCS satellite-based precipitation products during an extreme storm event of July 21, 2012, over Beijing. They concluded that both satellite-based products underestimated the precipitation magnitudes and also both products failed to capture the temporal variation of storm precipitation. A few number of studies have reported the performance evaluation of upgraded TMPA products during extreme precipitation events. In this regard, Huang et al. [25] evaluated the performance of real-time and post-real-time TMPA products during the extreme precipitation event of July 2012 in Beijing and concluded that both latest TMPA products still had limitations. No particular study was carried out to evaluate the performance of the latest TMPA precipitation products during the extreme precipitation events over Hindukush mountainous region. Therefore, this study will fill the gap of this research. The purpose of this study is to evaluate the performance of real-time and post-real-time version 7 TMPA precipitation products for the extreme precipitation event of 28–30 July 2010 over Swat River Basin situated in the complex terrain mountainous region of Hindukush, Pakistan. This paper is organized as follows. In Section 2, case study specifications are described. Datasets and methods to analyse the characteristics and error quantification for the satellite-based precipitation estimates for the extreme event of 28–30 July 2010, (from 00:00 UTC 28 July to 00:00 UTC 31 July 2010) are described in Section 3. Section 4 presents the results and discussion, followed by concluding remarks in Section 5.

2. Case Study Specifications

This study was conducted for a particular basin, Swat River Basin (14039 km2), nested within the complex topography of Hindukush Mountains. The study area lies in the northern region of Pakistan, ranging from 70°59′E to 72°47′E and from 34°20′N to 35°56′N (Figure 1). The highest altitude within the study area is 5,920 meters above mean sea level (henceforth m a.m.s.l.) and the lowest is 375 m a.m.s.l.; the average altitude is 2180 m a.s.l. Vegetation can be seen mostly between 1,800 m a.s.l. and 3,400 m a.s.l., and glaciers are visible above the altitude of 4,000 m a.s.l. Meteorology of the area suggests that the average annual precipitation over the entire basin ranges from 375 mm to 1,250 mm. Precipitation is mostly concentrated in two seasons, winter (January to March) and summer (July to September), that is, westerlies and monsoon. Considerably high precipitation occurs during winter, but the intense flood generating precipitation events only occur during the summer monsoon season. It is an elevated basin and heavy isolated precipitation events in summer are often caused by the orographic lifting of the monsoon air mass arriving from the south to southeast direction [1]. In 2010, the flood in Swat River was experienced due to monsoon precipitation.

Swat River is very important for the economic development of this region. There are two hydroelectric power plants with a combined operative capacity of 123 MW which contribute to the National Grid System of the country. Another hydropower generation project, Mohmand Dam Hydropower Project with an estimated installed capacity of 740 megawatts (MW), is also proposed on this river. Mohmand Dam will be a multipurpose dam, accompanied by the hydroelectric power generation; it will irrigate 15,100 acres of agricultural land and will also protect Charsadda, Peshawar, and Nowshera districts from flash floods, which were severely affected by flooding in 2010 [26].

3. Materials and Methods

3.1. Precipitation Datasets

Catastrophic precipitation storm of 28–30 July 2010, in the northwestern region of Pakistan, was selected for quantitative evaluation of satellite-based precipitation estimates using available in situ rain gauge observations. In the present work, the rain gauge observations of 15 gauging stations (eight within and seven outside of the basin boundary) on three-hourly basis were obtained from Pakistan Meteorological Department (PMD) and Water and Power Development Authority (WAPDA). The real-time and post-real-time TMPA products, at fine resolution which is 3-hourly temporal and spatial, were obtained from open sourced repository at the website of Goddard Space Flight Centre. These products are freely available with quasi-global coverage (50 N-S) to accommodate various needs for a wide range of applications [27].

3.2. Methods

The TMPA-based real-time and post-real-time precipitation estimates for the extreme storm event were compared with rain gauge observations at points (gauging station) and basin levels. The ArealRain Extension in ArcView GIS [28] was used to estimate the gauge-based basin average precipitation. As the locations of the centres of TMPA grid cells ( spatial resolution) and the gauging stations do not coincide with each other, the inverse distance weightage method was used to estimate the 3-hourly satellite precipitation estimates at the locations of gauging stations. Previously, Arias-Hidalgo et al. [29] have used this method to estimate the TMPA estimates at the rain gauge locations. Satellite-based areal average precipitation has been produced from both satellite products by averaging all the pixels that lie within the study area. The performance of both TMPA precipitation products was evaluated by using continuous evaluation indexes (CEI) and categorical indexes (CI), where CEI was applied on both gauging station and whole basin scales accumulated precipitation estimates and CI was applied on precipitation time series at the basin scale. Areal-averaged precipitation over the basin was estimated from rain gauge measurements within and around the basin.

3.2.1. Continuous Evaluation Indexes

The performance of 3B42RT and 3B42V7 precipitation products was evaluated by using five widely used continuous evaluation indexes. Among those indexes, Pearson’s correlation coefficient (CC) was used to assess the scale of agreement between the rain gauge measurements and estimates of TMPA products. The mean error (ME) was selected to evaluate the average difference between satellite and gauge precipitation datasets; the mean absolute error (MAE) was used to find out the average magnitude of the error, while root mean square error (RMSE), which gives more importance to the larger errors as compared to mean absolute error, was used to find out the average error magnitude. Relative bias (BIAS) was calculated to describe the magnitude of the difference between the gauge and satellite estimates. CC and BIAS were dimensionless, while all other parameters were in millimetres (mm). The respective formulas are given bywhere is the total number of pairs of satellite and gauge data; and are the th value of satellite and gauge precipitations data, respectively; and and are the mean values of satellite and gauge data, respectively.

3.2.2. Categorical Indexes

For more precise evaluations of the precipitation time series of TMPA products, three categorical statistical indexes, including the false alarm ratio (FAR), probability of detection (POD), and critical success index (CSI), were calculated to measure the correspondence between the satellite observations and gauge data. POD represents how often the precipitation occurrences are correctly detected by satellite. The FAR denotes the fraction of cases in which the satellite detects the precipitation when actually there is no precipitation. CSI shows the overall fraction of gauge and/or satellite precipitation events that were correctly predicted. No precipitation or precipitation events were identified by the values of precipitation thresholds. The perfect value of FAR was 0 but 1 for each of POD and CSI and their respective formulas are given as follows:where represents the observed precipitation correctly detected; is the observed precipitation not detected; is the precipitation detected but not observed; and , , and are the times of occurrence of the corresponding case.

4. Results and Discussions

4.1. Evaluation of Accumulated Precipitation

Figure 2 shows the three-hourly rain gauge observations and satellite-based precipitation estimates that were accumulated from 00:00 AM on 28 July to 00:00 31 July 2010 to yield storm total precipitation. Kriging interpolation technique was applied to interpolate the accumulated precipitation over the study domain. The interpolated results of gauge accumulated precipitation (Figure 2(a)) show that the heavy precipitation extends from the north to the south of Swat Basin. 3B42V7 captures the intense precipitation that extends from northwest to southeast direction (Figure 2(b)) but generally tried to match spatial pattern of the observed precipitation. 3B42RT misplaced the intense storm extending and showed the extents of most intense precipitation in the middle parts with an increase towards the western region of the study area. Both TMPA products underestimated the precipitation by a wide margin, with maximum precipitation less than 250 mm estimated by 3B42V7 and less than 130 mm captured by 3B42RT.

Comparison of the accumulated precipitation on station and basin levels is shown in Figure 3. 3B42RT significantly underestimated the precipitation at all gauging stations and also at basin scale, while 3B42V7 overestimated the storm precipitation at two gauging stations (Chitral and Drosh) and underestimated it at all other gauging stations and basin level. Quantitative comparisons of areal average precipitation on the basin scale show that 3B42V7 has a good correlation (CC = 0.87), but 3B42RT has a very low correlation (CC = 0.20) with gauge-based areal-averaged precipitation; it is evident that 3B42RT cannot capture well the spatial pattern of precipitation in the study area. Statistical errors (ME, MAE, and RMSE) are high in 3B42RT as compared to 3B42V7 (as shown in Figure 4). Both TMPA products show significant underestimation (32.15% by 3B42V7 and 66.73% by 3B42RT) as compared to gauge observed accumulated precipitation. However, the overall performance of 3B42V7 was better than 3B42RT in order to capture the spatial pattern of precipitation in the study area.

Point-based quantitative comparisons between both satellite precipitation products and gauge-based observations are shown in Table 1. Results showed that 3B42V7 has good CC (best value of 0.95 at Peshawar) with gauge-based observations, whereas 3B42RT has low CC (best value of 0.53 at Dir). These CC values show that 3B42V7 has generally followed the spatial pattern of precipitation during the extreme storm event, but 3B42RT failed to capture the spatial variation of precipitation in the entire study area. The values of BIAS show that both TMPA products, 3B42V7 and 3B42RT, significantly underestimated the storm accumulated precipitation at all gauging stations except Chitral and Drosh gauging stations, where 3B42V7 overestimated the precipitation (estimated best values of BIAS for 3B42V7 are −2.6% at Bala Kot and for 3B42RT are −17.9% at Drosh gauging station).

4.2. Evaluation of Precipitation Time Series

The ability to capture the accurate temporal variation of precipitation is the most important thing for monitoring of flash floods and landslides. Figure 4 presents the time series plots of areal-averaged gauge and satellite-based precipitation estimates, accumulated on the hourly basis in the Swat Basin. The gauge observed precipitation showed that the peak of the 72 hr storm event occurred at the 27th hour and after the 36th hour it decreased dramatically and became less than 1 mm/h by the 39th hour. The 3B42V7-based precipitation generally increased from the first hour to the peak occurring at the 15th hour and then showed a mix of increasing and decreasing trend up to the 42nd hour after that it decreased suddenly to less than 0.5 mm/h by the 45th hour. 3B42RT produced the peak of precipitation at the 57th hour and substantially underestimated the precipitation magnitudes throughout the event. Both satellite-based products failed to capture the peak and temporal variation of precipitation. Both TMPA products underestimate the precipitation rates throughout the storm event.

It was noticed that the gauge observed very heavy precipitation rate in the study area (>13 mm/h) which lasted for three hours. Hong et al. [30] fixed a limit of precipitation intensity-duration threshold for landslides which is 12.45 mm/h for 0.42-hour duration. Both of the satellite-based precipitation products did not exceed the minimum bound of 12.45 mm/hr. This means that if the precipitation estimates of 3B42V7 and 3B42RT are used as an input data to the landslide models, then these datasets might not be able to trigger the debris and landslides.

Figure 5 shows the frequency distribution of hourly precipitation for different precipitation intensities for the areal-averaged precipitation time series. Results show that 3B42V7 slightly underestimates the low-intensity precipitation (less than 1 mm/h), while up to 3 mm/h precipitation intensities were overestimated by 3B42RT. Precipitation intensities between 1 and 6 mm/h were overestimated by 3B42V7, while 3 to 9 mm/h intensities were underestimated by 3B42RT. Both satellite products failed to capture the precipitation above 9 mm/h.

Categorical statistics provides an insight into the performance of the probability of detection, critical success index, and false alarm rate. Figure 6 exhibits that 3B42V7 has maximum (100%) probability of detection for precipitation intensities between 2 and 6 mm/h and it decreases rapidly with the increase of precipitation intensity. Similarly, CSI score of 3B42V7 is high up to 9 mm/h precipitation rate and becomes zero when the precipitation rate is more than 14 mm/h. The 3B42RT has the high probability of detection (>80%) for low precipitation rates (<1 mm/hr), but it starts decreasing dramatically with the increase of precipitation intensity and becomes zero when the precipitation rate is more than 12 mm/h. Results of contingency statistics revealed that 3B42V7 and 3B42RT had very poor performance in order to capture the heavy precipitation rates. Similar results were also observed by the frequency distributions analysis shown in Figure 5.

The poor performance of both TMPA-based products is, maybe, due to the complex topography and associated orographic precipitation process in this region. The algorithms, based on IR, use the threshold values of cloud top temperature for precipitation estimation, but this temperature is too cold in case of orographic clouds which consequently cause the underestimation of orographic precipitations. The scattering of passive microwaves by ice aloft leads to the underestimation of precipitation in PM algorithms. Therefore, IR and PM algorithms used in the satellite-based products resulted in the underestimation of precipitation during the extreme storm event in this region.

5. Summary and Conclusions

The aim of this study was to evaluate the performance of the widely used TMPA products, 3B42RT and 3B42V7, during an extreme heavy precipitation event over Swat River Basin and adjacent areas in Hindukush Mountains. The observations of automatic rain gauge stations used a ground truth for the evaluation of TMPA products. Several graphical and statistical techniques have been employed in conjunction to evaluate the satellite-based products in terms of accumulated, time series precipitation, occurrence frequency, and contingency metrics. The results of this study are summarized as follows.(a)3B42RT failed to capture the spatial pattern of precipitation (CC < 0.25), but 3B42V7 had generally captured the precipitation spatial pattern (CC > 0.80).(b)Both TMPA products failed to follow the temporal variation of observed precipitation.(c)3B42V7 underestimated the areal-averaged precipitation by more than 32.15% and 3B42RT underestimated it by 66.73%.(d)3B42V7 and 3B42RT are unable to detect intense precipitation rates (e.g., >15 mm/h).

Both TMPA products, 3B42V7 and 3B42RT, revealed poor performance during extreme precipitation event in this region. The underestimation of accumulated storm precipitation by both TMPA products was mainly ascribed to complex topography and the orographic effect in this region. The results of this study are consistent with the findings of Huang et al. [25]. These two satellite-based precipitation products have limitations in terms of resolution and accuracy, particularly for such type of heavy precipitation events. Therefore, cautionary measures should be taken while 3B42V7 and 3B42RT are to be applied for hydrological modelling and monitoring of floods and landslides during heavy precipitation events. These findings will also be useful for algorithm developers of Global Precipitation Measuring Mission that was launched in 2014 with more advanced dual-frequency radar on board to provide better spatiotemporal coverage of satellite-based precipitation over the globe.

Competing Interests

The authors declare that there are no competing interests.

Acknowledgments

The present study was carried under the umbrella of Chinese Academy of Sciences and The World Academy of Sciences (CAS-TWAS) President’s Fellowship Program at Cold and Arid Regions Environmental and Engineering Research Institute. The work was also supported by the Ministry of Science and Technology of the People’s Republic of China (Grant no. 2013CBA01808) and the National Natural Science Foundation of China (Grant nos. 41271082 and 41130638). The authors are grateful to the PMD and WAPDA for providing the data. The authors also graciously acknowledge the agencies who have voluntarily offered data online for research facilitation.