Abstract
Using uncertainty quantification techniques, we carry out a sensitivity analysis of a large number (17) of parameters used in the NCAR CAM5 cloud parameterization schemes. The LLNL PSUADE software is used to identify the most sensitive parameters by performing sensitivity analysis. Using Morris One-At-a-Time (MOAT) method, we find that the simulations of global annual mean total precipitation, convective, large-scale precipitation, cloud fractions (total, low, mid, and high), shortwave cloud forcing, longwave cloud forcing, sensible heat flux, and latent heat flux are very sensitive to the threshold-relative-humidity-for-stratiform-low-clouds (\(rhminl)\) and the auto-conversion-size-threshold-for-ice-to-snow \(\left( {dcs} \right).\) The seasonal and regime specific dependence of some parameters in the simulation of precipitation is also found for the global monsoons and storm track regions. Through sensitivity analysis, we find that the Somali jet strength and the tropical easterly jet associated with the south Asian summer monsoon (SASM) show a systematic dependence on \(dcs\) and \(rhminl\). The timing of the withdrawal of SASM over India shows a monotonic increase (delayed withdrawal) with an increase in \(dcs\). Overall, we find that \(rhminl\), \(dcs\), \(ai,\) and \(as\) are the most sensitive cloud parameters and thus are of high priority in the model tuning process, in order to reduce uncertainty in the simulation of past, present, and future climate.
Similar content being viewed by others
Introduction
Reliable projections of future climate change (CC) are of utmost importance for the assessment of impacts and adaptation planning. Quantifying and reducing uncertainties in climate projections are of high priority. In general, ensemble simulations with multiple global climate models (GCMs) or a single model with different parameterizations have been used in the past to characterize uncertainties due to physical and/or dynamical processes1,2,3,4. Insufficient physical understanding, coarse grid resolution, and the resolution dependency of parameterization schemes have limited the ability of GCMs to simulate CC reliably4,5,6,7,8. In GCMs, subgrid-scale processes are parameterized using some physical assumptions and empirically designed parameters. The empirically designed parameters lead to various levels of uncertainties in model simulations9,10.
The process of parameter calibration (or tuning) adjusts the parameter values to better match the simulated climate features with those observed. Parameter values are typically determined from limited measurements (or from theoretical calculations). Tuning becomes more cumbersome when the number of uncertain parameters is too large11. In this situation, researchers use an alternative statistical approach (known as a sensitivity analysis (SA)) to screen out the most sensitive parameters for calibrating GCMs. SA reduces the required number of iterations for parameter tuning, and the computational cost, without affecting the model performance12,13,14,15. SA is broadly categorized into two types-local and global, and it can adopt either a qualitative or quantitative approach16,17,18,19,20,21,22,23. The main difference between local SA (LSA) and global SA (GSA) is that the LSA approach explores the changes of model performance by perturbing one parameter at a time while keeping all other parameters fixed, whereas the GSA approach explores the model performance by perturbing all parameters at the same time. The simplest and most preferred LSA is the differential LSA, which uses partial derivatives at a fixed parameter location as the measure of parametric sensitivity. On the other hand, GSA involves two steps: (a) generating a sample set of parameters within their feasible range using a particular sampling method (e.g., Monte Carlo, Latin Hypercube24 (LH), Orthogonal Array25 (OA), and OA based LH26), and (b) computing the qualitative or quantitative attribution of variation in the simulation of a climate variable to the perturbation in parameter values. Some GSA methods require special sampling techniques. For example, Morris One-At-a-Time (MOAT) uses the Morris sampling technique17, and the Sobol method uses the Saltelli sampling technique13.
However, most of the discussed sampling methods require more than 10,000 simulations to cover the full parametric space and increase exponentially with an increase in the number of uncertain parameters, thus, requiring more computational resources. Therefore, researchers use an alternative cost-effective emulator to estimate the model outputs using a small number of model simulations from a specific sampling technique at the selected points, to minimize the high computing resource demand19,27,28,29,30,31,32,33,34,35,36. In this study, we perform the qualitative SA analysis using the Morris method37,38 due to its computational efficiency. This method is quite efficient in determining the few potentially important ones amongst a large number of selected parameters. However, a drawback of the Morris approach is that it cannot distinguish the non-linear effects of a parameter from the interaction effects between different parameters, and cannot estimate the effect of a parameter in relation to other parameters37.
The effect of deep convection on climate sensitivity has been widely studied for global as well as regional climate simulations by many researchers6,37,38,39,40. The effect of cloud microphysics and macrophysics has also been studied extensively, and its representation in global and regional climate models has been substantially improved23,38,39,41. However, it remains the dominant source of large uncertainty in climate simulations28,31,35,42,43,44. Clouds are centrally important in climate studies to understand the radiative energy budget of the Earth’s atmosphere system, hydrological cycle, and precipitation. For example, low-level clouds play a crucial role in the radiation budget of the Earth by modulating the shortwave cloud radiative forcing, and high clouds play a vital role in the radiation budget by modulating the longwave cloud radiative forcing. However, their proper representation in GCMs has been an unresolved issue45,46,47. Recently, Zelinka et al.48 using CMIP6 models have shown an increase in climate sensitivity due to a weaker response of extratropical cloud cover and water content to a change in surface temperature, and such change is noticed to be linked to cloud parameterizations.
Some of the above studies have carried out SA to quantify uncertainties in the simulation of few global climate variables to cloud-related parameter perturbation but limited only to few parameters. Qian et al.23 have reported that global mean precipitation does not respond linearly and monotonically to the change in some cloud parameters. He et al.39 have shown that increasing the value of ice- and snow-fall speed parameters can lower the value of longwave cloud forcing (LWCF), and a larger value of auto-conversion size threshold for ice to snow (\(dcs)\) can lead to larger LWCF. Sanderson et al.49 have reported that the uncertainty in ice-fall speed can significantly affect climate sensitivity. Zhang et al.37 have reported that changes in threshold relative humidity parameter for high clouds can substantially affect the model performance, and reducing its value can increase the stratiform condensation and decrease atmospheric humidity. Golaz et al.27 have reported that the cloud droplet number limiter (\(cdnl\)) has the largest source of uncertainty in cloud-aerosol interaction. In addition, Bony and Dufresne50 have reported spatially varying cloud feedback and noted the trade cumulus regime to be most important for cloud feedback. Hazra et al.51 have reported a significant bias in the simulation of the meridional tropospheric temperature gradient and vertical moisture distribution due to improper vertical cloud distribution over south Asia, and hence weaker Indian summer monsoon simulation52,53.
It is, therefore, crucial to systematically characterize the sensitivity of climate simulations at global and regional scales during different seasons (especially for different monsoon and storm track regions), as well as the characteristics of South Asian summer monsoon (SASM) to cloud microphysics and macrophysics parameters to reduce uncertainty in climate simulations. The quantification and reduction of uncertainty in climate simulations due to parameter sensitivity over the SASM region are also one of the main objectives of the DST CoE in Climate Modeling, IIT Delhi, India, for the improvement of SASM simulations5,6,7,8,54. In this paper, we examine the GSA for the majority of physical parameters in microphysics and macrophysics parameterizations used in the NCAR CAM5, using MOAT sensitivity analysis for different simulated climate variables.
Results and discussion
Global spatial variance distribution
Figure 1 shows the spatial variance distribution of annual (ANN), June–August (JJA), and December-February (DJF) mean precipitation (total, convective, and large-scale), and cloud fraction (low, medium, and high) from 180 model simulations. The variance in each of the different variables shown in Fig. 1 is a measure of the variability in the 180 simulations performed by perturbing the parameters within their upper and lower bounds. For the total precipitation (PRECT), large variance occurs over the tropics, South Pacific Convergence Zone (SPCZ), South America, Central Africa, and Himalaya during ANN (Fig. 1a). Qian et al.23 have also noticed large variance over the tropical regions during ANN from the perturbation of cloud and aerosol related parameters. On a seasonal scale, the variance in PRECT is relatively higher (~ 2 times) than that for ANN over the regions mentioned above, and over the Indian land, Indian ocean, eastern China, and subtropical northwestern Pacific region during JJA, and the subtropical northeastern Pacific and Atlantic stratus region during DJF (Fig. 1b,c). For the convective precipitation (PRECC), the region of large variance for ANN, DJF, and JJA is similar to PRECT, except over the subtropical Pacific and Atlantic region (in all periods) and the subtropical western Indian ocean (in DJF), where the large variance occurs in large-scale precipitation (PRECL) (Fig. 1d–i). Also, PRECC and PRECL are the primary contributors of PRECT over the tropical and subtropical regions, respectively8,55.
For the cloud fraction, large variance in low-level clouds (CLDLOW) occurs over the tropical oceanic and Arctic regions, and moderate to small variance occurs over the global continental land areas for ANN32, JJA, and DJF (Fig. 1j–l). It is to be noted that CLDLOW over the oceanic region is sensitive to the SST, but this study uses prescribed climatological SST and hence coupled model simulations could show somewhat different patterns. For medium-level clouds (CLDMED), large variance occurs over the equatorial region and small to moderate over the higher latitudes across the different periods (Fig. 1m–o). For high-level clouds (CLDHGH), the pattern of variance (Fig. 1p–r) over the tropical regions is similar to CLDMED; however, its magnitude over the tropical region is slightly higher than CLDMED and CLDLOW. In general, CLDHGH and CLDLOW contribute almost equally to the total cloud (CLDTOT), in line with the findings of Kay et al.56.
In addition, large variance in shortwave cloud forcing (SWCF) occurs over the tropical oceanic region and small to moderate over the continental land areas, with highest over the eastern Pacific, Atlantic, and Indian Ocean during ANN. The seasonal SWCF variance follows the sun seasonal migration (i.e., it is highest in JJA over the northern hemisphere’s oceanic region from 10° S to 40° N, and in DJF over the southern hemisphere’s oceanic region from 10° N to 40° S) (Fig. 2a–c). The smaller SWCF variance over land than the oceanic region is also reported from SA of cloud parameters in Lin et al.57 and Cloud Unified By Binormals (CLUBB) parameters in Guo et al.32 during ANN. The large SWCF over the subtropical region has been reported in previous studies due to persistent low-level stratus clouds58, and the SWCF bias over that region is reported to be a serious concern in existing CMIP5 models, and hence the unsatisfactory simulation of mid-latitude westerly jet59. Further, large variance in longwave cloud forcing (LWCF) occurs over the inter-tropical convergence zone (ITCZ), similar to the large PRECC variance region across different periods (Fig. 2d–f). Ardanuy et al.58 have reported that the large LWCF variability over the ITCZ region could be due to the high sensitivity of high-level tropical clouds associated with deep convection (Fig. 1).
Sensitivity analysis for global climate simulations
Spatial distribution of relative importance
Figure 3 shows the spatial distribution of relative importance (RI) of 17 uncertain parameters from the MOAT sensitivity analysis in the simulation of mean annual PRECT. We find highest RI of—(a) \(rhminl\) over tropical oceanic and subtropical stratus region, (b) \(dcs\) over SPCZ, North America, Europe, and northwestern Asia, (c) \(as\) over Indo-Pacific warm pool and northwestern Pacific storm tracks region, and (d) \(ai\) over the Arctic region, and northern parts of the Arabian Sea and Bay of Bengal (BoB). Some parameters show moderate RI, such as \(dp1\) over the land areas of South America, Asia, Africa, and over the oceanic region of southern subtropical and equatorial Pacific, and \(wsub\) over Central Asia. We also find parameters which show lesser spatial RI for ANN, but show seasonal dependence, such as, (a) \(cdnl\) shows highest RI over the northeastern Pacific region, and moderate over South America and South Africa during JJA and northeastern Asia during DJF, (b) \(dp2\) shows higher RI over northcentral Pacific during DJF, and (c) \(ecr\) shows highest RI over the southern subtropical Pacific region during JJA (Supp. Figs. S1, S2).
Some of the most sensitive parameters in the annual mean spatial PRECT simulation reported here agree well with previous findings on SA. For example, Qian et al.23 have reported that the largest uncertainty in PRECT simulation over the oceanic region is primarily controlled by \(rhminl\) and \(dcs\). He and Posselt39 have shown \(dcs\), \(ai\), and \(rhminl\) as the most sensitive parameters in the simulation of tropical cyclones. Covey et al.38 have also reported large sensitivity of \(rhminl\) in global mean PRECT simulation. Plausible physical mechanisms through which the most sensitive parameters influence the annual and seasonal mean PRECT simulation and other important global climate variables are discussed in “Impact of parameters to global climate simulations” section.
RI of parameters on simulation of important climatic variables
In this section, we first discuss the RI of specific parameters on simulation of important climatic variables at the global scale, monsoon regions, and storm track regions during ANN, JJA and DJF (see Table 1 list of variables), and then the plausible mechanisms through which these variables get affected. In this regard, from Fig. 4, we find the global mean PRECT simulation is most sensitive to parameters that reported highly sensitive in spatial PRECT pattern23,37 (Fig. 3). However, PRECC and PRECL simulation are highly sensitive to (\(rhminl, dcs, ai, as, dp1)\), and (\(dcs, rhminl, ai, as, dp1)\), respectively. Please note in the text the sensitivity of parameters is discussed in decreasing order of sensitivity. Further, CLDLOW, CLDMED, CLDHGH, and CLDTOT simulation is most sensitive to \(\left( {rhminl} \right)\)37, (\(dp1,dcs)\), (\(ai, dcs)\) and \(\left( {rhminl, dcs, ai} \right)\), respectively, across the different periods. The large sensitivity of \(rhminl\) in CLDLOW simulation was also reported in Zhang et al.20. The SWCF, LWCF, latent heat flux (LHFLX), and sensible heat flux (SHFLX) simulation is most sensitive to \(\left( {rhminl} \right)\), (\(dcs, ai, as)\), \(\left( {rhminl} \right)\) and \(\left( {rhminl} \right)\) during all periods, respectively. The outgoing longwave flux (FLUT) is highly sensitive to \(\left( {dcs, ai, as} \right)\) during JJA and ANN, while it becomes slightly less sensitive to (\(as)\) during DJF. Furthermore, from Fig. 4, we notice that the simulation of surface air temperature (TAS) is most sensitive to (\(dcs\), \(rhminl\), \(cdnl\), \(sh2\)) during JJA, to (\(cdnl\), \(as\), \(sh2)\) during DJF, and to (\(rhminl\), \(dcs, ai)\) during ANN.
The RI of specific parameters on global climate simulation seen in Fig. 4 can be better understood in Fig. 5. In general, parameters with a large value of modified means (µ) are considered to have large main effects, and parameters with a large value of standard deviation (σ) are considered to have large interactive effects (i.e., interactions with other parameters38). However, parameters with a small value of µ and σ are considered less sensitive, and parameters with a large value of µ and σ are considered most sensitive (which is usually referred to as RI60). Thus, we find that for PRECT simulation, (\(rhminl\), \(dcs\), \( ai\), \(as\)) are most sensitive, with very large main and interactive effects during all periods. Morris results also show few parameters, such as collection efficiency of ice aggregation (\(eii\)), deep convection cloud fraction (\(dp1\)), and the threshold relative humidity parameter for high clouds (\(rhminh)\) with small to moderate level of sensitivity to PRECT simulation, and rest are highly insensitive. The spatial patterns of main and interactive effects of all parameters in PRECT simulation are also shown in Supp. Figs. S3 and S4.
We also report the seasonal and regime-specific dependence of some parameters for the monsoon and storm track regions (see Table 2 for latitude and longitude details), such as local summer precipitation over the monsoon region of India, Australia, North Africa, South America and the storm track region of BoB are most sensitive to \(dp1\). In contrast, the local winter precipitation over—India is more sensitive to \(wsub\), Australia is more sensitive to \(dcs\), North Africa and South America are more sensitive to \(cdnl\) (Fig. 6). The western Pacific storm track region also shows seasonal dependence; it is more sensitive to \(cdnl\) in JJA, whereas more sensitive to \(wsub\) in DJF. The large sensitivity of \(dp1\) over the monsoon region is evident due to the large convective activity during the summer period52,61,62. However, irrespective of the regions and seasons, CLDLOW and CLDHGH are most sensitive to \(rhminl\) and \(ai\), respectively (Fig. 6).
Impact of parameters to global climate simulations
Furthermore, in response to the perturbation of various important parameters, we present the global annual mean variation of different climatic variables in Figs. 7 and 8. We find PRECT to decrease monotonically from ~ 3.15 to 2.95 mm/day in response to increase in \(rhminl\), and increase monotonically from ~ 3.0 to 3.15 mm/day in response to an increase in \( ai\), which is in line with the findings of Qian et al.23 (Fig. 7). Since \(rhminl\) directly affects the amount of stratiform low cloud, increased \(rhminl\) decreases the CLDLOW (from ~ 50 to ~ 35%), which then lowers the SWCF (from ~ − 65 to − 45 W/m2) (Fig. 8). The linear decrease in LHFLX (from ~ 92 to 86 W/m2) in response to an increase in \(rhminl\) can be seen as a result of an increase in near-surface (2-m) specific humidity. The increase in near-surface specific humidity with an increase in \(rhminl\) could be linked to the fact that increasing the \(rhminl\) makes it difficult for moisture to precipitate out in the form of stratiform precipitation (PRECL), and hence leading to a buildup of low-level moisture. The decrease in PRECL with an increase in \(rhminl\) can be seen in Fig. 7. The increase in near-surface specific humidity along with an increase in relative humidity (since TAS does not change much with \(rhminl\)) is causing a reduction in the surface evaporation (could be seen from the decrease in LHFLX) (Fig. 8). The linear decrease in liquid water path (LWP) with an increase in \(rhminl\) is also found in some previous studies23,33,34 (Fig. 7). In line with the findings of Lin et al.57, the decrease in PRECC to an increase in \(rhminl\) is also seen by indirectly affecting the stability of the low-level atmosphere and hence the convection (Fig. 7).
We find opposite responses of \(dcs\) and \(ai\), and both show a large response to CLDHGH. In general, the increase in \(dcs\) leads to lesser conversion of ice to snow, so more ice clouds remain in the upper troposphere39, and hence more ice water path (IWP) and LWCF. Since the increase in ice clouds makes the atmosphere more stable, there is a reduction in convective activity, and hence, a decrease in PRECC and PRECT. The increase in \(ai\), however, leads more ice particles to fall, and therefore a decrease in CLDHGH, which then lowers LWCF and IWP64. As a result of the reduction in LWCF, TAS decreases mildly due to reduced greenhouse effect33,49,58. Falling of more ice with increasing \(ai\) causes more precipitation (PRECT and PRECC), most likely due to increased convective instability65,66. The effect of \(dcs\) and \(ai\) on SWCF is small and non-linear, in line to the response of \(as\), which acts quite similar to \(ai\), but for snow.
In addition, we also find non-monotonic behavior of \(cdnl\), which, in general, increases cloud droplet number concentration with increasing \(cdnl\) through the increased activation of smaller aerosol particles27,67. The strong response of \(cdnl\) is found in the simulation of CLDLOW and hence, SWCF, such that the global mean annual SWCF increases with a decrease in \(cdnl\) and vice-versa. An increase in CLDLOW is found consistent with an increase in LWP and PRECL. The response of CLDHGH to \(cdnl\) is minimal, and the same is the case for LWCF. More specifically, \(cdnl\) affects SWCF by increasing the albedo from the increased number of cloud concentration and liquid clouds lifetime. Sensitivity to \(wsub\) perturbations is similar to \(cdnl\), but smaller in amplitude. Since \(cdnl\) and \(wsub\) strongly influence the liquid clouds35, they have a relatively lower impact on TAS than other parameters. We also find the linear response of \(dp1\) to CLDHGH, increasing \(dp1\) increases CLDHGH, which then causes the increase in IWP and LWP, and hence LWCF. The increase in \(dp1\) also increases CLDLOW substantially, and hence SWCF.
Sensitivity analysis for SASM features
RI of parameters on simulation of SASM features
Model biases over South Asia during the summer monsoon are very large, not only in this model but also in many of the CMIP5 models68,69. The spatial precipitation distribution, onset and withdrawal, and interannual and intraseasonal variability are some important SASM features and are not satisfactorily simulated in existing models51,68,69. Previous findings suggest that the skill of SASM simulation is largely dependent on a model’s ability to simulate the strength of the low-level Somali jet (SJS), upper-level tropical easterly jet (TEJ), inter-tropical convergence zone (ITCZ), local Hadley circulation strength (HCS), meridional tropospheric temperature gradient (MTTG), and the easterly vertical shear of zonal wind (ESZW) over the Indian region6,51,52,68. Hence, we further attempt to understand how the sensitive parameters in cloud parameterizations affect the SASM simulation. In this respect, we first find the most sensitive parameters related to some essential features of SASM using MOAT SA and then present the likely physical mechanisms causing such sensitivity.
Figure 9 shows the RI of sensitive parameters on the simulation of monsoon onset, withdrawal, SJS, TEJ, and HCS. SASM onset over India is defined when MTTG changes from negative to positive value on an annual cycle, and vice-versa for the withdrawal date52,70,71. MTTG is calculated by subtracting the vertically (600–200 hPa) averaged air temperature over BOX2 (5° N–15° S; 40°–100° E) from that of BOX1 (5°–35° N; 40°–100° E). We find the SASM onset over India to be highly sensitive to (\(wsub, dcs, dp1, as, rhminl\)), and withdrawal to be highly sensitive to \(\left( {wsub, rhminl,ai, dcs, as, dp1} \right)\). The SJS, defined as the weighed-area-averaged speed over (15° S–15° N; 37.5°–62.5° E)72, is highly sensitive to (\(cdnl\), \(as, ai, dcs, rhminl, dp1\)). Also, the TEJ, defined as the wind speed at 150 hPa along 10° N from 40°–110° E, is highly sensitive to (\(rhminl, dp1, wsub,dcs)\). Further, we find the HCS, defined as the difference in the weighted-area-averaged meridional wind strength between 850 and 200 hPa over (70°–105° E; 5°–30° N)73 is mildly sensitive to (\(dp1,cdnl, eii\)).
Impact of parameters to SASM features
Figure 10 shows the perturbation response for different parameters in the simulation of onset and withdrawal dates, SJS, TEJ, HCS, and some other dynamical features responsible for maintaining SASM. We find that the onset date increases monotonically with \(rhminl\) (up to ~ 5 days), \(dp1\) (up to ~ 4 days), \(as\) (up to ~ 5 days), decreases with \(eii\) (up to ~ 4 days), and responds non-monotonically to \(dcs\), \(ai\), and \(cdnl\). The withdrawal date increases monotonically with \(dcs\) (up to ~ 22 days), \(rhminl\) (up to ~ 15 days), and responds non-monotonically to \(wsub\) and \(cdnl\).
The onset and withdrawal dates, strength, and sustenance of SASM are noted in previous studies to be strongly influenced by MTTG68,70,73,74. In this regard, we find that the MTT (BOX1) is increasing substantially with \(dcs\) (up to ~ 1 °C), and \(rhminl\) (up to ~ 0.5 °C), and decreasing with \(ai\) (up to ~ 1 °C). It shows a non-monotonic response to \(as \) and \( dp1\). We also find that the response of MTT (BOX2) is similar to MTT (BOX1) (Supp. Fig. S5). Hazra et al.51 have reported that the MTTG simulation reliability from GCMs largely depends on the reliability of the simulation of vertical cloud distribution. In line with the results in “Impact of parameters to global climate simulations” section for global annual means, we find that LWCF increases with increase in \(dcs\) and \(dp1\), and decreases with increase in \(ai\) and \(rhminl\) over BOX1 and BOX2 (with different amplitudes of response; Supp. Figs. S5, S6). SWCF also shows a similar response to parameters as noted in LWCF (except for \(rhminl\) over BOX1, and \(dcs\) and \(ai\) over BOX2, that do not show any significant changes). The uneven changes in LWCF and SWCF over BOX1 and BOX2 to parameter perturbations modulate the vertical temperature distribution unevenly over BOX1 and BOX2 and hence change the MTTG simulation, which then affects the onset and withdrawal, and the strength of SASM (Fig. 10).
We further find that SJS monotonically increases with \(dcs\) and \(dp1\), and decreases with \(ai\), and non-monotonically responds to \(as\). TEJ monotonically increases with \(rhminl\), and non-monotonically responds to \(dcs\), \(cdnl\), \(dp1\), and \(wsub\). HCS shows only a mild increase with an increase in \(rhminl\) and \(eii\), and a mild decrease with an increase in \(dp1\), and responds non-monotonically to \(cdnl\). In addition, the ESZW calculated as a difference of wind strength between 850 hPa (EW_850) and 200 hPa (EW_200) over (0°–15° N; 50°–90° E) also influences SJS (Fig. 10). The ESZW strength exceeding 20 m/s during JJAS was reported to be critical for maintaining the SASM52,53. ESZW is affected by the parameter perturbations through the changes in the vertical temperature and cloud distribution. We find that the ESZW monotonically increases with an increase in \(rhminl\) (up to ~ 3 m/s) and non-monotonically responds to \(dp1\) and \(cdnl\). Specifically, we find that EW_850 increases substantially with \(dcs\) (up to ~ 2 m/s), \(rhminl\) (up to ~ 1.5 m/s), and \(dp1\) (up to ~ 1 m/s). However, EW_200hPa decreases substantially with an increase in \(rhminl\), and non-monotonically responds to \(dp1\) and \(cdnl\) (Supp. Fig. S5).
Conclusions
In this study, we have performed the sensitivity analysis of 17 parameters from the cloud microphysics and macrophysics parameterizations used in the NCAR CAM5. Morris method has been used to identify parameters that have large main and interactive effects on the global climate simulation, global monsoons (with a special emphasis on SASM), and storm track regions on an annual and seasonal basis.
We find the highest variability in PRECT over the tropical convective region and moderate variability in PRECT over the subtropical stratiform region, which arise due to the large variance in PRECC and PRECL, respectively, from 180 inter-parameter perturbed simulations8,55. Also, the large variance in LWCF, CLDHGH, CLDMED, total precipitable water (TMQ), LWP, and IWP are found over the large PRECT variance region39,58. The large variance in LWP and IWP over the tropical and subtropical regions could be one of the reasons for the large variance in PRECT simulation32. For the annual mean spatial PRECT simulation, we find the highest spatial RI of the following parameters: \(rhminl, dcs, as, ai, dp1, wsub, and cdnl,\) across the different periods. RI finding reported here is in line with previous studies for some parameters, such as \(rhminl\) and \(dcs\) are reported most sensitive over the tropical regions23, \(dcs\), \(ai\), and \(rhminl\) are reported most sensitive over the western Pacific39, and \(rhminl\) is reported most sensitive over the global region on PRECT simulation38. In addition, we find large main and interactive effects of \(rhminl\), and moderate main and interactive effects of \(dcs\), \(ai\), and \(as\) on PRECT simulation23,37. Parameters \(rhminl\) and \(dcs\) are most sensitive for PRECC and PRECL simulations, respectively.
Simulations of cloud fraction (total, low, mid, and high) are very sensitive to \(rhminl\) and \(dcs\). Zhang et al.20 have also reported the large \(rhminl\) sensitivity and suggested that \(rhminl\) tuning can better simulate the clouds in CAM. Simulation of SWCF and LWCF are most sensitive to \(rhminl\), and \(dcs\) and \(ai\), respectively. Simulation of SHFLX and LHFLX are most sensitive to \(rhminl\) and \(dcs\). Notably, we find seasonal dependence in the sensitivity of some parameters, for example, in the simulation of TAS, \(dcs\) and \(rhminl\) are most sensitive during JJA, whereas \(as\) and \(cdnl\) are most sensitive during DJF. In addition to the seasonal dependence, we find regime specific dependence of some parameters, such as the summer precipitation over the different monsoon and storm track regions are more sensitive to \(dp1\), while the winter precipitation does not show any systematic sensitivity. The large sensitivity of \(dp1\) during the summer period over the monsoon region could be due to the presence of large convective clouds52,61,62,65.
In response to parameter perturbation, we find a monotonic decrease in PRECT with \(rhminl\) due to reduced low-level stratiform and shallow cumulus clouds and hence the reduced LWP and SWCF20,32,33. We find an increase in LWCF and IWP with \(dcs\) as the increase in \(dcs\) leaves more ice clouds at high-level, thereby decreasing the stability of the atmosphere and hence the decrease in PRECC and PRECT. We also find that the response of precipitation simulation to \(ai\) and \(as\) is opposite to \(dcs\)—increase in \(ai\) (\(as\)) causes more ice (snow) particles to fall; thus, it reduces CLDHGH, LWCF, and IWP64,65,66. With the increase in \(cdnl\) and \(wsub\), there is an increase in PRECL and LWP due to an increase in stratiform low clouds and low-level cloud droplet concentration, respectively.
Further, analyzing the SASM simulations, we find that the monsoon onset and withdrawal dates68,69 are highly sensitive to some of the cloud parameters through their considerable influence on MTTG. In general, we find that the sensitivity of MTTG occurs via changes in vertical cloud distribution and cloud radiative forcings51. We find MTTG to be most sensitive to \(dcs\), due to the higher sensitivity of MTT (BOX1) to \(dcs\), as there are more high-level clouds during SASM over BOX1 (Supp. Figs. S5, S6). We find SJS to be most sensitive to \(dcs\). According to Krishnamurti et al.74, SJS is strongly related to the tropospheric temperature over the Indian land (roughly represented by MTT (BOX1)). The increase in \(dcs\), increases MTT (BOX1) by increasing the cloud forcings (Supp. Figs. S5, S6), and hence increases SJS. We also find that ESZW and TEJ are most sensitive to \(rhminl\), and caused by the higher sensitivity of EW_200hPa than EW_850hPa to \(rhminl\) (Supp. Fig. S5). The higher sensitivity of EW_200hPa could be due to high sensitivity in the strength of the Tibetan anticyclone, thus leading to higher sensitivity in the sub-tropical westerly jet. The high sensitivity of EW_200hPa also explains the high sensitivity of the TEJ to \(dcs\). We do not find HCS to show high sensitivity to any of the parameters discussed above.
Thus, through the identification of the most sensitive parameters in the cloud parameterization schemes used in the NCAR CAM5, our study helps prioritize tuning efforts, not only for the model used in this work but also for any global or regional model using similar parameters in their cloud parameterization schemes. Informed tuning efforts complemented by observational constraints to the most sensitive parameters used in climate models will be crucial for reducing parameter-sensitivity induced uncertainty in both historical climate simulations and climate change projections.
Methodology
Model description and simulation details
NCAR CAM5 under the framework of CESM1.2.2 has been used to carry out the model simulations for sensitivity analysis. CAM5 uses the finite volume dynamical core from Lin and Rood75 and Lin76, shallow convection scheme from Park and Bretherton77, deep convection scheme from Zhang-McFarlane78 with modifications to include dilute parcel computations by Neale et al.79, momentum transport by Richter and Rasch80. Also, CAM5 uses the radiation scheme from Iacono et al.81 and Mlawer et al.82, two-moment cloud microphysics scheme from Morrison and Gettelman83, and Gettelman et al.84, cloud macrophysics scheme from Park et al.85, and moist turbulence scheme from Bretherton and Park86. For more details on CAM5 configuration, see Neale et al.87.
We have conducted a set of 180 simulations for 6-year each (a total of 1080 years of model integration) at a horizontal resolution of 0.9° latitude × 1.25° longitude and 30 vertical levels, using prescribed monthly climatological sea surface temperature (SST). The last five years of the simulations are used in this analysis, discarding the first year as spin-up. The average values of the selected climate variables (see Table 1) for each 5-year simulation on annual (ANN) and seasonal (i.e., for June–August (JJA) and December–February (DJF)) time-scales are considered as one sample for ANN, JJA, and DJF, respectively.
Parameters
Parameters from cloud microphysics and macrophysics parameterization schemes are used in this study (see Table 3), and the climate variables used to assess sensitivity are shown in Table 1. Generally, there are many uncertain parameters in cloud physics parameterizations; we choose to highlight the sensitivity analysis for those parameters that are not explored much in the regional and seasonal context. We used 17 parameters: 9 from cloud microphysics and 8 from cloud macrophysics schemes (see Table 3 for lower and upper bound). The 15 parameters (out of 17 parameters) have been chosen from a large set of parameters explored in the existing literature23,33,38,39. The default values, lower, and upper limits of these parameters are taken from previous studies23,39. For the two additional parameters related to shallow cloud fraction, the lower and upper bounds are taken from the 95% interval of high posterior probability from our SCAM5 results (and this range matches to ~ 50% on both sides of the default value).
Morris method based sensitivity analysis
The Morris method based on MOAT sampling17 is used to quantify the elementary (main) effects of the parameters. This method can identify parameters whose effects may be negligible or linear or non-linear (or involved in interactions with other parameters). For each parameter, two global sensitivity measures (µ and σ) are computed, where µ shows the overall influence of the parameter on model output (climate variables) and σ shows higher-order effects (i.e., interactions with other parameters) of the parameter on climate variables. In the Morris method, each input parameter is varied across ‘\(m\)’ levels in the parameter space. The input parameters are selected from set \(\left\{ {0, 1/\left( {m - 1} \right), 2/\left( {m - 1} \right), \ldots , 1} \right\}\) (in our case \(m = 4\)), and a single parameter is perturbed by \(\Delta = \left( {m/2} \right)/\left( {m - 1} \right)\). To compute the elementary effect, let us consider \(k\) parameters (in our case \(k = 17\)), and a random sample \(S_{1} = \left\{ {x_{1} ,x_{2} , \ldots ,x_{k} } \right\}\) and another sample \(S_{2} = \left\{ {x_{1} ,x_{2} , \ldots , x_{i} + \Delta_{i} , \ldots ,x_{k} } \right\}\) by perturbing the ith parameter by \(\Delta_{i}\). The elementary effect of ith parameter \(x_{i }\) is defined as \(E_{i} = \frac{{\left\{ {f\left( {S_{2} } \right) - f\left( {S_{1} } \right)} \right\}}}{{\Delta_{i} }}\), where \(f\) stands for the weighted-area-averaged value of a particular climate variable for which sensitivity effect will be analyzed. However, the \(E_{i}\) computed here has the unit of \(f/\Delta\) (which varies based on the parameter unit and variable unit) and can not be directly used for the comparison and ranking between the variables and other parameters. It is thus normalized according to Covey et al.38 as \(E_{i} = \frac{{\left\{ {f\left( {S_{2} } \right) - f\left( {S_{1} } \right)} \right\}/f\left( {S1} \right)}}{{\Delta /\left( {x_{h} - x_{l} } \right)_{i} }}\), where \(x_{h}\) and \(x_{l}\) refer to the high and low values of a particular parameter range. Further, a third sample \(S_{3} = \left\{ {x_{1} ,x_{2} , \ldots ,x_{i} + \Delta_{i} , \ldots ,x_{j} + \Delta_{j} , \ldots ,x_{k} } \right\}\) is generated by perturbing another parameter from remaining \(k - 1\) parameters \(\left( {j\, {\text{is not equal to}}\, i} \right)\), and by repeating this process until all the parameters are varied, we get \(k + 1\) samples \(\left( {S_{1} ,S_{2} , \ldots ,S_{k + 1} } \right),\) collectively called a single trajectory, and \(k\) elementary effects (\(E_{1} ,E_{2} , \ldots ,E_{k} )\). The above procedure is repeated to get r trajectories. Hence, the total numbers of simulations required to determine the sensitivity of the parameters are \(r*\left( {k + 1} \right)\) samples17,37. Here, we have used \(r = 10\), similar to Zhang et al.37, and hence the total number of simulations to be performed is 180 (i.e., \( 10*\left( {17 + 1} \right)\). Furthermore, \(\mu_{i}\) is defined as the mean of \(\left| {E_{i} } \right|\), and \({\upsigma }_{i}\) as a standard deviation of \(E_{i}\).
Parameters with a large value of \(\mu_{i}\) and \(\sigma_{i}\) are considered to be most sensitive with large main and interactive effects. Once \(\mu_{i}\) and \(\sigma_{i}\) are computed for each parameter, the relative importance (RI) measure of a given parameter is calculated by combining \(\mu_{i}\) and \(\sigma_{i}\) effects in a relationship by \(\beta_{i} = \frac{{\sqrt {\mu_{i}^{2} + \sigma_{i}^{2} } }}{s}\), with equal weightage to \(\mu_{i}\) and \(\sigma_{i}\), where ‘\(s\)’ is the standard deviation of \(\sqrt {\mu_{i}^{2} + \sigma_{i}^{2} }\) values of different parameters (here ‘i’ corresponds to a particular parameter), and is used to normalize the importance of different model parameters60.
To perform the Morris sensitivity analysis, we use a newly developed software package by Tong88. It is known as the non-intrusive Problem-Solving environment for Uncertainty Analysis and Design Exploration (PSUADE). This software package has a variety of tools to conduct global SA, uncertainty analysis, and parameter calibration with a large set of uncertain parameters. PSUADE has a variety of (~ 15) sampling methods, including the Morris sampling technique, and provides users with the option to choose any method from ~ 10 in-built global SA techniques (where MOAT GSA is one of them). This software package for GSA and uncertainty quantification has been widely used since its development89,90,91,92.
Data availability
All the data used in this study is in the public domain and can be downloaded freely.
References
Allen, M. R., Stott, P. A., Mitchell, J. F., Schnur, R. & Delworth, T. L. Quantifying the uncertainty in forecasts of anthropogenic climate change. Nature 407, 617–620 (2000).
Stainforth, et al. Uncertainty in predictions of climate response to rising levels or greenhouse gases. Nature 433, 403–406 (2005).
Lopez, A. et al. Two approaches to quantifying uncertainty in global temperature changes. J. Clim. 19(19), 4785–4796. https://doi.org/10.1175/JCLI3895.1 (2006).
Neelin, J. D., Bracco, A., Luo, H., McWilliams, J. C. & Meyerson, J. E. Considerations for parameter optimization and sensitivity in climate models. Proc. Natl. Acad. Sci. 107, 21349–21354 (2006).
Mishra, S. K., Anand, A., Fasullo, J. & Bhagat, S. Importance of the resolution of surface topography in indian monsoon simulation. J. Clim. 31, 4879–4898. https://doi.org/10.1175/JCLI-D-17-0324.1 (2018).
Anand, A. et al. Indian summer monsoon simulations: Usefulness of increasing horizontal resolution, manual tuning, and semi-automatic tuning in reducing present-day model biases. Sci. Rep. 8(1), 3522. https://doi.org/10.1038/s41598-018-21865-1 (2018).
Anand, A., Bhowmik, M., Mishra, S. K., Sahany, S. & Reddy, C. V. Response of Indian monsoon to increase of resolution in NCAR-CAM5. Atmos. Res. 221, 12–26. https://doi.org/10.1016/j.atmosres.2019.01.015 (2019).
Pathak, R., Sahany, S., Mishra, S. K. & Dash, S. K. Precipitation biases in CMIP5 models over the south Asian region. Sci. Rep. 9(1), 9589. https://doi.org/10.1038/s41598-019-45907-4 (2019).
Warren, S. G. & Schneider, S. H. Seasonal simulation as a test for uncertainties in the parameterizations of a Budyko-Sellers zonal climate model. J. Atmos. Sci. 36, 1377–1397 (1979).
Li, J. et al. Assessing parameter importance of the common land model based on qualitative and quantitative sensitivity analysis. Hydrol. Earth Syst. Sci. 17, 3279–3293. https://doi.org/10.5194/hess-17-3279-2013 (2013).
Tarantola, A. Inverse Problem Theory and Methods for Model Parameter Estimation 342 (SIAM, Philadelphia, 2005).
Liu, Y., Gupta, H. V., Sorooshian, S., Bastidas, L. A. & Shuttleworth, W. J. Exploring parameter sensitivities of the land surface using a locally coupled land-atmosphere model. J. Geophys. Res. 109, D21101. https://doi.org/10.1029/2004JD004730 (2004).
Saltelli, A. Making best use of model evaluations to compute sensitivity indices. Comput. Phys. Commun. 145(2), 280–297. https://doi.org/10.1016/S0010-4655(02)00280-1 (2002).
Campolongo, F., Cariboni, J. & Saltelli, A. An effective screening design for sensitivity analysis of large models. Environ. Modell. Softw. 22, 1509–1518 (2007).
Borgonovo, E. A new uncertainty importance measure. Reliab. Eng. Syst. Saf. 92, 771–784 (2007).
Sobol, I. M. Quasi-Monte Carlo methods. Progr. Nucl. Energy 24(1–3), 55–61. https://doi.org/10.1016/0149-1970(9090022-W) (1990).
Morris, M. D. Factorial sampling plans for preliminary computational experiments. Technometrics 33(2), 161–174. https://doi.org/10.1080/00401706.1991.10484804 (1991).
Murphy, J. M. et al. Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature 430, 768–772 (2004).
Jackson, C. S. & Huerta, G. Empirical Bayes approach to climate model calibration. Geosci. Model Dev. Discuss. https://doi.org/10.5194/gmd-2016-20 (2016).
Zhang, Y. et al. Regional assessment of the parameter-dependent performance of CAM4 in simulating tropical clouds. Geophys. Res. Lett. 39, L14708. https://doi.org/10.1029/2012GL052184 (2012).
Zou, C.-Z. et al. Recalibration and merging of SSU observations for stratospheric temperature trend studies. J. Geophys. Res. Atmos. 119, 13180–13205. https://doi.org/10.1002/2014JD021603 (2014).
Boyle, J. S. et al. The parametric sensitivity of CAM5’s MJO. J. Geophys. Res. Atmos. https://doi.org/10.1002/2014JD022507 (2015).
Qian, Y. et al. Parametric sensitivity analysis of precipitation at global and local scales in the community atmosphere model CAM5. J. Adv. Model. Earth Syst. 7, 382–411. https://doi.org/10.1002/2014MS000354 (2015).
McKay, M. D., Beckman, R. J. & Conover, W. J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2), 239–245. https://doi.org/10.1080/00401706.2000.10485979 (1979).
Owen, A. B. Orthogonal arrays for computer experiments, integration and visualization. Stat. Sin. 2(2), 439–452 (1992).
Tang, B. Orthogonal array-based latin hypercubes. J. Am. Stat. Assoc. 88(424), 1392–1397. https://doi.org/10.2307/2291282 (1993).
Golaz, J. et al. Sensitivity of the aerosol indirect effect to sub-grid variability in the cloud parameterization of the GFDL atmosphere general circulation model AM3. J. Clim. 24, 3145–3160 (2011).
Lee, L. A., Carslaw, K. S., Pringle, K. J., Mann, G. W. & Spracklen, D. V. Emulation of a complex global aerosol model to quantify sensitivity to uncertain parameters. Atmos. Chem. Phys. 11(23), 12253–12273 (2011).
Sraj, I., Zedler, S. E., Knio, O. M., Jackson, C. S. & Hoteit, I. Polynomial chaos-based Bayesian inference of K-profile parameterization in a general circulation model of the tropical pacific. Mon. Weather Rev. 144(12), 4621–4640 (2016).
Zhu, Q., Xu, X., Gao, C., Ran, Q. H. & Xu, Y. P. Qualitative and quantitative uncertainties in regional rainfall frequency analysis. J. Zhejiang Univ. Sci. A 16(3), 194–203. https://doi.org/10.1631/jzus.A1400123 (2015).
Carslaw, K. S. et al. Large contribution of natural aerosols to uncertainty in indirect forcing. Nature 503(7474), 67–71. https://doi.org/10.1038/nature12674 (2013).
Guo, Z. et al. Parametric behaviors of CLUBB in simulations of low clouds in the community atmosphere model (CAM). J. Adv. Model. Earth Syst. 7, 1005–1025. https://doi.org/10.1002/2014MS000405 (2015).
Yang, B. et al. Uncertainty quantification and parameter tuning in the cam5 zhang-mcfarlane convection scheme and impact of improved convection on the global circulation and climate. J. Geophys. Res. Atmos. 118(2), 395–415 (2013).
Zhang, Y. & Sahinidis, N. V. Uncertainty quantification in CO2 sequestration using surrogate models from polynomial chaos expansion. Ind. Eng. Chem. Res. 52(9), 3121–3132. https://doi.org/10.1021/ie300856p (2013).
Zhao, C. et al. A sensitivity study of radiative fluxes at the top of atmosphere to cloud-microphysics and aerosol parameters in the community atmosphere model CAM5. Atmos. Chem. Phys. 13(21), 10969–10987. https://doi.org/10.5194/acp-13-10969-2013 (2013).
Guo, Z. et al. A sensitivity analysis of cloud properties to CLUBB parameters in the single-column community atmosphere model (SCAM5). J. Adv. Model. Earth Syst. 6, 829–858. https://doi.org/10.1002/2014MS000315 (2014).
Zhang, T. et al. An automatic and effective parameter optimization method for model tuning. Geosci. Model Dev. 8, 3579–3591 (2015).
Covey, C., Lucas, D. D., Tannahill, J., Garaizar, X. & Klein, R. Efficient screening of climate model sensitivity to a large number of perturbed input parameters. J. Adv. Model. Earth Syst. 5(3), 598–610 (2013).
He, F. & Posselt, D. J. Impact of parameterized physical processes on simulated tropical cyclone characteristics in the community atmosphere model. J. Clim. 28, 9857–9872. https://doi.org/10.1175/JCLI-D-15-0255.1 (2015).
Zhang, T. et al. Automatic tuning of the community atmospheric model CAM5.3 by using short-term hindcasts with an improved downhill simplex optimization method. Geosci. Model Dev. 11, 5189–5201. https://doi.org/10.5194/gmd-11-5189-2018 (2018).
Gettelman, A., Kay, J. E. & Shell, K. M. The evolution of climate sensitivity and climate feedbacks in the community atmosphere model. J. Clim. 25(5), 1453–1469. https://doi.org/10.1175/JCLI-D-11-00197.1 (2012).
Lee, L. A., Carslaw, K. S., Pringle, K. J. & Mann, G. W. Mapping the uncertainty in global CCN using emulation. Atmos. Chem. Phys. 12(20), 9739–9751. https://doi.org/10.5194/acp-12-9739-2012 (2012).
Lohmann, U. et al. Cloud microphysics and aerosol indirect effects in the global climate model ECHAM5-HAM. Atmos. Chem. Phys. Discuss. 7(2), 3719–3761 (2007).
Schwartz, S. E. Uncertainty requirements in radiative forcing of climate change. J. Air Waste Manage. Assoc. 54(11), 1351–1359 (2004).
Charney, J. G. Carbon Dioxide and Climate: A Scientific Assessment 22 (National Academy of Science, Washington, DC, 1979).
Hartmann, D. L. et al. The effect of cloud type on Earth’s energy balance: Global analysis. J. Clim. 5, 1281–1304 (1992).
Cahalan, R. F., Ridgway, W., Wiscombe, W. J., Bell, T. L. & Snider, J. B. The albedo of fractal stratocumulus clouds. J. Atmos. Sci. 51(16), 2434–2455. https://doi.org/10.1175/1520-0469(1994)051%3c2434:TAOFSC%3e2.0.CO;2 (1994).
Zelinka, M. D. et al. Causes of higher climate sensitivity inCMIP6 models. Geophys. Res. Lett. https://doi.org/10.1029/2019GL085782 (2020).
Sanderson, B. M., Piani, C., Ingram, W. J., Stone, D. A. & Allen, M. R. Towards constraining climate sensitivity by linear analysis of feedback patterns in thousands of perturbed-physics GCM simulations. Clim. Dyn. 30(2–3), 175–190 (2008).
Bony, S. & Dufresne, J.-L. Marine boundary layer clouds at the heart of tropical cloud feedback uncertainties in climate models. Geophys. Res. Lett. 32, L20806. https://doi.org/10.1029/2005GL023851 (2005).
Hazra, A. et al. Impact of revised cloud microphysical scheme in CFSv2 on the simulation of the Indian summer monsoon. Int. J. Climatol. 35(15), 4738–4755. https://doi.org/10.1002/joc.4320 (2015).
Goswami, B. N. & Xavier, P. K. ENSO control on the south Asian monsoon through the length of the rainy season. Geophys. Res. Lett. 32, L18717 (2005).
Li, C. & Yanai, M. The onset and interannual variability of the asian summer monsoon in relation to land-sea thermal contrast. J. Clim. https://doi.org/10.1175/1520-0442(1996)009%3c0358:TOAIVO%3e2.0.CO;2 (1996).
Dash, S. K. et al. Climate modeling in India: Present status and the way forward. Bull. Am. Meteorol. Soc. 98, 183–188. https://doi.org/10.1175/BAMS-D-16-0322.1 (2017).
Myoung, B. & Nielsen-Gammon, J. W. Sensitivity of monthly convective precipitation to environmental conditions. J. Clim. 23(1), 166–188 (2010).
Kay, J. E. et al. Exposing global cloud biases in the community atmosphere model (CAM) using satellite observations and their corresponding instrument simulators. J. Clim. 25(15), 5190–5207. https://doi.org/10.1175/JCLI-D-11-00469.1 (2012).
Lin, G., Wan, H., Zhang, K., Qian, Y. & Ghan, S. J. Can nudging be used to quantify model sensitivities in precipitation and cloud forcing?. J. Adv. Model. Earth Syst. 8, 1073–1109 (2016).
Ardanuy, P. E., Stowe, L. E., Gruber, A. & Weiss, M. Shortwave, and net cloud-radiative forcing as determined from. J. Geophys. Res. 96(2), 537–549 (1991).
Ceppi, P., Hwang, Y. T., Frierson, D. M. W. & Hartmann, D. L. Southern Hemisphere jet latitude biases in CMIP5 models linked to shortwave cloud forcing. Geophys. Res. Lett. https://doi.org/10.1029/2012GL053115 (2012).
Lu, X., Wang, Y.-P., Ziehn, T. & Dai, Y. An efficient method for global parameter sensitivity analysis and its applications to the Australian community land surface model (CABLE). Agric. For. Meteorol. 182–183, 292–303 (2013).
Tao, W. & Xiaowen, L. The relationship between latent heating, vertical velocity, and precipitation: The impact of aerosol. EGU Gen. Assemb. Conf. Abstracts 17, 2660. https://doi.org/10.1002/2015JD024267 (2015).
Xie, S. et al. Understanding cloud and convective characteristics in version 1 of the E3SM atmosphere model. J. Adv. Model. Earth Syst. 10(10), 2618–2644 (2018).
Bal, P. K., Pathak, R., Mishra, S. K. & Sahany, S. Effects of global warming and solar geoengineering on precipitation seasonality. Environ. Res. Lett. 14, 034011 (2019).
Mitchell, D. L., Rasch, P., Ivanova, D., McFarquhar, G. & Nousiainen, T. Impact of small ice crystal assumptions on ice sedimentation rates in cirrus clouds and GCM simulations. Geophys. Res. Lett. 35(9), 1–5 (2008).
Sun, B., Groisman, P. Y. & Mokhov, I. I. Recent changes in cloud-type frequency and inferred increases in convection over the United States and the former USSR. J. Clim. 14(8), 1864–1880 (2001).
Pistotnik, G., Groenemeijer, P. & Sausen, R. Validation of convective parameters in MPI-ESM decadal hindcasts (1971–2012) against ERA-interim reanalyses. Meteorol. Z. 25(6), 753–766 (2016).
Hoose, C. et al. Constraining cloud droplet number concentration in GCMs suppresses the aerosol indirect effect. Geophys. Res. Lett. 36(12), 1–5 (2009).
Saha, A., Ghosh, S., Sahana, A. S. & Rao, E. P. Failure of CMIP5 climate models in simulating post-1950 decreasing trend of Indian monsoon. Geophys. Res. Lett. 41(20), 7323–7330. https://doi.org/10.1002/2014GL061573 (2014).
Sperber, K. R. et al. The Asian summer monsoon: An intercomparison of CMIP5 vs. CMIP3 simulations of the late 20th century. Clim. Dyn. 41, 2711 (2013).
Xavier, P. K., Marzin, C. & Goswami, B. N. An objective definition of the Indian summer monsoon season and a new perspective on the ENSO–monsoon relationship. Q. J. R. Meteorol. Soc. 133, 749–764 (2007).
Webster, P. J. et al. Monsoons: Processes, predictability and the prospects for prediction. J. Geophys. Res. 103, 14451–14510 (1998).
Wang, H. & Xue, F. Interannual variability of Somali jet and its influences on the inter-hemispheric water vapor transport and on the East Asian summer rainfall (in Chinese). Chin. J. Geophys. 46, 18–25 (2003).
Moetasim, A. et al. Suppression of south Asian summer monsoon precipitation in the 21st century. Geophys. Res. Lett. 36, L01704. https://doi.org/10.1029/2008GL036500 (2009).
Krishnamurti, T. N., Molinari, J. & Pan, H. L. Numerical simulation of the somali jet. J. Atmos. Sci. 33, 2350–2362 (1976).
Lin, S.-J. & Rood, R. B. Multidimensional flux-form semi-Lagrangian transport schemes. Mon. Weather Rev. 124, 2046–2070 (1996).
Lin, S.-J. A “vertically Lagrangian” finite-volume dynamical core for global models. Mon. Weather Rev. 132, 2293–2307 (2004).
Park, S. & Bretherton, C. S. The University of Washington shallow convection and moist turbulence schemes and their impact on climate simulations with the community atmosphere model. J. Clim. 22, 3449–3469 (2009).
Zhang, G. J. & McFarlane, N. A. Sensitivity of climate simulations to the parameterization of cumulus convection in the Canadian climate centre general circulation model. Atmos. Ocean 33, 407–446. https://doi.org/10.1080/07055900.1995.9649539 (1995).
Neale, R. B., Richter, J. H. & Jochum, M. The impact of convection on ENSO: From a delayed oscillator to a series of events. J. Clim 21, 5904–5924 (2008).
Richter, J. H. & Rasch, P. J. Effects of convective momentum transport on the atmospheric circulation in the community atmosphere model, version 3. J. Clim. 21, 1487–1499 (2008).
Iacono, M. J. et al. Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models. J. of Geophys. Res. Atmos. https://doi.org/10.1029/2008JD009944 (2008).
Mlawer, E. J., Taubman, S. J., Brown, P. D., Iacono, M. J. & Clough, S. A. Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave. J. Geophys. Res. Atmos. 102, 16663–16682 (1997).
Morrison, H. & Gettelman, A. A new two-moment bulk stratiform cloud microphysics scheme in the community atmosphere model, version 3 (CAM3). Part I: Description and numerical tests. J. Clim. 21(15), 3642–3659. https://doi.org/10.1175/2008jcli2105.1 (2008).
Gettelman, A. et al. Global simulations of ice nucleation and ice supersaturation with an improved cloud scheme in the community atmosphere model. J. Geophys. Res. 115, D18216. https://doi.org/10.1029/2009JD013797 (2010).
Park, S., Bretherton, C. S. & Rasch, P. J. Integrating cloud processes in the community atmosphere model, version 5. J. Clim. 27, 6821–6856 (2014).
Bretherton, C. S. & Park, S. A new moist turbulence parameterization in the community atmosphere model. J. Clim. 22, 3422–3448 (2009).
Neale, R. B., et al. Description of the NCAR community atmosphere model (CAM 5.0), NCAR Tech. Note NCAR/TN-486+ STR (2010).
Tong, C. PSUADE User’s Manual (Lawrence Livermore National Laboratory, Livermore, 2005).
Tong, C. & Graziani, F. A practical global sensitivity analysis methodology for multi-physics applications. In Computational Methods in Transport: Verification and Validation (ed. Graziani, F.) 277–299 (Springer, Berlin, 2008).
Tong, C. Quantifying Uncertainties of a Soil-Foundation Structure-Interaction System Under Seismic Excitation (Lawrence Livermore National Laboratory, Livermore, 2008).
Snow, M. G. & Bajaj, A. K. Uncertainty Quantification Study for a Comprehensive Electrostatic MEMS Switch Model. PRISM (NNSA Center for Prediction of Reliability, Integrity and Survivability of Microsystems, West Lafayette, 2010).
Gan, Y. et al. A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model. Environ. Model. Softw. 51, 269–285. https://doi.org/10.1016/j.envsoft.2013.09.031 (2014).
Acknowledgements
We are extremely thankful to NCAR for providing the Community Atmosphere Model publicly at https://www.cesm.ucar.edu/models/cesm1.2/cam/, and Lawrence Livermore National Laboratory for providing PSUADE software publicly at https://computing.llnl.gov/projects/psuade-uncertainty-quantification. We are also grateful to the IIT Delhi supercomputing facility (https://supercomputing.iitd.ac.in/) and DST CoE in Climate Modeling at IIT Delhi (RP03350). Ministry of Education, Government of India, is acknowledged for Ph.D. fellowship support to RP. S. Sahany acknowledge partial support from DST Science and Engineering Research Board (grant ECR/2015/000229). Matlab R2018a and NCAR-NCL6.4.0 (https://www.ncl.ucar.edu/) have been used for analysis. The model simulated output datasets used in this study and the codes used for quantifying uncertainty are archived at Mendeley Public Repository and can be found publicly at https://data.mendeley.com/datasets/3w2wxwnn5k/1. Finally, we thank the two anonymous reviewers for their many suggestions that helped to improve the manuscript considerably.
Author information
Authors and Affiliations
Contributions
S.S., S.K.M. and R.P. designed the study and jointly carried out the analysis. R.P. performed model simulations and generated the figures. All authors contributed to writing the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Pathak, R., Sahany, S. & Mishra, S.K. Uncertainty quantification based cloud parameterization sensitivity analysis in the NCAR community atmosphere model. Sci Rep 10, 17499 (2020). https://doi.org/10.1038/s41598-020-74441-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-74441-x
This article is cited by
-
Aircraft observations in a tropical supercluster over the equatorial Indian Ocean during MISO-BOB field campaign
Scientific Reports (2024)
-
Indian summer monsoon simulations in successive generations of the NCAR Community Atmosphere Model
Theoretical and Applied Climatology (2023)
-
GEO-WMS: an improved approach to geoscientific workflow management system on HPC
CCF Transactions on High Performance Computing (2023)
-
A spatial directivity–based sensitivity analysis to farmland quality evaluation in arid areas
Environmental Science and Pollution Research (2022)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.