The Cost Reduction Potential of Demand Response in Balancing Markets from a System Perspective

: Demand response (DR) can potentially provide a cost-e ﬃ cient alternative for balancing the electricity grid by replacing fossil-fuelled power plants for the provision of ﬂ exible capacity. This paper aims to quantify the cost reduction potential of DR from a system perspective. Historical data of balancing markets are studied using regression and average bid price analysis to quantify the e ﬀ ect of the participation of DR resources on the price of ﬂ exible capacity for the provision of balancing reserves by focusing on two case studies in Great Britain and the Netherlands. It is estimated that DR bids are, on average, 35% lower than the market average. The regression analysis concluded that 1% higher participation of DR in balancing markets leads, on average, to a 2.7% lower prices for ﬂ exible capacity. The results verify the hypothesis that ﬂ exible DR capacity is o ﬀ ered at a lower price on balancing markets compared to conventional generation resources, resulting in lower costs for grid operators to balance the grid, thus reducing societal costs for electricity provision and overall emissions through the integration of low-carbon balancing resources.


Introduction
In 2021, the European Union (EU) set the ambitious goal of reaching net-zero greenhouse gas emissions in 2050 [1].To achieve this goal, a shift towards renewable energy sources (RES) has to be made.Wind and solar resources have the highest potential in generating renewable electricity in the EU [2].However, the electricity grid will face significant challenges due to a shift towards RES, such as solar and wind energy, as electricity production will be increasingly intermittent, volatile, and unpredictable.Therefore, one of the main challenges of the energy transition is to constantly maintain the balance between the supply and demand of electricity, as this is essential for a reliable, efficient, and safe operation of the electricity system [3].The traditional way to balance the electricity grid is mainly by adjusting the power output of fossil-fuelled power plants to match the demand.However, the decommissioning of fossil-fuelled power plants is essential for Europe's low-carbon future, and as such, there is a need for alternative flexible resources to balance the electricity grid in the future.Nowadays, there is a growing consensus among scientists, policymakers, and electricity market participants that demand response (DR) is an essential source of flexibility that needs to be developed to maintain a balanced electricity grid in the future [4].In contrast to the traditional way, with DR, the imbalance in the electricity system is solved by adjusting the demand for electricity to match it with the supply [5].With the growing penetration of renewable energy sources in the energy system, DR will play an increasingly important role in balancing the supply and demand of electricity.
In Europe, transmission system operators (TSO) organise and operate single-buyer balancing markets for flexible capacity to balance the grid.In this paper, it is investigated whether DR can reduce costs for balancing the electricity system by having a lower marginal cost than traditional balancing methods.The assumption is that when DR has a lower marginal cost, DR capacity will be offered on the balancing markets for a lower price.With this marginal bidding assumption, it is assumed that the bid price reflects the marginal costs of providing flexible capacity from a particular flexibility source.When more flexible capacity is available for a lower bid price, the price for flexible capacity will decrease.This leads to the hypothesis of this research, that higher participation of DR on balancing markets reduces the settled prices of flexible capacity, and thus the costs incurred by TSOs.Reduced costs for TSOs can lower societal costs for electricity supply.

Literature Review and Research Gap
The economic benefits of DR from a system perspective are often discussed in academic literature.In this section, the academic and grey literature that assess the cost reduction of DR is reviewed.
In a report of the European Commission, it is stated that DR can offer "cheaper and cleaner solutions to balancing the grid" [6].However, the report lacks a detailed research methodology.Strbac [7] assessed a modest economic benefit of DR in system flexibility by comparing the operational costs of DR to those of a gas turbine.Ofgem [8], the energy regulator for Great Britain (GB), similarly evaluated the system cost reduction from DR by comparing its operational costs to those of a power generation plant.Nonetheless, both studies did not explore how the reduced operational costs of DR might lower balancing market prices and consequently decrease balancing costs for grid operators.Koliou et al. [9] investigated the cost reduction of DR for grid operators, concluding that the primary economic advantage of DR is the reduction in infrastructural grid costs due to decreased peak load.However, the paper does study the effect of DR participation on balancing market prices, and is therefore not relevant for testing the hypothesis of this research.
Several studies estimate the economic benefit of DR using a modelling approach.Vlachos and Biskas [10] simulated the costs incurred by grid operators on balancing markets by comparing the cost effectiveness of different balancing market designs for a specific region, including DR resources.Nevertheless, their study did not specifically estimate the effect of the participation of DR on the balancing costs.Dietrich, Latorre, Olmos, and Ramos [11], using a modelling approach, found that implementing DR for grid balancing could reduce system costs and be "economically reasonable" from a system operator's perspective.However, they did not quantify the economic benefit.Gils [12] conducted a case study on Germany, simulating the country's energy system, and concluded that the main benefit of DR is its ability to replace peak power generation capacity, thereby reducing system costs.Similarly, Xiang et al. [13] and Klaassen et al. [14] performed a cost-benefit analysis of DR, considering the energy system as a whole, without focusing on the specific balancing costs for grid operators.Consequently, these studies cannot be used to test the hypothesis that DR reduces costs for grid operators by lowering balancing market prices.
Walawalkar et al. [15] took a different approach and conducted a case study on the PJM electricity market in the United States.They compared the social welfare gains with the subsidies paid to price-responsive loads.The strength of their paper is that it uses actual load and price data from 2006.However, they still needed to simulate DR bids to estimate the economic benefit of DR participation in the electricity market.Bradley et al. [16] have provided a comprehensive overview of the different system cost reductions of DR but stated that "it was not possible to provide an average annual estimate of the value of DR to avoid the need for generation capacity to provide a reserve for emergencies/unforeseen events".
The Dutch TSO, TenneT, in its Annual Market Update 2019, reported that the prices for flexible capacity had dropped in the Dutch balancing market due to increased offered capacity since the moment that DR was allowed to participate [17].However, this does not detail specifically DR, but rather the effect of increased liquidity on these markets.In the Power Responsive reports of GB's TSO, National Grid, insights have been provided on the average bid prices of DR on balancing markets, which show that DR bid prices are usually lower than traditional flexibility sources [18].These reports form a sound basis for supporting both the hypothesis and the analysis of the bid prices of DR.However, the depth of analysis is limited, and external factors affecting prices have not been taken into account.Therefore, a more in-depth analysis is needed to estimate the cost reduction of DR on balancing markets.
While different methods have been employed in the existing literature to estimate the cost reduction potential of DR, a generic quantitative method is lacking with which stakeholders can identify relationships between the sources that provide flexibility and the balancing market prices.The literature review clearly indicates the lack of studies that quantitatively estimate the cost reduction of DR in grid balancing using historical balancing market data.This gap can be attributed to the difficulty of conducting such analyses in most countries, where the necessary data are not publicly accessible.As a consequence, current research outputs cannot be used for the estimation of the cost reduction potential of flexibility sources from a system perspective, and cannot be strictly comparable within the context of different countries and balancing markets.The identified research gap sets the basis for the scope of this research and the formulation of the main research question as follows: What is the cost reduction potential of DR participation in balancing markets from a system perspective?

Introduction to Methodology
To quantify the cost reduction potential, it is important to estimate the relationship between two main variables, i.e., the price of flexible capacity on balancing markets and the share of DR in the total accepted capacity on balancing markets.This paper presents a method to identify this relationship, which applies a regression analysis in a novel way by using historical data of balancing markets as input.To complement the regression analysis, an average bid price analysis is conducted to compare the average bid price of DR bids with the overall average of the market, which is used as a measure for the cost reduction of DR.These methodological steps are applied to two case studies, corresponding to the manual frequency restoration reserve (mFRR) balancing product in the Netherlands (NL) and the firm frequency response (FFR) balancing product in GB.For NL, undisclosed data were used, specifically made available for this research by the Dutch TSO TenneT.For GB, public data of TSO National Grid were used.

Paper Layout
The paper is structured as follows: the research method is presented in Section 2, and the results follow in Section 3. The results are discussed in Section 4, and the paper is concluded in Section 5, where future research and policy recommendations are provided.

Research Methodology
In this section, the research methodology for the estimation of the cost reduction of DR from a system perspective is presented.The data collection and relevant variables are presented in Section 2.1.The methods for the regression analysis and the average bid analysis are presented in Sections 2.2 and 2.3, respectively.

Data Collection and Variables
The data collection addresses the two identified case studies in NL and GB.The balancing sub-markets in scope are listed in Table 1, including the data source and the investigated periods.In contrast to the symmetrical GB balancing sub-markets, the Dutch balancing markets are separated per the specific direction of the flexible capacity.Flexible capacity in the upward direction refers to an increase in production or a decrease in consumption of electricity.Flexible capacity in the downward direction refers to a decrease in production or an increase in consumption of electricity.In a symmetrical balancing market, flexible capacity should be available in both upward and downward directions [20].
The data on the balancing markets in GB and NL are translated into the variables used in this research.The symbols for these variables are listed in Table 2. To test the hypothesis of this research, the variables used in this research are defined as follows:

•
Average bid price on balancing sub-market  per flexibility source  per tender period  ( , , ).

•
The share of flexibility source  in the total accepted capacity per tender period  on balancing sub-market   , , .

•
The price of accepted flexible capacity bids of balancing sub-market  per tender period  ( , ).

•
The total flexible capacity accepted on balancing sub-market  per tender period  ( , ).
It is important to note that the variable for flexible capacity,  , , has a different interpretation per sub-market.The main difference is the time horizon over which it specifies the flexible capacity.For example, in Dutch mFRR markets, the variable defines how much MW of flexible capacity was reserved by the TSO for one month, which, therefore, could be linearly activated by the TSO to balance the grid.For other markets, the time horizon for the variable  , is one week or one day.To calculate this variable, only the accepted capacity bids are considered, as the capacity that is bid but rejected does not influence the settled prices of flexible capacity on balancing markets.This capacity does not affect the costs incurred by TSOs to balance the grid and is, therefore, irrelevant to this research.
It is also important to note that the FFR markets in the UK and the Dutch mFRR markets have a pay-as-bid pricing scheme in which there is not a single price per period.Every bidder receives their bid price when their bid is accepted.Therefore, the variable  , is, in this case, defined as the average of all the accepted bid prices per period.The Dutch aFRR market has a pay-as-cleared (marginal pricing) pricing scheme in which every accepted bidder receives the bid price of the highest accepted bid.Therefore, the balancing market prices in the two types of markets should be interpreted differently.

Regression Analysis
With the combination of  , , and  , , the hypothesis can be tested by identifying the trend between the two variables, with DR as the flexibility source of interest.The trend analysis is performed using regression analysis, which tests whether a higher share of DR in balancing markets (independent variable) is associated with a lower price for flexible capacity (dependent variable) that can support system cost reduction.Variable  , is used as a control variable in the regression model to check whether a higher accepted capacity is associated with a higher price for flexible capacity.Other external independent variables, such as gas price ( ), are also included in the regression model as control variables when they are shown to be statistically significant.Adding these control variables increases the accuracy of the regression model.
An example regression model in this context is as follows: The intercept  and the coefficients  , , and  are estimated by the regression model based on the input data.The error term , or residual, is the difference between the predicted value of the dependent variable and the actual value.The accuracy in predicting the dependent variable using the independent variables is maximised by parameterizing the coefficients to minimise the error term.When the regression model estimates a negative relationship between  and  , , the results support the hypothesis that DR participation can result in cost reduction for balancing the grid.

Average Bid Price Analysis
The average bid price analysis is used to complement the regression analysis by providing a different measure for the same estimation of the cost reduction in DR.This analysis is used to validate the regression analysis results by comparing the average bid price of DR flexible capacity ( ) with the overall average bid price per balancing market ( ).The variables for the average bid prices are defined in Equations ( 2) and (3).When DR bids are lower than the market average, TSOs can reduce costs when more flexible capacity is bought from DR resources.This would support the hypothesis of this research.
Capacity-weighted averages were also considered for calculating  and  .These weighted averages yielded results comparable to those obtained using simple averages.
Therefore, for the sake of simplicity, simple averages were employed in the average bid price analysis.

Results Case Study: Great Britain
The flexibility source associated with DR on the FFR market in GB is referred to as Load Response.To provide some context to the role of this flexibility source in this balancing sub-market, Figure 1 shows the average shares of the flexibility sources in the total accepted volume of the period in scope.The percentage of Load Response is 13% and 13% for the FFRd and FFRs, respectively.Next, Figure 2 shows a scatterplot of the share of Load Response and the price of flexible capacity on the FFR market per tender period in scope.It shows a negative trend for the FFRd market, whereas no visible trend can be identified for the FFRs market.

Regression Analysis: FFR Market
First, it was tested whether the data are suitable for building a regression model.This test shows that a regression model is only suitable for the FFRd, and not for the FFRs market.Data of the static FFRs market only contain a price for flexible capacity for 34 months (excluding outliers).In the other months (25% of the time), no static flexible capacity was bought; thus, no price was settled.The regression model built based on these 34 months fails to have statistically significant results, as shown in Table 3.Here, it can be seen that only the participation of the generation-type Diesel has a significant effect on the price, that the observations/number of predictors ratio is too low, and that the predictive value of the model is low (R 2 = 0.28).Therefore, only the regression results of the FFRd market are analysed further.The results of the dynamic FFRd regression model can be found in Table 4.The independent variables that have been shown to be statistically significant are  , and  , .The variables of the other flexibility sources have been shown to be statistically insignificant.An external independent variable that has appeared to be significant is the GB gas price  .Table 5 shows the results of the statistical tests, which are used to test the validity of the results of the regression model.The data show that a strong correlation of 0.69 has been found between  and  .This is just below the critical value of 0.7, above which multicollinearity in the data is suggested [21].Multicollinearity could cause problems for the estimation of the coefficients in the regression model.Contrarily, the variance inflation factor analysis (VIF analysis) shows that there is no collinearity.Therefore, the regression model is accepted.), which supports the hypothesis of this study.A positive relationship has been found between  and  , which is according to expectations.For the gas price in GB, the unit £/therm is used, a conventional unit for natural gas companies [22].Therefore, many data providers also use this unit.A therm is approximately equal to 29.3 kWh.
The plots in Figure 3  .This can be explained by the effect of  on  .The peak of  in January 2020 is clearly not predicted well.This peak may have been caused by an external factor that is not included in this analysis.

Results Case Study: The Netherlands
Market data were collected for five Dutch balancing sub-markets: aFRR Symmetrical, aFRR Upward, aFRR Downward, mFRR Downward, and mFRRda Upward capacity.The average shares of the different flexibility sources in the total accepted capacity per balancing sub-market are illustrated in Figure 6.It shows that Large-scale production takes most of the share, followed by Mixed Portfolio.DR is attributed to a small share in the total accepted capacity on the markets, especially in the aFRR balancing market, for which  is 0. Therefore, the aFRR markets are excluded from the analysis, as DR takes an insignificant share of the total accepted capacity. Figure 7 shows a scatterplot of the DR share and the flexible capacity price on the Dutch balancing sub-market for mFRR provision per tender period in scope.It shows a negative trend for the mFRRda Upward provision, while no visible trend can be recognised for the mFRRda Downward provision.

Regression Analysis: mFRRda Upward and Downward Market
Tables 6 and 7 show the results of the statistical tests, which are used to test the validity of the results of the regression models for the mFRRda Upward and Downward markets.A strong correlation between  and  was found, which is in line with expectations, as high gas prices result in high marginal costs for gas turbines that provide flexible capacity.The VIF analysis shows that this high correlation does not cause multicollinearity.Multicollinearity could cause problems for the estimation of the coefficients in the regression model.On the contrary, the normality of residuals assumption is violated by the regression model.This suggests that the coefficients of the model cannot be estimated accurately.To understand why the residuals are not normally distributed, the relation between the residuals and the independent variables is illustrated in Figures 8 and 9 for the mFRRda Upward and Downward market.Two things are remarkable, which can explain the violation of the normality of the residual assumption.For both markets, there are many different residuals for 0% .This is due to the fact that in many auctions, DR did not participate, and different prices were settled.When the DR participants join the auction, they often win and provide a significant share of the auction.Next to that, residuals are higher for moments when  was around EUR 100/MWh.This can be explained by the market instability caused by relatively high gas prices.The violation of the normality of residuals assumption makes the estimation of the coefficient less accurate.However, the 95% confidence range of the coefficients is negative for both markets, and the independent variables show a significant effect on the dependent variable, and the violation of the normality of residuals assumption is explainable.Therefore, the results of the mFRRda Upward and Downward regression model are taken into consideration and used to support the conclusion.The inaccuracy caused by the violation of the assumption can be compensated by combining the results of multiple markets.
The results of the regression model of the mFRRda Upward market can be found in Table 8.The independent variable that has been shown to be statistically significant is  , .The external independent variable that has shown to be significant is the NL gas price  .The results of the regression model of the mFRRda Downwards market can be found in Table 9.The independent variable that has been shown to be statistically significant is  , .The external independent variable that has shown to be significant is the NL gas price  (in €/MWh).Figure 11 and the regression statistics in Table 6 show that the regression model prediction accuracy is acceptable (R 2 = 0.40 and MAPE = 54%).It shows a negative relationship between  and  , (−0.37 ), which supports the hypothesis of this study.However, the relationship looks non-linear.A positive relationship has been found between  and  , as expected.This relation does look to be linear.
The estimated regression model of the mFRRda Downwards market is presented in Equation ( 6).

Average Bid Price Analysis: mFRRda Markets
Figure 12 shows that DR bids lower than the market average on the mFRRda Downwards market (EUR 4.92/MW/h vs. EUR 7.06/MW/h; i.e., 30% lower) and mFRRda Upwards market (EUR 6.71/MW/h vs. EUR 8.98/MW/h; i.e., 25% lower).Both observations support the hypothesis of this study.

Cross-Market Comparison and Analysis
In this section, the results of the different analyses and markets are consolidated to conduct a cross-market comparison and analysis between the two case studies of GB and NL.

Regression Analysis
The results of the regression models provide an estimation of the change in price caused by a 1% increase in the share of DR ( ).
Figure 13 shows the relative cost reduction of DR across the different markets for which a regression analysis (RA) was possible ( , , ).It shows that the relative cost reductions of the FFRd and the mFRRda Upward markets are −1.41% and −1.49%, respectively.The relative cost reduction of the mFRRda Downward capacity market is significantly higher at −5.24%.The average of the different estimations is −2.71%.Figure 14 shows the estimated price reduction of DR in the period in per balancing sub-market.This is calculated by multiplying the relative cost reduction (RCR) of the regression analysis ( , , ) with the average share of DR per market ( ̅ , ).This result can be interpreted as the cost reduction ( , ) for TSOs due to the participation of DR in balancing markets in the period in scope.This cost reduction ranges from −11% to −18%.

Average Bid Price Analysis
The measure of the average bid price analysis should be interpreted differently from the regression analysis.The relative cost reduction of the average bid price (ABA) analysis ( , , ) shows the percentage difference between the average bid price of DR and the overall average bid price on the market ∆ (in %).
Figure 15 shows the relative cost reduction for which the average bid price analysis was possible.It shows that the different markets show significantly different results, ranging from −14% for the FFRd market to −70% for the FFRs market.The average of the results is −35%.Both the results of the regression analysis and average bid price analysis support the hypothesis that the participation of DR lowers the price for flexible capacity.However, the quantifications show that there is a significant difference in the extent to which DR lowers this price.

Discussion
This chapter reflects on the methodology, the assumptions, and the results of this research.By examining the strengths and weaknesses of the study, it is determined how the results can be interpreted to draw conclusions.

Regression and Average Bid Price Analysis
Different types of analyses were used to test the hypothesis of this study.Multiple balancing products are included in the scope of the two case studies in GB and NL.The results of the different analyses are discussed per balancing product, after which the different outcomes are compared.
Regarding the GB's FFRd data, a clear negative relationship is visible between the participation of DR ( , ) and the price of flexible capacity on the FFRd market ( ).Both the results of the regression and the average bid price analysis support the hypothesis that higher participation of DR leads to lower balancing costs for grid operators.
However, for GB's FFRs market, a contradiction between the results of the different types of analyses is observed.Remarkably, DR bids are significantly lower in the FFRs market than the market average (−70%), while the regression analysis cannot support the hypothesis as it cannot identify a significant effect of  , on  .Next to that, a positive correlation (0.28) was found between  , and  .When assuming the validity of the hypothesis of this study, i.e., a negative relationship between  , and  , the positive correlation can be explained by the fact that this type of analysis does not consider other factors.It could be the case that in moments of high  , , an external factor (e.g., the gas price) accidentally was also high, which increased  .This leads to a positive correlation.It could have been tested with a regression analysis to determine whether the external factor caused this correlation.However, this was impossible due to the limited number of observations as input to the regression model.This limitation can also explain why no significant effect was estimated of  , on  .When not assuming the validity of the hypothesis, i.e., there is an insignificant or a positive relationship between the two variables of interest, the contradiction in the FFRs market can be explained by the fact that the result of the average bid price analysis is caused by the extreme outlier in the average bid price of the flexibility source DSF: Distributed generation (for export).The average bid of this flexibility source of GBP 47.58/MW/h was significantly higher compared to the market average of GBP 8.42/MW/h.When excluding this flexibility source, Load Response bids the third-highest average bid price on this market of the seven flexibility sources participating in this market.
For both the Dutch mFRRda Upward and Downward capacity markets, a negative trend between the variables of interest is observed.This trend is supported by both the regression and the average bid price analysis, which support the hypothesis of this research.However, two main weaknesses exist in the regression analysis of the mFRRda markets.First, the regression analysis of the mFRRda Downward market is based on low participation of DR resources of 2.3%.Therefore, a limited number of DR participants are represented by these results.Second, the regression models of both the mFRRda Upward and Downward capacity market violate the normality of the residual assumption.This leads to less accurate estimations of the coefficients  , , , and Future research should include a broader range of balancing markets in different countries.This improves external validity by reducing the country selection bias.When appropriate balancing market data are available in more countries, it is recommended to look at the cost reduction of DR in balancing markets with a high share of DR, as this was not the case for all the markets included in the scope of this research.Furthermore, it would be relevant to study the impact of the high gas prices on the balancing markets individually to isolate this effect from other developments that have been studied on the price of flexible capacity.This can be performed by zooming in on the energy crisis period and by conducting a regression analysis to estimate the effect of the gas price on the balancing market prices.
It is also recommended to test whether non-linear models, like exponential or logarithmic models, better explain the relationship between the participation of DR and the price of flexible capacity in balancing markets.The non-linear relationship can be estimated using non-linear regression models.This can increase the accuracy of the estimations.
Lastly, it is recommended to combine the results of a study like this with a study that includes other factors that can lead to extra (or less) costs for TSOs, such as changes to the rules and design of the balancing market auctions.This shall provide a complete overview of the cost reduction of DR from a system perspective.
One of the main challenges of this research was finding appropriate data on balancing markets that can be used for the quantitative research methods used in this study.This challenge limited the scope to only two countries.Preferably, balancing markets of more countries would have been included in the scope to improve the external validity of the study.Therefore, it is recommended that policymakers and energy authorities make balancing markets more transparent to enable future studies on the relationship between the flexibility sources and the balancing market prices.Specifically, data on the mix of flexibility sources participating in the balancing markets is largely missing and would be valuable for future research.The potential challenge of implementing improving data transparency is that it creates an extra burden for grid operators, leading to extra costs.However, with decreasing costs of information technology and clear trends on more interconnectivity between devices, these extra costs are expected to be limited.

Conclusions
In this section, the conclusion of this research is formulated by answering the main research question: What is the cost reduction potential of demand response participation in balancing markets from a system perspective?
Based on existing literature, this research hypothesises that higher participation of DR can reduce costs for balancing the electricity grid.The main research aim was to test this hypothesis using a novel quantification methodology, thus contributing to the existing literature.When appropriate data are available, this novel application of the methodology can be used as a generic quantitative method to compare different balancing markets.
The research question was answered by analysing historical data on balancing markets to identify the (quantitative) relationship between the share of DR in the total accepted capacity and the price of flexible capacity in balancing markets.The markets included in the scope were the FFR markets of GB and the FRR market of NL, using historical data from 2018 up to 2021.The chosen methodology has limitations to the internal and external validity of the results, mainly due to ambiguity in the results, model assumptions, and the country selection bias.
Despite these limitations, the results show that for most balancing markets that were included in the scope, a significant price reduction is estimated due to the participation of DR, which leads to lower costs for TSOs for balancing the electricity grid.It is estimated that DR bids are, on average, 35% lower than the market average.The regression analysis estimated that a 1% higher participation of DR in markets leads, on average, to a 2.7% lower price for flexible capacity.Looking at the average current participation of DR in the investigated markets, it is estimated that the price in these markets has dropped by 10-20% due to DR participation.It can, therefore, be concluded that the results of this research support the hypothesis that higher participation of DR can reduce costs for balancing the electricity grid.This study contributes to the current literature by quantifying the cost reduction of DR participation in grid balancing using historical balancing market data.

Figure 1 .
Figure 1.Share of accepted capacity per generation type of dynamic FFRd (left) and static FFRs (right) market over the period April 2018 until January 2022.

Figure 2 .
Figure 2. Scatterplot of price of flexible capacity and share of load response on FFRd (left) and FFRs (right) market.

,
show that the price is predicted more accurately at relatively high and  ).Especially high values for  show a clear effect on  .It also shows that the accuracy of the model increases over time and that it follows the up-moving trend of

Figure 4 .
Figure 4. Average bid price on dynamic FFRd market per flexibility source.

Figure 5 .
Figure 5. Average bid price on static FFRs market per flexibility source.

Figure 6 .
Figure 6.Average share of accepted capacity per flexibility source per balancing sub-market.

Figure 7 .
Figure 7. Scatterplot of price of flexible capacity and share of demand response on mFRRda Downward (left) and mFRRda Upward (right) market.

Figure 8 .
Figure 8. Scatterplot of residuals of regression model and independent variables of regression model mFRRda Upward market.

Figure 9 .
Figure 9. Scatterplot of residuals of regression model and independent variables of regression model mFRRda Downward market.

Figure 10 and,
Figure 10 and the regression statistics show that the regression model predicts the price of flexible capacity  well (R 2 = 0.70 and MAPE = 30%).It shows a negative relationship between  and

Figure 12 .
Figure 12.Average bid price per flexibility source per sub-balancing market.
fairly compare markets with different price levels and currencies, the relative cost reduction (RCR) is calculated by dividing this number by the average price per market,  .This results in a measure for the percentage change in  caused by a percentage change in  (

Figure 13 .
Figure 13.Overview of results from regression analysis.

Figure 14 .
Figure 14.Estimated cost reduction of demand response in reference year per balancing sub-market using regression analysis.

Figure 15 .
Figure 15.Overview of the relative average bid price of DR compared to the market average.

Table 1 .
Input data for estimation of cost reduction of demand response.

Table 2 .
Symbols used to define variables and parameters for analyses.

Table 3 .
Results regression model of FFRs market.

Table 5 .
Results statistical tests on regression model dynamic FFRd market.

Table 6 .
Results statistical tests on regression model mFRRda Upward market.

Table 7 .
Results statistical tests on regression model mFRRda Downward market.