Next Article in Journal
Information Transfer in Active States of Human β2-Adrenergic Receptor via Inter-Rotameric Motions of Loop Regions
Next Article in Special Issue
Practical Experience in the Application of Energy Roofs, Ground Heat Storages, and Active Thermal Protection on Experimental Buildings
Previous Article in Journal
Protective Effect of Ectoin on UVA/H2O2-Induced Oxidative Damage in Human Skin Fibroblast Cells
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation and Comparison of Spatial Clustering for Solar Irradiance Time Series

1
Sciences for Environment Laboratory, University of Corsica Pasquale Paoli, UMR CNRS 6134, 20000 Ajaccio, France
2
Department of Electronic Engineering, School of Exact Sciences and Engineering, Universidad Sergio Arboleda, 11000 Bogotá, Colombia
3
Radiotherapy Unit, Hospital of Castellucio, 20000 Ajaccio, France
4
Universidad Politécnica de Madrid, UPM, Avd. Puerta de Hierro, 2, 28040 Madrid, Spain
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(17), 8529; https://doi.org/10.3390/app12178529
Submission received: 27 July 2022 / Revised: 22 August 2022 / Accepted: 23 August 2022 / Published: 26 August 2022
(This article belongs to the Special Issue New Developments and Prospects in Clean and Renewable Energies)

Abstract

:
This work exposes an innovative clustering method of solar radiation stations, using static and dynamic parameters, based on multi-criteria analysis for future objectives to make the forecasting of the solar resource easier. The innovation relies on a characterization of solar irradiation from both a quantitative point of view and a qualitative one (variability of the intermittent sources). Each of the 76 Spanish stations studied is firstly characterized by static parameters of solar radiation distributions (mean, standard deviation, skewness, and kurtosis) and then by dynamic ones (Hurst exponent and forecastability coefficient, which is a new concept to characterize the “difficulty” to predict the solar radiation intermittence) that are rarely used, or even never used previously, in such a study. A redundancy analysis shows that, among all the explanatory variables used, three are essential and sufficient to characterize the solar irradiation behavior of each site; thus, in accordance with the principle of parsimony, only the mean and the two dynamic parameters are used. Four clustering methods were applied to identify geographical areas with similar solar irradiation characteristics at a half-an-hour time step: hierarchical, k-means, k-medoids, and spectral cluster. The achieved clusters are compared with each other and with an updated Köppen–Geiger climate classification. The relationship between clusters is analyzed according to the Rand and Jaccard Indexes. For both cases (five and three classes), the hierarchical clustering algorithm is the closest to the Köppen classification. An evaluation of the clustering algorithms’ performance shows no interest in implementing k-means and spectral clustering simultaneously since the results are similar by more than 90% for three and five classes. The recommendations for operating a solar radiation clustering are to use k-means or hierarchical clustering based on mean, Hurst exponent, and forecastability parameters.

1. Introduction

Renewable energy is commonly referred to as clean energy, as it comes from natural processes or sources that are constantly being renewed. However, it is recognized that the knowledge of the “availability” and “variability” of these renewable sources [1] is an important task and a great challenge, considering that the development of solar energy over the world is increasing and will continue to increase in the future [2,3,4].
The main problem of this energy source, which could inhibit or reduce its development, is its intermittence and randomness, which make its management difficult for an energy system operator [5]. Thus, to reduce and even to delete, at least partially, this inconvenience, three research axes must be developed in parallel:
  • The development of energy storages: They will allow us to store the energy in excess and to restore it when the load requires it [6];
  • The development of smart concepts of electrical grid: The produced and consumed energy and power must be managed efficiently with smart algorithms, using information and communication technologies [7];
  • The forecasting of the intermittent renewable energy production: Solar- or wind-prediction tools must be integrated into energy and power management systems to anticipate the future actions [8].
The benefit of solar radiation prediction is effectively proven [9]. There are a large number of publications in the literature that address the problem of solar-irradiance prediction. The techniques applied to prediction depend on the time horizon of the prediction and the time step of the solar irradiation [10]. Between these methods, time-series-based methods are based on statistical models applied to ground data measured in the past and at the instant of the prediction, using regression techniques [11], artificial intelligence methods [12], or statistical approaches [13]. They are used to forecast solar data from some minutes to about a 6 h horizon. They often have the disadvantage of being efficient only for the site on which the model has been trained and to be not generalizable elsewhere.
It should be interesting to verify if a model developed on a given site must be applied to other ones with “similar” characteristics not only from the received-solar-energy point of view but also from the point of view of the dynamic behavior of the solar irradiation one. With this final objective, the purpose of this study was to group the meteorological stations by “solar radiation affinities”.
Clustering is a technique used in data mining to identify clusters of elements according to a measure of similarity between them. In addition, clustering to minimize the dimensionality of the data while handling a large number of variables is used [14]. On the other hand, the clustering of geographically spaced data has been addressed in the literature. Still, this one seeks to cluster similar or geographically proximate data in geographic-information-system (GIS) information layers [15].
The study of the behavior of times series applied to a large territory by using statistic and artificial intelligence (AI) methods, grouping in “clusters” time series with the same behavior (i.e., with the same variability), was realized particularly in two papers written by Warren Liao [16] and Wang et al. [17]. The first one [16] summarized previous works on clustering time-series data into various application domains and discussed criteria for evaluating the performance of clustering results and measures for determining the similarity/dissimilarity between two time series. The second one [17] realized a high-dimensional time-series clustering work, using algorithms based on distance metrics that generally fail because they cannot handle missing data. Instead, time series are clustered based on global features extracted from each series and can be fed into clustering algorithms. In these works, statistical operations describe the time series: trend, seasonality, periodicity, serial correlation, kurtosis, chaos, nonlinearity, and self-similarity.
Reviews papers such as References [18,19] present states-of-the-art in the last decade that introduces some fundamental concepts of time-series analysis, classification, and clustering methods based on observations, time and frequency, and the similarity between series and dimensionality reduction.
Focusing now on the clustering in renewable energy sources, Tripathi et al. [20] described various AI techniques applied to different renewable energies, particularly photovoltaic ones. They realized a clustering of datasets for analyzing the most suitable location of solar plants according to the study of similar meteorological conditions.
Hartmann [21] compared various methods to categorize clear, cloudy, and partiality cloudy sky days, using a one-year solar-irradiance dataset from Budapest (Hungary). Six methods were compared deterministically and non-deterministically (k-means clustering, Fuzzy c-Means, and Multiple Fuzzy C-Means) with different temporal resolutions. The comparison aimed to reveal the strengths and weaknesses of the applied methods. Unfortunately, the results obtained with the implemented methods are limited, as they are susceptible to the input data, and the categorization is often inconsistent among them.
In Reference [22], the authors aimed to predict the global hourly solar radiation of the next day and used clustering. The k-means clustering algorithm was proposed to classify four kinds of days: clear, cloudy, cloudy in the morning, and cloudy in the afternoon. They were combined with regression algorithms (decision trees, support vector machines, and artificial neural networks) to estimate the day-ahead clearness index in Malaga, Spain.
Liu et al. [23] proposed a solar irradiance classification of 98 stations with solar irradiance sensors and 562 stations without irradiance data. A k-means and a support-vector-machine genetic algorithm were used to perform this clustering. Models were developed by introducing geographical parameters, including latitude and altitude. Hassan et al. [24] sought to predict hourly global irradiance profiles from daily global irradiance records from six sites in the North African Sahara. They started from a prior categorization of the hourly observations by using a k-means clustering algorithm, followed by a nonparametric approximation of the function, using the multilayer perceptron artificial neural network.
Laguarda et al. [25] studied the relationship between the solar resource and the climatology in Uruguay (condition of the phenomenon called Niño or Niña). The input information consisted of global-horizontal-irradiance (GHI) estimations from daily satellite images and regionalization of the meteorological stations based on the geographical position of the station. A Principal Component Analysis (PCA) was used to decrease the dimensionality of the series. The clustering algorithm, based on the changes in the station for different years, was a k-means/ward.
Pham et al. [26] applied a k-means clustering to satellite-based daily global horizontal irradiation for spatial-variability analysis and regionalization in different regions of Vietnam.
Maldona-Salgero et al. [27] proposed a methodology to characterize and cluster the spatiotemporal daily global horizontal solar-resource variability in the Spanish territory. They used a hierarchical clustering technique to classify the spatial data, and different time windows were subsequently evaluated. The parameters used in this study are averaged (yearly, seasonal, and monthly) values of daily horizontal global irradiances.
An unsupervised clustering-based (UC-based) solar forecasting method was developed by Feng et al. [28] for short-term (1-h-ahead) global horizontal irradiance forecasting. The daily GHI time series is clustered by an Optimized Cross-Validated Clustering (OCCUR) method.
Malakar et al. [29] proposed a novel short-term (2-h-ahead) solar forecasting approach that uses a clustering (k-medoid clustering method) on the basis of cloud parameters as a preprocessing step. To ensure broader variation in cloud movements, neighboring stations were used that were selected by using a dynamic time warping (DTW)-based similarity score. The method is very interesting, although complex. The proposed model achieved 19.74% less nRMSE compared to the benchmarks.
The majority of the papers presented above propose methods and modes of validation crucial for the clustering of solar radiation; however, they are limited, for the most part, to a single-criterion study most often relating to a geographical criterion and daily and monthly data (time step not really interesting in practice for solar applications). In order to address these limitations, we propose to develop a new methodology, particularly by studying non-geographical parameters and statistical parameters revealing the dynamics of each hourly or intra-hourly clear-sky index time series. Various techniques of clustering [30] are applied to group the meteorological stations by “solar radiation affinities”, i.e., to group by similarity or proximity criteria according to the static and dynamic characteristics of the time series. Clustering is not an exact science; totally contradictory results can be linked to the use of poor-quality measures. It is therefore essential, in the field of solar engineering, in addition to stating this characteristic, to identify, quantify, and correct possible problems. The various steps of this work are as follows (rarely are all of these steps studied in the same paper):
  • To evaluate the quality of the data provided by the meteorological stations because the measure of solar irradiation is often accompanied by errors due to pyranometer calibration, surrounding effects, or data-acquisition-system failure;
  • To determine the best descriptors of static (e.g., descriptive statistics measures) and dynamic (e.g., Hurst exponent (H), forecastability coefficient (F), etc.) characteristics of the series and to determine the redundancy of these descriptors;
  • To implement clustering algorithms such as k-mean, k-medoids, spectral, and hierarchical clustering;
  • To compare the clusters obtained by each method with each other and the well-known Köppen classification, characterizing the areas according to climate, solar irradiation, precipitation, and temperatures.
The paper continues as follows: Section 2 implements tools that analyze the accuracy and quality of the measured data; Section 3 evaluates the best criteria to characterize solar time series; Section 4 presents the Köppen climatic classification and the clustering methods that are implemented on the solar irradiance time series; Section 5 implements some clustering algorithms and compares the clustering results; at last, in Section 6 and Section 7, the perspectives of the work are described and conclusions are drawn, respectively.
The major contributions of the paper are as follows:
-
The objective of the clustering is to improve the efficiency of the forecasting of the solar radiation; the objective was found only in one reference [29];
-
The utilization of several parameters to characterize each site;
-
The utilization of dynamic parameters to characterize each meteorological station: Hurst exponent already used for other meteorological time series but not for solar irradiances, and mainly the forecastability coefficient, which is a new concept—the utilization of several clustering methods and their comparison between them and with the well-known Köppen classification (upgraded for Spain).

2. Solar Irradiation Time-Series Analysis

To conduct this study, large databases (with an intra-hour time step) collected on several meteorological stations were needed. The solar irradiances for the present work were provided by the “Sistema de Información Agroclimática para el Regadío” (SIAR) system [31], consisting of 448 meteorological stations (https://eportal.mapa.gob.es//websiar/Inicio.aspx) (accessed on 2 June 2021). The data are free but are not open-access. These stations are concentrated in areas suitable for agriculture, with low slopes and measure temperature, rainfall, horizontal solar radiation, humidity, wind speed, and direction. Each weather station undergoes maintenance every six months and calibration every year. Note that rainfall, humidity, and solar irradiance measurements are used to determine weather stations in the Köppen [32] class.

2.1. Data Measures and Stations

The Spanish Ministry of Agriculture, Fisheries, and Food [31] make available an Agroclimatic Information System for Irrigation (SIAR) with measured data recorded every 30 min on 542 sites (only 448 are active; https://eportal.mapa.gob.es//websiar/Inicio.aspx, accessed on 2 June 2021). The position of the meteorological stations used in this work is shown in Figure 1. Solar irradiance measurements obtained by pyranometers are verified according to the International Standard ISO 9847 Solar energy Calibration. For the purposes of this study, global horizontal radiation time series (GHI) from 1 January 2017 to 31 December 2020, with a 30 min time step, were used. It is obvious that a reliable measure of meteorological data is not always an easy task, and even the maintenance of the station is well realized; quality control must be applied, mainly on solar radiation data.
Before explaining the quality-control method (Section 2.3), the clear-sky solar radiation model (Section 2.2) is briefly described here.

2.2. Clear Sky Model

The solar irradiation time-series GHI (for global horizontal irradiation or irradiance) exhibits a seasonality and a periodicity (a yearly cycle and a diurnal one). Most of the machine learning and AI methods can only be used with stationary time series [33] (the “weak” assumption is sufficient). To “delete” this periodicity, it is common to compute a ratio called clear-sky index and defined as GHI on the solar irradiance in clear-sky conditions (denoted GHIcs), kt = GHI/GHIcs. This one results in a normalized quantity theoretically comprised between 0 and 1. A clear-sky model estimates the solar irradiance that reaches the ground surface when the sky is clear without clouds. Such models were developed and differ from each other mainly in the inputs needed by each model [34]; they generally used meteorological variables (such as ozone layer thickness, precipitable water, aerosol optical depth, etc.) and solar geometry (solar elevation, declination, etc.) [35]. The most widely used clear-sky models are the Solis model developed by Mueller et al. [36] and simplified by Ineichen [37], the European Solar Radiation Atlas (ESRA) model [38], the Reference Evaluation on Solar Transmittance 2 (REST2) model [39], and the McClear Model [40,41,42] (this list is not exhaustive). The New Heliosat-4 method [40] is an operational tool for solar irradiance monitoring in the framework of the projects “Monitoring Atmospheric Composition and Climate (MACC)” [43] and the Copernicus program. This method processes Meteosat images to create the CAMs radiation service (Copernicus Atmosphere Monitoring Service) used to calculate the clear-sky solar radiation, to estimate the cloud effect (coupled with APOLLO/SEV from DLR), and the ground albedo (derived from MODIS).
It allows us to have an efficient model with a fast implementation because it is available via a web service that gives time series of horizontal global, horizontal diffuse, and normal beam irradiances for a given point and a given period, from 2004 up to current day − 2 (minus two days), with a time step from 1 min to 1 day. For this paper, only the data of clear-sky solar irradiance were uploaded via http://www.soda-pro.com (accessed on 10 March 2021). More information about the McClear Model and the upload platform can be found in references [40,41]. Figure 2 shows, as an example, the superposition of the series generated with this model (clear sky) and SIAR measurements (in real meteorological conditions) on the same locations (here, stations V29 and C01; see Figure 1).
It is clear that the clear-sky irradiance estimated by CAMs can be quasi-perfectly superimposed onto the data measured on the ground level for days with clear skies. Thus, the quality of the CAM model is shown. It is possible to assess, more globally, the adequacy between measurement and model over a significant period (annual) for the same stations (see Figure 3).
Using such a methodology, all the data, for each station, were carefully checked, and only stations having passed the tests correctly were selected in this study. As an intermediate outcome, the McClear model provides a good estimate of the clear-sky irradiance, but as shown in the next section, the results can still be improved.

2.3. Data Quality Control

A necessary condition to establish objective conclusions in clustering is to work with valid data. For this reason, the quality control of measured (SIAR) and estimated time series in clear-sky conditions (CAMs McClear) should be performed. Generally, several problems occur in solar-data acquisition, such as failures of the acquisition system, synchronization issues, incorrect measurements at sunset or sunrise (due to high azimuth angles), or other artifacts. Espinar et al. [44] and El Alani et al. [45] studied this critical topic of quality check and proposed efficient Quality-Control Procedures (QCPs) for solar data. They showed that, after checking the plausibility of data, some visual support (graphs and histograms) helps in the interpretation of this quality check. We drew inspiration from these two papers to establish our own QCP, which is described in Figure 4.
We modified the previous methods a little bit in view to, in our opinion, make them more relevant for the data studied in this study: kt analysis based on geographic clustering. These processes are essential to extract relevant information for data mining and analysis tasks of solar-energy time series [46]. The QCP methodology is based on four main steps:
  • GHIcs correction related to a possible offset corresponding to an erroneous time stamp: clock issue or stations’ location approximation (see Section 2.3.1);
  • Visual validation of kt series to easily identify significant measurement errors (see Section 2.3.2).
  • Quality evaluation of data provided by SIAR system and discarding of the stations with more than 30% of over-irradiance data (see Section 2.3.2).
  • Detection of the kt outlier. The data that are much larger than 1.2 are removed (see Section 2.3.3).

2.3.1. Time-Stamp Correction

The elimination or minimization of uncertainties in the kt time series must be realized [47,48,49], so the results will be relevant only if the clear sky and the measured solar irradiances are correctly time-stamped. It is quite common to observe a time lag (ranging from a few minutes to about 20 min) between the two types of series defining the clear-sky index: GHI and GHIcs. The effect is that it is systematically observed in higher measurements than the clear sky at sunset or sunrise. There are several explanations that can be put forward. The first is related to a mislocation (or lack of precision) of the measurement stations (which is unlikely but possible in some cases). Then an error can occur when entering the geographical characteristics of the stations in the McClear interface or a problem of clock between the measurement and the estimate by clear sky. A retiming strategy is proposed to minimize the delay between two time series. For this purpose, the methodology is as follows:
  • Operate a clear-sky shift (Δt) from −60 min to +60 min (by steps of 1 min), based on a simple linear interpolation (121 time series are obtained).
  • Compute for the 121 GHIcs series generated previously the mean square error (MSE) compared to measurement (GHI).
  • Retain Δt, the offset that allows us to obtain the minimum MSE.
  • Propose the new corrected clear-sky series, which corresponds to the linear interpolation of the series shifted by the offset, Δt ( G H I c s C o r r e c t e d t = G H I c s t + Δ t ).
The offset, Δt, is thus the parameter to find and then apply to GHIcs in order to find a better concordance in terms of the MSE between GHI and new GHIcs.
As an example, the impact of this shift is seen in Figure 5. Considering the correction and 1 year of acquisition (30 min time step), the average value of kt is decreased by almost 1%, from 0.5814 to 0.5761, and the variance by 4.2% (from 0.1136 to 0.1088).
Now that the series is correctly recalibrated, we have to check if they are all usable.

2.3.2. Validation of the SIAR GHI Time Series

Even if the data series were verified by the SIAR’s quality check, it seems that it is useful to realize a new checking by using the visual procedure proposed by Reference [45] and completed by some tests on the kt values. The solar irradiance data that are used here are the average horizontal global solar irradiance for 30 min on the period 1 January 2017 to 31 December 2020. For each station, the following steps are realized:
Visual validation: Measured data (SIAR) are plotted in a 2D graph (Figure 6); in the same graph are drawn the theoretical sunrise (red color) and sunset hour (green color). This analysis allows for a visual identification of errors over time to visualize missing values, issues in time reference, and abnormal values. The two meteorological stations taken as an example passed the test, although an asymmetry is noted between the measurements above the green dotted line and below the red dotted line. Moreover, the measure begins before theoretical sunrise. This may indicate a little measurement error or sensor calibration error. This test allows, by its nature, to point out only the big measurement errors and is extremely time-consuming but necessary if one wants to use clean data. The other visual tests performed are not detailed here, but interested readers can refer to Reference [45].
In what follows, a filtering of the time series is systematically performed to eliminate the night hours. GHI and GHIcs irradiance values are removed for the hours of the day related to a solar angle less than 5 degrees.
Over-irradiance test: This test is based on the exploitation of kt histograms, as seen in Figure 7. Although easily automated, it is interesting to look at the shape of the histogram. The experienced user will be able to easily point out measurement errors and stations to remove from the study. Another way is to quantify the number of occurrences where kt is greater than 1. We have arbitrarily chosen a limit of 30%. Thus, if for a series, there is more than 30% of over-irradiance data (which is rare or impossible for 30 min time granularity), we consider that it is preferable to not use the station.

2.3.3. Outlier Cleaning Methodology

Sometimes outlier values can pollute some interpretations, especially when a static treatment requires a normalization of the data. A maximum kt value equal to 2.5 or 1.2 does not induce the same effects. To counter this effect, kt values higher than 1.2 are removed. Even if some meteorological conditions can be met and induce over-irradiance, by experience with kt series with a time step of 30 min, these values are unlikely to be withdrawn to avoid a statistical bias in our treatments.

2.4. Results of the Data Quality Control

After applying the previously described process to the 94 stations, only 76 stations passed the tests (Figure 1). Table 1 shows the number of stations, total active, and validated by year.
Although there are a lot of losses after completing the many tests presented above, there are still 76, which is rare in this kind of study. What is even more rare is to have simulations made with only corrected, validated, and filtered data.

3. Characterization of Solar Irradiance Time Series

Seventy-six GHI time series (one per location) measured between 1 January 2017 and 31 December 2020 were used. These observations were collected every 30 min. Each GHI series comprises 70,128 elements, for a total of 5,329,728 measurements. In addition, for each site and each 30 min, the GHIcs and kt (GHI/GHIcs) are computed; that is, more than 15 million data are created. As mentioned in the paper’s Introduction, each site must be characterized from the available-solar-energy point of view, not only with the mean value or the cumulative GHI but mainly by the distribution or variation of the solar radiation. The notions of variability, forecastability, and dynamics of the series must be considered. The statistical parameters that are the most appropriate for this study are divided into two classes: the first one concerns static parameters (mean, standard deviation, skewness, and kurtosis), and the second one concerns the dynamic parameters (Hurst exponent (H) and forecastability coefficient (F)).

3.1. Static Parameters

A characterization of the data includes position, dispersion, symmetry, and feature of time-series distributions [50]. As performed in Reference [51], the mean is used to compare the different measures. It is the choice of simplicity and has thus left aside the other measures of central tendency (median and mode) and non-central tendency (quartiles, deciles, and percentiles). As it is important to consider the dispersion of the series, the standard deviation is used. The two other parameters are well-known in statistics:
  • Skewness describes how much the statistical data distribution is asymmetrical from the normal distribution, where distribution is equally divided on each side [52,53,54,55]; it is defined by the following:
S k e w n e s s = μ 3 σ 3
where μ 3 is the third central moment and σ is the the standard deviation.
  • Kurtosis measures the “tailedness” of the probability distribution of a real-valued random variable [54,55,56,57] and is defined by the following equation:
T a i l e d n e s s = μ 4 σ 4
where μ 4 is the fourth central moment.

3.2. Dynamic Parameters

A fundamental task in these statistical analyses is to characterize the location and variability of a dataset [58]. In order to analyze and compare the dynamic behavior of irradiance time series, the use of the Hurst exponent (H) and forecastability coefficient (F) is proposed. H is related to fractal geometry at different scales (concept defined by Mandelbrot [59]). The main idea states that fractals are objects that have a similar appearance when observed at different scales and have details that cannot be studied by Euclidean geometry. H was used in previous studies to characterize the variability of meteorological parameters [60,61,62]. The values of H for a time series with n components are in the range of 0 and 1 and are computed from the expected value (E[x]):
E R n S n = n H   as   n
where R n is the range of the n cumulative deviations and S n is the sum of the first n standard deviations. According to the value of H, any time series can be classified into one of the three categories:
  • If H < 0.5, the series is anti-persistent. The closer the value is to 0, the stronger the mean-reversion process is. In practice, it means that a high value is followed by a low value, and vice versa.
  • If H = 0.5, the series is totally random.
  • If H > 0.5, the series is persistent. The closer the value is to 1, the stronger the trend.
There are several methods to calculate H. We used rescaled range analysis, average wavelet coefficient, and periodogram regression detailed in References [63,64]. The different techniques are close in terms of results, with a difference of less than 10%. Therefore, we did not know which one to use, so we decided to average the results obtained with the three methods.
The F coefficient describes how a model trajectory diverges from a true system trajectory. It is bounded between 0% and 100% and provides insight into the extent to which solar radiation time series can be predicted. This parameter can be estimated from a Monte Carlo method to determine R M S E m a x (the maximum error related to a site where the GHI randomly oscillates between 0 and G H I C S ) and the RMSE of the smart persistence predictor ( R M S E p ) [65]. F can be calculated with Equation (1):
F 100 %   × 1 R M S E p   /   R M S E m a x
The results for all the stations are given in Appendix A Table A1. For more details concerning this metric, interested readers can refer to Reference [66].

3.3. Correlation between Statistical Parameters—Redundancy

This section assesses whether the parameters defined above are not redundant and whether they all provide new information. If not, the static dependence will lead to a rejection of one of the two parameters to the detriment of the more complex one to be calculated. The goal is to be parsimonious and to propose the least complex method. The Spearman’s Rank Correlation Coefficient [67] is a statistical tool that examines the degree to which two datasets are correlated, even if the relationship between these two sets is not linear (unlike the Pearson one). This parameter is defined from the ratio between the covariance of two rank variables R(X) and R(Y) ( c o v ( R X , R Y ) and the product of their standard deviation ( σ ( R X x   σ ( R Y ). If the coefficient is greater than 0.75 (relationship in the same direction) or lower than −0.75 (relationship in the opposite direction), the correlation must be considered to be high. The task is then to use only descriptors with cross-correlations (in the Spearman sense) between −0.75 and 0.75. Figure 8 shows the Spearman correlation coefficient between the six descriptors of the kt series. A lot of values are outside the range of “statistical independence”. To have only values between −0.75 and 0.75, it is advisable to keep only three variables: mean, Hurst exponent (H), and forecastability coefficient (F). Figure 9 shows the median and quartiles (of the mean, H, and F) of the series. We note that F is relatively homogeneous on the dataset, and the two other parameters are more scattered mainly for the mean.

4. Köppen Climatic Classification and Clustering Methods

One of the simplest methods of geographic clustering based on the meteorological characteristics of the sites is the Köppen climatic classification. To facilitate the visualization of the results of this work, a Geographic Information System was implemented in QGIS software [68]. The various clusters are presented in the form of a map; several maps are drawn according to the clustering method applied. Thus, this makes it simpler to compare the various clusters with each other.

4.1. Köppen Climatic Classification

It consists of a worldwide natural climate classification [32] that identifies five main climate types, subdivided into a total of thirty classes, with a series of letters that indicate the behavior of temperatures and precipitations that characterize each climate and thus the kind of vegetation existing in them. Note that, a priori, the Köppen index (three letters in Spain: first is climate type, second is rainfall regime, and third is temperature variations) has no direct relationship with the solar irradiance characteristic of the site. Considering that this original classification is relatively old (1981–2010 by the Instituto de Meteorología de España [69]) and that some climate modifications may have occurred, we decided to actualize the Köppen classification using the SIAR data and the monthly values of temperatures and precipitation between 2017 and 2020; a new Köppen classification was then elaborated as shown in Figure 10. As this Köppen classification is well-known worldwide, and even if the solar potential is not considered in this classification, it seems that it can be used in our study just for comparison purposes.

4.2. Geographical Clustering Methods

Clustering includes all techniques that involve the grouping of data points. Given a set of data points (characterized by several descriptive parameters), a clustering algorithm is used to classify each data point (i.e., meteorological stations) into a specific group. In theory, data points that are in the same group should have similar properties and/or features. In contrast, data points in different groups should have highly dissimilar properties and/or features. Machine learning, and particularly unsupervised learning, can be used for clustering. It is a common technique for data analysis used in many fields such as economics, medicine, market analysis, environmental-pattern analysis, crime analysis [19], business and socioeconomics, engineering, science, medicine, art, and entertainment, [16] among others. Time-series clustering can be classified into three categories [18,19,70]: (a) subsequence clustering is clustering on a set of subsequences of a time series that are extracted by using a sliding window, that is, clustering of segments from a single long time series [71]; (b) time-point clustering (time series segmentation) is a clustering of time points based on a combination of their temporal proximity of time points; and (c) whole time-series clustering is a clustering of a set of individual time series with respect to their similarity [72] (this paper is dedicated to this type of grouping).

4.2.1. The Available Tools

Applied to our geographical clustering problem, the methodology concerns a given set of data, D (SIAR data), from which we previously extracted indices about its static and dynamic behaviors. The problem of the whole clustering of time-series data is formally well defined in Reference [19] as follows: time-series clustering, given a dataset of n time-series data, D = F 1 ,   F 2 , , F n , the process of unsupervised partitioning of D into, C = C 1 ,   C 2 , , C n , in such a way that homogenous time series are grouped together based on a certain similarity measure, is called time-series clustering. Then C i is called a cluster, where D = i = 1 k C i   and C i   C j = 0 for i j . A schematic of the main clustering techniques is shown in Figure 11.
The hierarchical clustering algorithm is a method in which data are grouped based on the distance between each one and looking for the data within a cluster to be the most similar to each other. It can also be seen as a graphical representation where elements are nested in tree-like hierarchies [73]. Hierarchical clustering strategies can be either agglomerative (each observation starts in its own cluster) or divisive (all observations start as a single cluster). We decided to apply only the first one during simulations. Indeed, the purpose is to group the meteorological stations with the smallest distance between their dynamic and static characteristics.
The partitive clustering is different and allows to divide a dataset into k clusters by trying to minimize some specified error functions. In k-means and k-medoids cases, each data point belongs to a single group. Data points are assigned to a cluster such that the sum of the squared distance between the data points and the centroid of the cluster (means for k-means or median for k-medoid) is minimal [74,75]. Spectral clustering is a technique that reduces complex multidimensional datasets into clusters of similar data in rarer dimensions [76]. It is based on calculating the eigenvalues of the data-similarity matrix in order to reduce the dimensionality of the system.
Many details about clustering and the pitfalls to avoid are given in the valuable Hyndman papers [17]. In summary, k-means and k-medoids methods are the most commonly used clustering algorithm [77,78], with the number of clusters, k, specified by the user. Hierarchical clustering generates a nested hierarchy of similar groups of time series according to a pairwise distance matrix of the series [79]. Both of these clustering approaches, however, require that the length of each time series be identical due to the Euclidean distance calculation requirement and are unable to deal effectively with long-time series due to poor scalability. From a mathematical point of view now, k-means is defined from a set of observations (x1, x2, …, xn). Each observation is a d-dimensional real vector; k-means clustering aims to partition the n observations into k (≤n) sets S = {S1, S2, …, Sk} so as to minimize the within-cluster variance. Formally, the objective is to find the following (μi is the mean of points in Si):
argmin S i = 1 k x S i x μ i 2
The hierarchical clustering is operated from sophisticated algorithms. In this technique, initially each data point is considered as an individual cluster. At each iteration, the similar clusters merge with other clusters until one cluster or k-clusters are formed. The basic algorithm is straightforward (agglomerative case):
-
Compute the proximity matrix;
-
Let each data point be a cluster;
-
Repeat: Merge the two closest clusters and update the proximity matrix;
-
Until only a single cluster remains.
As there is no consensus on which method to use, we chose to test all three in the next one. Table 2 offers a comparison of the main characteristics of the clustering methods used in this work.
A visible highlight in Table 2 concerns the fact that some clustering methods need to know the number of clusters to determine. How to choose the appropriate number of clusters is an open problem in the literature [81]. A pseudo-supervision can be used to define the ideal number of clusters (certainly the simplest way). For this reason, no algorithms were used to evaluate the optimal number of clusters. As the developed clustering was also compared with the Köppen classification (naive clustering method), it seemed convenient to take an equal number of clusters. Two cases were studied:
  • According to the Spanish Köppen classification (BSh, BSk, Cfa, Cfb, and Csb), k = 5;
  • According to the second letter (precipitation regime) of the Spanish Köppen classification (S, f, and s), k = 3. A strong link exists between GHI and precipitation: when one increases, the other decreases, and vice versa.

4.2.2. Clustering Methods Comparison

The notion of “objectively correct” does not exist in clustering: “clustering is in the eye of the beholder” [82]. The most appropriate clustering algorithm for a particular problem must often be chosen experimentally, unless there is a mathematical reason to prefer one clustering model over another. An algorithm designed for a specific model type will usually fail on a dataset containing a radically different model type. For example, k-means cannot find nonconvex clusters. According to the literature review, three important factors can be evaluated in clustering: (a) clustering tendency, which helps to evaluate whether the dataset we are working with has clustering tendency and not just uniformly distributed points [81,83]; (b) number of clusters k and (c) clustering quality. Concerning the last point, which is the most important for us, we can note several metrics which can be divided into internal and external measurements. The first one uses internal information to validate the clustering; that is, it evaluates how good the clustering structure is without the need for information from outside the algorithm itself [84,85]. Some of the clustering performance measures are the Davies–Bouldin Index, Silhouette Coefficient, Calinski–Harabasz Index, etc. The second one uses external information to validate the clustering and is independent of the clustering technique [86]. Some of the clustering-performance measures are the Rand Index, Jaccard Index, Fowlkes–Mallows scores, mutual-information-based scores, homogeneity, completeness, V-measure, etc. As it seems more relevant to us to use external measures, we have opted for the Rand Index method and the Jaccard Index:
  • The Rand Index (RI) is a measure of the percentage of correct decisions made by the algorithm: RI = (TP + TN)/(TP + FP + FN + TN), where TP is the number of true positives, TN is the number of true negatives, FP is the number of false positives, and FN is the number of false negatives;
  • The Jaccard Index (JI) is a measure that quantifies the degree of similarity between two sets: JI = |A∩B|/|A∪B|, where A and B are two sets or clusters.
There is no real reason for this choice, except that their construction seemed better suited to the specificities of our study. The Rand and Jaccard Indices measure the degree of similarity between two sets. The range goes from 0% to 100%; if the partition is totally different, it is 0%, and if it is strictly identical, it is 100%. Note that the Jaccard Index ignores true negatives, while the Rand Index does not [87,88].

5. Results

While it is easy to show the results of clustering methods, it is not straightforward to validate it or to compare it objectively with another one. We therefore start by showing maps of Spain with the distribution of clusters according to the 76 stations studied, and then we compare each method by using appropriate metrics. All the results obtained by these clustering methods are detailed in Appendix A Table A2.

5.1. Case of 5 Clusters

As seen previously, we had to set a number, k, for this clustering study. We arbitrarily chose k = 5 because the Köppen classification states (empirically) that there are five different climates in Spain. The results of clustering are shown in Figure 12, Figure 13, Figure 14 and Figure 15. As expected, the results related to k-means and k-medoids are equivalent. Indeed, when there is no or few outliers, these two methods are almost similar. Concerning the two other methods, there are small differences, but it is visually difficult to differentiate them. At this level, it is really difficult to distinguish between these four methods, and specific metrics will have to be used for more objectivity. Table 3 and Table 4 are presented the Rand and Jaccard Indices. The Rand and Jaccard approaches for the cluster comparison are really similar in the study. If some differences are visible, the conclusions remain the same. There is no interest in using k-means, k-medoids, and spectral separately since the clusters resulting from these models are similar (similarity higher than 95% for Rand and 91% for Jaccard). The choice to use k-medoids, hierarchical, and Köppen for geographical clustering seems quite justified given this result and given that k-medoids is in theory more robust than k-means and spectral. Let us see now if, by decreasing the number of clusters (3), this conclusion remains the same.

5.2. Case of 3 Clusters

In this study, the visual rendering of the cluster through the four methods mentioned above is available in Figure 16, Figure 17, Figure 18 and Figure 19. The k-medoids method seems to stand out from the others, but the differences are still quite difficult to distinguish. Table 5 and Table 6 present the Rand and Jaccard Indices.
When analyzing the results obtained by k-means and spectral clustering algorithms, it can be said that they present similar results in more than 90% for classes three and five. The two tables (Rand and Jaccard) are similar; this suggests that the methodology is robust and the conclusions are stable. Contrary to case k = 5, the conclusions are slightly different here, and there would be a model to add: k-means or spectral. Because of its totally different foundation from that of k-medoid, our preference is for spectral. Thus, the methodologies to use (and to test) when studying predictions that require geographic clustering are, in this case, k-medoids, hierarchical, spectral, and Köppen.

6. Summary of Some Important Milestones of This Work

The methodology applied in this study problem is divided into two parts, as illustrated by two graphical schemes:
(a)
The methodology used for analysis, correction, and validation of solar irradiance time series was presented in Figure 4. This part of the methodology was developed in Section 2.3, and the results obtained were presented in Section 2.4.
(b)
The methodology used for characterization, clustering, and decision of the number of clusters from Köppen–Geiger classification is presented in Figure 20. This part of the methodology was developed in Section 3 (characterization); in Section 4, we presented the Köppen climatic classification and clustering methods; and finally, in Section 5, we presented the maps and results.
It should be noted that, in future work, if high-quality GHI data are available, the first part of the methodology (i.e., the one presented in Figure 4) may be unnecessary to implement. As a result, only the implementation of the second part of the methodology would be necessary in a future work (without the reduction of the number of characteristic variables from five to three (the three independent variables are sufficient). In conclusion, it can be evidenced that the second part of the proposed methodology is easy to implement.

7. Conclusions and Perspectives

The objective of this paper was to cluster several sites located in Spain according to solar radiation characteristics (quantitative and qualitative), with an objective to improve the forecasting of the solar irradiations. The novelties of this paper are not in the clustering methods, because the four methods used are well-known, but in the used parameters to qualify each meteorological station. Particularly, the use of the Hurst coefficient, and mainly the forecastability one, is original.
Each cluster groups the stations not according to the solar radiation potential only, as this has been already achieved for some sites over the World and is useful, as an example, for agricultural applications, but, and above all, it regroups the stations from the solar-radiation-variability point of view, i.e., from the qualitative viewpoint. It is essential to know that this variability in energy studies and this clustering will be useful for the elaboration of forecasting model based on time series and machine-learning methods.
The quality control of solar irradiation data provided by almost a hundred meteorological stations used in irrigation works was first realized during the study period 2017–2020. It allows us to be sure that the numerous data (more than 5 million GHI data) used in this work are relevant. After this quality control, 76 stations were then selected. In calculating the clearness index to know the clear-sky solar irradiance, the CAMs McClear model was used and previously verified; it appeared that its accuracy, when applied to our data, was high.
Firstly, each station was characterized, from a solar-radiation-variability point of view, by six parameters, including both static and dynamic ones: mean, standard deviation, skewness, Kurtosis, Hurst exponent, and forecastability coefficient. The dependence between these six parameters was then studied by using Spearman’s Rank Correlation Coefficient, and the results showed a high dependency between some of them; consequently, based on the parsimony principle and to avoid the redundancy of the information, only the mean, Hurst exponent, and forecastability coefficient were used to characterize each meteorological station.
From these descriptors, the stations were grouped by similarity (the shortest distance between descriptors), using the following algorithms: k-means, k-medoids, and spectral and hierarchical clustering to identify geographical areas with similar solar irradiation characteristics at a low time step (half an hour). The clusters were compared with each other and the well-known Köppen–Geiger climate classification.
The possible relationship between the Köppen classification and the number of clusters in which these time series can be grouped was analyzed. For both cases (five classes and three classes), the hierarchical clustering algorithm is the closest to the Köppen classification. However, it is probably not the most interesting to test, as it is a more complex method with the same (similar) results as a naive clustering method.
When evaluating the performance of the clustering algorithms, it can be concluded that there is no interest in simultaneously implementing k-means and spectral clustering since the results are similar in more than 90% for classes three and five.
The results shown in this study could be used to improve GHI prediction through the time-series formalism and machine learning in the following cases:
  • To select to predictor considering that a method efficient on a meteorological site can be applied with the same efficiency of all the sites of the same cluster (i.e., with the same solar radiation variability or evolution);
  • To make a forecast on a site where a GHI measurement device has just been installed. Clustering allows us to perform learning on data measured on one or several sites with similar characteristics and then to perform transfer learning to be able to make a forecast on the new site;
  • To make GHI predictions on a site where few historical measurements are available. Clustering allows us to increase the number of training data (and thus the quality of the training by avoiding overfitting) by integrating data from other sites of the same cluster;
  • To make prediction on a site where no measurement device is available. Clustering coupled with Kriging could allow for making a forecast from measurements obtained on nearby sites with similar meteorological characteristics;
  • To improve a forecast by integrating during the learning process time-delayed data from other sites in the same cluster.
In all the previous cases, and based on the results shown previously, the authors propose to use k-means clustering or hierarchical clustering interchangeably (as many clusters as Köppen classes) based on mean, Hurst exponent, and forecastability computed from clear-sky index series (derived by CAMs estimation). However, for those who are less eager to obtain satisfactory results, the possibility of using the Köppen classification (recalculated for the time series study period) remains possible. It allows a classification that can be described as naive.

Author Contributions

This paper is the collaborative work of all authors. Conceptualization, L.G.-G. and C.V.; methodology, L.G.-G. and C.V.; software, L.G.-G.; validation, L.G.-G., C.V. and G.N.; investigation, L.G.-G.; resources, J.A.; data curation, L.G.-G.; writing—original draft preparation, L.G.-G.; writing—review and editing, C.V. and G.N.; supervision, C.V. and G.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The authors have not provided data associated with this article.

Acknowledgments

The authors would like to thank (i) the network of agroclimatic stations of the Spanish Ministry of Agriculture, Food, and Environment, specifically the agrometeorological stations network of SIAR for the information provided on solar irradiance (https://eportal.mapa.gob.es) (accessed on 2 June 2021; and (ii) the atmospheric monitoring service CAMs-McClear for the information on solar irradiance under clear sky conditions (http://www.soda-pro.com) (accessed on 10 March 2021).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Time-series characterization indices.
Table A1. Time-series characterization indices.
CodeStationLat (°)Long (°)Altitude (m)Köp Class 1981–2010Köp Class 2017–2020MeanStandard DeviationKurtosisSkewnessHF
A20Agost38.422−0.650941BSkBSk0.810.443.39−1.150.7371.91
A21Orihuela38.180−0.95996BShBSk0.820.443.87−1.300.7374.25
BA08Don Benito38.927−5.896268BSkBSk0.790.433.13−1.070.7675.35
BA09Vil. los Barros38.575−6.348406BSkBSk0.790.433.18−1.090.7673.11
BU07S. Gadea del Cid42.701−3.075525CfbBSk0.670.371.79−0.360.7551.96
C02Boimorto43.032−8.141429CsbBSk0.610.371.68−0.200.7650.28
CC16Moraleja40.066−6.688272CsaBSk0.750.422.88−0.990.7873.74
CC19Zarza de Granadilla40.207−6.033354CsaBSk0.750.422.57−0.850.7772.02
CO09Palma del Río37.725−5.22757CsaBSk0.790.433.48−1.190.7576.79
CR10Manzanares39.122−3.354645BSkBSk0.800.443.15−1.120.7674.59
CR11Montiel38.696−2.881887CsaBSk0.790.442.86−1.010.7672.42
CU09Mariana40.152−2.142941CsaBSk0.730.422.16−0.690.7767.25
GC09Antigua28.320−13.94272BWhBSk0.810.433.13−1.010.6673.83
HU01Valfarta41.531−0.148359BSkBSk0.790.433.14−1.110.7574.65
HU02Zaidín41.6360.289182BSkBSk0.780.432.89−1.040.7776.32
HU03Alcolea de Cinca41.7400.073225BSkBSk0.800.442.86−1.050.7775.72
HU04Tamarite de Litera41.7800.377218BSkBSk0.750.422.71−0.960.7775.41
HU05Lanaja41.786−0.338361BSkBSk0.790.432.93−1.010.7674.02
HU08Sariñena41.771−0.177291BSkBSk0.760.422.90−1.000.7674.90
HU09Huesca42.105−0.378432CfaBSk0.740.422.42−0.780.7774.17
HU10Candasnos41.4590.094307BSkBSk0.780.432.90−1.020.7675.48
HU11Grañén41.942−0.356323BSkBSk0.750.412.86−0.960.7774.71
HU12Huerto41.947−0.138415BSkBSk0.820.453.09−1.120.7675.65
Z06Ejea de los Caballeros42.097−1.196316BSkCfa0.760.432.81−0.970.7773.04
HU13Gurrea de Gállego41.992−0.731364BSkBSk0.790.442.84−1.010.7673.83
HU15Alfántega41.8210.148249BSkBSk0.770.432.86−1.020.7775.33
HU17Fraga41.4940.35498BSkBSk0.750.422.52−0.880.7873.75
HU18Tardienta41.969−0.508366BSkBSk0.790.442.93−1.050.7674.69
HU19San Esteban de Litera41.8820.304316BSkBSk0.810.452.82−1.040.7776.01
HU22Santa Cilia42.576−0.708733CfbCsa0.760.432.47−0.870.7771.23
IB01Santa Eulalia del Río39.0091.440122CsaBSk0.780.433.10−1.040.7470.25
M02Arganda del Rey40.310−3.498531BSkBSk0.800.442.91−1.070.7673.43
M05San Martín de la Vega40.233−3.560516BSkBSk0.780.432.83−1.010.7773.65
M06Chinchón40.192−3.469534BSkBSk0.780.432.63−0.940.7772.70
MA10Antequera37.034−4.563457CsaBSk0.790.433.39−1.180.7573.46
MU104Murcia37.977−0.984128BShBSh0.850.463.84−1.330.7374.75
MU121Murcia37.939−1.13554BShBSh0.830.453.21−1.130.7373.97
MU14Moratalla38.196−1.813458BSkBSk0.810.443.32−1.150.7373.22
NA02Fitero42.045−1.843436BSkCsa0.740.422.22−0.690.7668.78
NA03Cascante42.034−1.724346BSkBSk0.750.422.39−0.780.7669.68
NA04Ablitas41.996−1.645338BSkBSk0.770.432.49−0.880.7670.05
NA05Aibar/Oibar42.558−1.316420CfaCsa0.750.422.22−0.710.7869.71
NA07Murillo el Fruto42.384−1.487348CfaCsa0.750.422.57−0.890.7770.52
NA08Adiós42.686−1.747443CfbCsa0.740.431.99−0.600.7868.79
NA09Artajona42.583−1.791360CfaCfa0.730.422.16−0.670.7768.89
NA10Miranda de Arga42.510−1.809345CfaCsa0.730.412.17−0.650.7869.05
NA11Falces42.422−1.792292CfaCsa0.750.422.30−0.740.7769.31
NA13Bargota42.477−2.299382BSkCfa0.710.412.04−0.620.7767.41
NA15Arcos, Los42.539−2.185421CfaCfa0.720.412.03−0.590.7767.10
NA16Sesma42.473−2.127456CfaCsa0.730.422.08−0.620.7767.75
NA18Tudela42.093−1.577243BSkBSk0.760.432.50−0.830.7771.60
P08Lantadilla42.345−4.278793CsbCsb0.750.422.24−0.740.7969.95
TE01Calanda40.960−0.210439BSkBSk0.790.442.91−1.050.7571.79
TE03Híjar41.215−0.530306BSkBSk0.810.452.97−1.070.7573.90
TE04Monreal del Campo40.780−1.355950BSkBSk0.740.422.38−0.780.7568.26
TE05Teruel40.347−1.166914BSkBSk0.710.412.07−0.620.7567.18
TO12Mora39.664−3.773735BSkBSk0.810.443.15−1.130.7672.49
V14Algemesí39.216−0.43619CsaCsa0.790.443.10−1.060.7473.92
V25Bolbaite39.068−0.690267CsaCsa0.680.392.46−0.850.7469.96
V26Bétera39.598−0.46897BSkBSk0.780.433.48−1.180.7473.82
V27Chulilla39.676−0.832378BSkBSk0.800.443.18−1.130.7373.14
V28Godelleta39.421−0.677270CsaCsa0.770.433.20−1.110.7471.87
V29Bèlgida38.879−0.454281CsaCsa0.760.423.22−1.090.7473.01
VA08Medina de Rioseco41.860−5.071727CsbCsb0.770.432.44−0.810.7871.24
Z01Almonacid de la Sierra41.451−1.330384BSkBSk0.760.432.55−0.900.7670.62
Z14Borja41.854−1.508378BSkCsa0.770.432.50−0.870.7670.33
Z16Caspe41.303−0.071175BSkBSk0.750.422.67−0.860.7774.69
Z17Osera de Ebro41.544−0.537251BSkBSk0.800.443.04−1.110.7674.63
Z18Daroca41.107−1.425748BSkBSk0.680.401.77−0.400.7464.08
Z21Tauste41.999−1.143353BSkBSk0.780.432.88−1.010.7772.31
Z22Boquiñeni41.842−1.250227BSkBSk0.760.422.76−0.950.7671.32
Z23Pastriz41.593−0.731182BSkBSk0.810.452.90−1.030.7674.29
Z24Calatayud41.362−1.615523BSkBSk0.740.422.39−0.790.7769.08
Z25Tauste41.905−1.310237BSkBSk0.770.422.80−0.950.7672.36
Z26Zuera41.888−0.766288BSkBSk0.780.432.92−1.020.7773.66
ZA08Toro41.507−5.366652CsbCsa0.770.432.52−0.860.7871.39
Table A2. Clustering by method and number of clusters.
Table A2. Clustering by method and number of clusters.
5 Classes3 Classes
CodeStationk-MeansSpectralk-MedoidsHierarchicalk-MeansSpectralk-MedoidsHierarchical
A20Agost15143221
A21Orihuela45533222
BA08Don Benito12143221
BA09Villafranca de los Barros12143221
BU07Santa Gadea del Cid24352313
C02Boimorto24322313
CC16Moraleja51241121
CC19Zarza de Granadilla33441131
CO09Palma del Río15143221
CR10Manzanares12143221
CR11Montiel51241121
CU09Mariana24342311
GC09Antigua12113221
HU01Valfarta12143221
HU02Zaidín51241121
HU03Alcolea de Cinca51241121
HU04Tamarite de Litera51241131
HU05Lanaja51241121
HU08Sariñena51241121
HU09Huesca33442331
HU10Candasnos51241121
HU11Grañén51241121
HU12Huerto12143221
Z06Ejea de los Caballeros51241131
HU13Gurrea de Gállego51241121
HU15Alfántega51241121
HU17Fraga33441131
HU18Tardienta51241121
HU19San Esteban de Litera51241121
HU22Santa Cilia33441331
IB01Santa Eulalia del Río12143221
M02Arganda del Rey51241121
M05San Martín de la Vega51241121
M06Chinchón33441131
MA10Antequera15143221
MU104Murcia45533222
MU121Murcia12143221
MU14Moratalla15143221
NA02Fitero24342311
NA03Cascante33442331
NA04Ablitas33441131
NA05Aibar/Oibar24342311
NA07Murillo el Fruto33441131
NA08Adiós24342311
NA09Artajona24342311
NA10Miranda de Arga24342311
NA11Falces34442331
NA13Bargota24342311
NA15Arcos, Los24342311
NA16Sesma24342311
NA18Tudela33441331
P08Lantadilla34342311
TE01Calanda51241121
TE03Híjar51241121
TE04Monreal del Campo33442331
TE05Teruel24342311
TO12Mora12143221
V14Algemesí12143221
V25Bolbaite33441331
V26Bétera15143221
V27Chulilla12143221
V28Godelleta12143221
V29Bèlgida12143221
VA08Medina de Rioseco33442331
Z01Almonacid de la Sierra33441131
Z14Borja33441131
Z16Caspe33441131
Z17Osera de Ebro12143221
Z18Daroca24352313
Z21Tauste51241121
Z22Boquiñeni51241131
Z23Pastriz51241121
Z24Calatayud33442331
Z25Tauste51241131
Z26Zuera51241121
ZA08Toro33441131

References

  1. Viera da Rosa, A.; Ordoñez, J.C. Fundamentals of Renewable Energy Processes; Academic Press: Cambridge, MA, USA, 2022. [Google Scholar] [CrossRef]
  2. Moukhtar, I.; El Dein, A.Z.; Elbaset, A.A.; Mitani, Y. Economic Study of Solar Energy Systems. In Solar Energy Power Systems; Springer: Cham, Switzerland, 2021. [Google Scholar] [CrossRef]
  3. Kabir, E.; Kumar, P.; Kumar, S.; Adelodun, A.A.; Kim, K.H. Solar energy: Potential and future prospects. Renew. Sustain. Energy Rev. 2018, 82, 894–900. [Google Scholar] [CrossRef]
  4. Kannan, N.; Vakeesan, D. Solar energy for future world: A review. Renew. Sustain. Energy Rev. 2016, 62, 1092–1105. [Google Scholar] [CrossRef]
  5. Zheng, J.; Zhang, H.; Dai, Y.; Wang, B.; Zheng, T.; Liao, Q.; Liang, Y.; Zhang, F.; Song, X. Time series prediction for output of multi-region solar power plants. Appl. Energy 2020, 257, 114001. [Google Scholar] [CrossRef]
  6. Sørensen, B. Solar Energy Storage; Academic Press: Copenhagen, Denmark, 2015. [Google Scholar] [CrossRef]
  7. Stoustrup, J.; Annaswamy, A.; Chakrabortty, A.; Qu, Z. Smart Grid Control; Springer International Publishing: Berlin, Germany, 2019. [Google Scholar] [CrossRef]
  8. Blaga, R.; Sabadus, A.; Stefu, N.; Dughir, C.; Paulescu, M.; Badescu, V. A current perspective on the accuracy of incoming solar energy forecasting. Prog. Energy Combust. Sci. 2019, 70, 119–144. [Google Scholar] [CrossRef]
  9. Notton, G.; Nivet, M.L.; Voyant, C.; Paoli, C.; Darras, C.; Motte, F.; Fouillot, A. Intermittent and stochastic character of renewable energy sources: Consequences, cost of intermittence and benefit of forecasting. Renew. Sustain. Energy Rev. 2018, 87, 96–105. [Google Scholar] [CrossRef]
  10. Perez, R. Wind Field and Solar Radiation Characterization and Forecasting: A Numerical Approach for Complex Terrain; Springer: Berlin, Germany, 2018. [Google Scholar] [CrossRef]
  11. Doorga, J.R.S.; Rughooputh, S.D.D.V.; Boojhawon, R. Modelling the global solar radiation climate of Mauritius using regression techniques. Renew. Energy 2019, 131, 861–878. [Google Scholar] [CrossRef]
  12. Fouilloy, A.; Voyant, C.; Notton, G.; Motte, F.; Paoli, C.; Nivet, M.L.; Guillot, E.; Duchaud, J.L. Solar irradiation prediction with machine learning: Forecasting models selection method depending on weather variability. Energy 2018, 165, 620–629. [Google Scholar] [CrossRef]
  13. Wang, L.; Kisi, O.; Zounemat-Kermani, M.; Salazar, G.A.; Zhu, Z.; Gong, W. Solar radiation prediction using different techniques: Model evaluation and comparison. Renew. Sustain. Energy Rev. 2016, 61, 384–397. [Google Scholar] [CrossRef]
  14. Zebari, R.; Abdulazeez, A.; Zeebaree, D.; Zebari, D.; Saeed, J.A. Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction. J. Appl. Sci. Technol. Trends 2020, 1, 56–70. [Google Scholar] [CrossRef]
  15. Borra, S.; Thanki, R.; Dey, N. Satellite Image Analysis: Clustering and Classification; Springer Briefs in Applied Sciences and Technology; Springer: Singapore, 2019. [Google Scholar] [CrossRef]
  16. Warren Liao, T. Clustering of time series data A survey. Pattern Recognit. 2005, 38, 1857–1874. [Google Scholar] [CrossRef]
  17. Wang, X.; Smith, K.; Hyndman, R. Characteristic-based clustering for time series data. Data Min. Knowl. Discov. 2006, 13, 335–364. [Google Scholar] [CrossRef]
  18. Aghabozorgi, S.; Seyed Shirkhorshidi, A.; Ying Wah, Y. Time-series clustering-A decade review. Inf. Syst. 2015, 53, 16–38. [Google Scholar] [CrossRef]
  19. Maharaj, E.A.; D’Urso, P.; Caiado, J. Time Series Clustering and Classification, 1st ed.Chapman and Hall/CRC Press: New York, NY, USA, 2019. [Google Scholar] [CrossRef]
  20. Tripathi, S.L.; Rishiwal, M.K.D.V.; Padmanaban, S. Introduction to AI Techniques for Renewable Energy Systems, 1st ed.; CRC Press: New York, NY, USA, 2021; ISBN 978-0367610920. [Google Scholar]
  21. Hartmann, B. Comparing various solar irradiance categorization methods—A critique on robustness. Renew. Energy 2020, 154, 661–671. [Google Scholar] [CrossRef]
  22. Jiménez-Pérez, P.F.; Mora-López, L. Modeling and forecasting hourly global solar radiation using clustering and classification techniques. Sol. Energy 2016, 135, 682–691. [Google Scholar] [CrossRef]
  23. Liu, Y.; Zhou, Y.; Wang, D.; Wang, Y.; Li, Y.; Zhu, Y. Classification of solar radiation zones and general models for estimating the daily global solar radiation on horizontal surfaces in China. Energy Convers. Manag. 2017, 154, 168–179. [Google Scholar] [CrossRef]
  24. Hassan, M.A.; Abubakr, M.; Khalil, A. A profile-free non-parametric approach towards generation of synthetic hourly global solar irradiation data from daily totals. Renew. Energy 2021, 167, 613–628. [Google Scholar] [CrossRef]
  25. Laguarda, A.; Alonso-Suárez, R.; Terra, R. Solar irradiation regionalization in Uruguay: Understanding the interannual variability and its relation to El Niño climatic phenomena. Renew. Energy 2020, 158, 444–452. [Google Scholar] [CrossRef]
  26. Pham, T.T.N.; Pham, T.H.; Vu, T.H. Satellite-Based Regionalization of Solar Irradiation in Vietnam by k-Means Clustering. J. Appl. Meteorol. Climatol. 2021, 60, 391–402. [Google Scholar] [CrossRef]
  27. Maldonado-Salguero, P.; Bueso-Sanchez, M.C.; Molina-Garcia, A.; Sanchez-Lozano, J.M. Spatio-Temporal Dynamic Clustering Modeling for Solar Irradiance Resource Assessment. 2022. Available online: https://ssrn.com/abstract=4121126 (accessed on 1 August 2022). [CrossRef]
  28. Feng, C.; Cui, M.; Hodge, B.M.; Lu, S.; Hamann, H.F.; Zhang, J. Unsupervised Clustering-Based Short-Term Solar Forecasting. IEEE Trans. Sustain. Energy 2019, 10, 2174–2185. [Google Scholar] [CrossRef]
  29. Malakar, S.; Goswami, S.; Ganguli, B.; Chakrabarti, A.; Roy, S.S.; Boopathi, K.; Rangaraj, A.G. Deep-Learning-Based Adaptive Model for Solar Forecasting Using Clustering. Energies 2022, 15, 3568. [Google Scholar] [CrossRef]
  30. Nasraoui, O.; Ben N’Cir, C.E. Clustering Methods for Big Data Analytics; Springer: Cham, Switzerland, 2019. [Google Scholar] [CrossRef]
  31. Ministerio de Agricultura, Pesca y Alimentación. 2018. Available online: https://www.mapa.gob.es/en/ (accessed on 12 August 2021).
  32. Beck, H.E.; Zimmermann, N.E.; McVicar, T.R.; Vergopolan, N.; Berg, A.; Wood, E.F. Present and future köppen-geiger climate classification maps at 1-km resolution. Sci. Data 2018, 5, 180214. [Google Scholar] [CrossRef] [Green Version]
  33. Trapletti, A.; Leisch, F.; Hornik, K. Stationary and Integrated Autoregressive Neural Network Processes. Neural Comput. 2000, 12, 2427–2450. [Google Scholar] [CrossRef]
  34. Badescu, V.; Gueymard, C.A.; Cheval, S.; Oprea, C.; Baciu, M.; Dumetrescu, A.; Iacobescu, F.; Milos, I.; Rada, C. Computing global and diffuse solar hourly irradiation on clear sky. Review and testing of 54 models. Renew. Sustain. Energy Rev. 2012, 16, 1636–1656. [Google Scholar] [CrossRef]
  35. Ineichen, P. Validation of models that estimate the clear sky global and beam solar irradiance. Sol. Energy 2016, 132, 332–344. [Google Scholar] [CrossRef]
  36. Mueller, R.W.; Dagestad, K.F.; Ineichen, P.; Schroedler Homscheidt, M.; Cros, S.; Dumortier, D.; Kuhlemann, R.; Olseth, J.; Piernavieja, G.; Reise, C.; et al. Rethinking satellite-based solar irradiance modelling: The SOLIS clear-sky module. Remote Sens. Environ. 2004, 91, 160–174. [Google Scholar] [CrossRef]
  37. Ineichen, P. A broadband simplified version of the Solis clear sky model. Sol. Energy 2008, 82, 758–762. [Google Scholar] [CrossRef]
  38. Rigollier, C.; Bauer, O.; Wald, L. Radiation atlas with respect to the heliosat method. Sol. Energy 2000, 68, 33–48. [Google Scholar] [CrossRef]
  39. Gueymard, C.A. REST2: High-performance solar radiation model for cloudless-sky irradiance, illuminance, and photosynthetically active radiation-Validation with a benchmark dataset. Sol. Energy 2008, 82, 272–285. [Google Scholar] [CrossRef]
  40. Qu, Z.; Oumbe, A.; Blanc, P.; Espinar, B.; Gesell, G.; Gschwind, B.; Klüser, L.; Lefèvre, M.; Saboret, L.; Schroedter-Homscheidt, M.; et al. Fast radiative transfer parameterisation for assessing the surface solar irradiance: The Heliosat-4 method. Meteorol. Z. 2017, 26, 33–57. [Google Scholar] [CrossRef]
  41. Lefèvre, M.; Oumbe, A.; Blanc, P.; Espinar, B.; Gschwind, B.; Qu, Z.; Wald, L.; Schroedter-Homscheidt, M.; Hoyer-Klick, C.; Arola, A.; et al. McClear: A new model estimating downwelling solar radiation at ground level in clear-sky conditions. Atmos. Meas. Tech. 2013, 6, 2403–2418. [Google Scholar] [CrossRef]
  42. Gschwind, B.; Wald, L.; Blanc, P.; Lefèvre, M.; Schroedter-Homscheidt, M.; Arola, A. Improving the McClear model estimating the downwelling solar radiation at ground level in cloud-free conditions-McClear-v3. Meteorol. Z. 2019, 28, 147–163. [Google Scholar] [CrossRef]
  43. Monitoring Atmospheric Composition and Climate|Copernicus. 2021. Available online: https://www.copernicus.eu/en/monitoring-atmospheric-composition-and-climate (accessed on 7 October 2021).
  44. Espinar, B.; Blanc, P.; Wald, L.; Hoyer-Klick, C.; Schroedter-Homscheidt, M.; Wanderer, T. On Quality Control Procedures for Solar Radiation and Meteorological Measures, from Subhourly to Monthly Average Time Periods; EGU General Assembly: Vienna, Austria, 2012; Available online: http://elib.dlr.de/80168/ (accessed on 23 March 2021).
  45. El Alani, O.; Ghennioui, H.; Ghennioui, G.; Saint-Drenan, Y.M.; Blanc, P.; Hanrieder, N.; Dahr, F.E. A visual support of standard procedures for solar radiation quality control. Int. J. Renew. Energy Dev. 2021, 10, 401–414. [Google Scholar] [CrossRef]
  46. Yesilbudak, M.; Colak, M.; Bayindir, R. A review of data mining and solar power prediction. In Proceedings of the 2016 IEEE International Conference on Renewable Energy Research and Applications (ICRERA), Birmingham, UK, 20–23 November 2016; pp. 1117–1121. [Google Scholar] [CrossRef]
  47. Forstinger, A.; Wilbert, S.; Driesse, A.; Hanrieder, N.; Affolter, R.; Kumar, S.; Goswami, N.; Geuder, N.; Vignola, F.; Zarzalejo, L.; et al. Physically based correction of systematic errors of Rotating Shadowband Irradiometers. Meteorol. Z. 2020, 29, 19–39. [Google Scholar] [CrossRef]
  48. Yang, D. Solar radiation on inclined surfaces: Corrections and benchmarks. Sol. Energy 2016, 136, 288–302. [Google Scholar] [CrossRef]
  49. Kosmopoulos, P.G.; Kazadzis, S.; Taylor, M.; Raptis, P.L.; Keramitsoglou, I.; Kiranoudis, C.; Bais, A.F. Assessment of surface solar irradiance derived from real-time modelling techniques and verification with ground-based measurements. Atmos. Meas. Tech. 2018, 11, 907–924. [Google Scholar] [CrossRef]
  50. Walpole, R.; Myers, R.; Myers, S.; Ye, K. Probability & Statistics for Engineers & Scientists; Pearson Ed.: Edinburgh Gate, UK, 2016. [Google Scholar]
  51. Bojanowski, J.S.; Vrieling, A.; Skidmore, A.K. A comparison of data sources for creating a long-term time series of daily gridded solar radiation for Europe. Sol. Energy 2014, 99, 152–171. [Google Scholar] [CrossRef]
  52. David, D.P.; Seward, L.E. Measuring Skewness: A Forgotten Statistic? J. Stat. Educ. 2011, 19, 1–18. [Google Scholar] [CrossRef]
  53. Brys, G.; Hubert, M.; Struyf, A. A Robust Measure of Skewness. J. Comput. Graph. Stat. 2004, 13, 996–1017. [Google Scholar] [CrossRef]
  54. Mohammed, M.B.; Adam, M.B.; Ali, N.; Zulkafli, H.S. Improved frequency table’s measures of skewness and kurtosis with application to weather data. Commun. Stat. Theory Methods Commun. Stat. Theory Methods 2022, 51, 581–598. [Google Scholar] [CrossRef]
  55. Groeneveld, R.A.; Meeden, G. Measuring Skewness and Kurtosis. J. R. Stat. Soc. Ser. D (Stat.) 1984, 33, 391–399. [Google Scholar] [CrossRef]
  56. Ruppert, D. What is Kurtosis? An Influence Function Approach. Am. Stat. 1987, 41, 1–5. [Google Scholar] [CrossRef]
  57. Girone, G.; Massari, A.; Campobasso, F.; D’Uggento, A.M.; Marin, C.; Manca, F. A proposal of new disnormality indexes. Commun. Stat.-Theory Methods 2021, 1–17. [Google Scholar] [CrossRef]
  58. Yang, D.; Dong, Z.; Lim, L.H.I.; Liu, L. Analyzing big time series data in solar engineering using features and PCA. Sol. Energy 2017, 153, 317–328. [Google Scholar] [CrossRef]
  59. Mandelbrot, B.B. Self-affine fractals and fractal dimension. Phys. Scr. 1985, 32, 257–260. [Google Scholar] [CrossRef]
  60. Cadenas, E.; Campos-Amezcua, R.; Rivera, W.; Espinosa-Medina, M.A.; Méndez-Gordillo, A.R.; Rangel, E.; Tena, J. Wind speed variability study based on the Hurst coefficient and fractal dimensional analysis. Energy Sci Eng. 2019, 7, 361–378. [Google Scholar] [CrossRef]
  61. Barbulescu, A.; Serban, C.; Maftei, C. Statistical analysis and evaluation of Hurst coefficient for annual and monthly precipitation time series. WSEAS Trans. Math. 2010, 10, 791–800. [Google Scholar]
  62. Shesh, S.R.; Koirala, R.; Gentry, R.; Perfect, E.; Mulholland, P.J.; Schwartz, J.S. Hurst Analysis of Hydrologic and Water Quality Time Series. J. Hydrol. Eng. 2011, 16, 717–724. [Google Scholar] [CrossRef]
  63. Mielniczuk, J.; Wojdyłło, P. Estimation of Hurst exponent revisited. Comput. Stat. Data Anal. 2007, 51, 4510–4525. [Google Scholar] [CrossRef]
  64. López-Lambraño, A.; Carrillo-Yee, E.; Fuentes, C.; López-Ramos, A.; López-Lambraño, M. Una revisión de los métodos para estimar el exponente de Hurst y la dimensión fractal en series de precipitación y temperatura. Rev. Mex. Fis. 2017, 63, 244–267. [Google Scholar]
  65. Notton, G.; Voyant, C. Chapter 3: Forecasting of Intermittent Solar Energy Resource. In Advances in Renewable Energies and Power Technologies, 1st ed.; Yahyaoui, I., Ed.; Elsevier Inc.: Amsterdam, The Netherlands, 2018; pp. 77–114. [Google Scholar] [CrossRef]
  66. Voyant, C.; Lauret, P.; Notton, G.; Duchaud, J.L.; Fouilloy, A.; David, M.; Mundher Yaseen, Z.; Soubdhan, T. A Monte Carlo based solar radiation forecastability estimation. J. Renew. Sustain. Energy 2021, 13, 1–13. [Google Scholar] [CrossRef]
  67. Wang, Z.; Lv, J.; Tan, Y.; Guo, M.; Gu, Y.; Xu, S.; Zhou, Y. Temporospatial variations and Spearman correlation analysis of ozone concentrations to nitrogen dioxide, sulfur dioxide, particulate matters and carbon monoxide in ambient air, China. Atmos. Pollut. Res. 2019, 10, 1203–1210. [Google Scholar] [CrossRef]
  68. Welcome to the QGIS Project! 2021. Available online: https://qgis.org/en/site/ (accessed on 25 November 2021).
  69. Agencia Estatal de Meteorología; Ministerio de Medio Ambiente y Rural y Marino; Instituto de Meteorologia de Portugal. Atlas Climático Ibérico/Iberian Climate Atlas; Agencia Estatal de Meteorología: Madrid, Spain, 2011; ISBN 978-84-7837-079-5. [CrossRef]
  70. Fortuna, L.; Nunnari, G.; Nunnari, S. Nonlinear Modeling of Solar Radiation and Wind Speed Time Series, 1st ed.; Springer: Cham, Switzerland, 2016. [Google Scholar] [CrossRef]
  71. Wu, J.; Chan, C.K.; Zhang, Y.; Xiong, B.Y.; Zhang, Q.H. Prediction of solar radiation with genetic approach combing multi-model framework. Renew. Energy 2014, 66, 132–139. [Google Scholar] [CrossRef]
  72. Prasad, J.C.; Prasad, M.V.N.K.; Nickolas, S.; Gangadharan, G.R. Trendlets: A novel probabilistic representational structures for clustering the time series data. Expert Syst. Appl. 2020, 145, 113119. [Google Scholar] [CrossRef]
  73. Friedman, J.; Hastie, T.; Tibshirani, R. The Elements of Statistical Learning Data Mining, Inference and Prediction, 2nd ed.; Springer Series in Statistics; Springer: New York, NY, USA, 2009. [Google Scholar] [CrossRef]
  74. Likas, A.; Vlassis, N.; Verbeek, J.J. The global k-means clustering algorithm. Pattern Recognit. 2003, 36, 451–461. [Google Scholar] [CrossRef]
  75. Park, H.S.; Jun, C.H. A simple and fast algorithm for K-medoids clustering. Expert Syst. Appl. 2009, 36, 3336–3341. [Google Scholar] [CrossRef]
  76. Von Luxburg, U. A tutorial on spectral clustering. Stat. Comput. 2007, 17, 395–416. [Google Scholar] [CrossRef]
  77. Bradley, P.S.; Fayyad, U.M. Refining initial points for k-means clustering. In Proceedings of the 15th International Conference on Machine Learning, Madison, WI, USA, 24–27 July 1998; pp. 91–99. [Google Scholar]
  78. Halkidi, M.; Batistakis, Y.; Vazirgiannis, M. On clustering validation techniques. J. Intell. Inf. Syst. (JIIS) 2001, 17, 107–145. [Google Scholar] [CrossRef]
  79. Keogh, E.; Lin, J.; Truppel, W. Clustering of time series subsequences is meaningless: Implications for past and future research. In Proceedings of the Third IEEE International Conference on Data Mining, Melbourne, FL, USA, 22 November 2003; pp. 115–122. [Google Scholar]
  80. Ezugwu, E.; Ikotun, M.; Oyelade, O.; Abualigah, L.; Agushaka, O.; Eke, I.; Akinyelu, A. A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects. Eng. Appl. Artif. Intell. 2022, 110, 104743. [Google Scholar] [CrossRef]
  81. Scitovski, R.; Sabo, K.; Martínez-Álvarez, F.; Ungar, S. Cluster analysis and Applications, 1st ed.; Springer: Cham, Switzerland, 2021. [Google Scholar] [CrossRef]
  82. Estivill-Castro, V. Why so many clustering algorithms: A position paper. ACM SIGKDD Explor. Newsl. 2002, 4, 65–75. [Google Scholar] [CrossRef]
  83. Wierzchoń, S.T.; Kłopotek, M.A. Modern Algorithms of Cluster Analysis, 1st ed.; Springer: Cham, Switzerland, 2018. [Google Scholar] [CrossRef]
  84. Liu, Y.; Li, Z.; Xiong, H.; Gao, X.; Wu, J. Understanding of internal clustering validation measures. In Proceedings of the 2010 IEEE International Conference on Data Mining, ICDM, Sydney, NSW, Australia, 14–17 December 2010; pp. 911–916. [Google Scholar] [CrossRef]
  85. Maulik, U.; Bandyopadhyay, S. Performance evaluation of some clustering algorithms and validity indices. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 1650–1654. [Google Scholar] [CrossRef]
  86. Amigó, E.; Gonzalo, J.; Artiles, J.; Verdejo, F. A comparison of extrinsic clustering evaluation metrics based on formal constraints. Inf. Retr. Boston 2009, 12, 461–486. [Google Scholar] [CrossRef]
  87. Rand, W.M. Objective Criteria for the Evaluation of Clustering Methods. J. Am. Stat. Assoc. 1971, 66, 846–850. [Google Scholar] [CrossRef]
  88. Wagner, S.; Wagner, D. Comparing Clusterings—An Overview. 2007. Available online: https://publikationen.bibliothek.kit.edu/1000011477 (accessed on 3 March 2021). [CrossRef]
Figure 1. Positions of the weather stations considered in this study with solar data available from 1 January 2017 to 31 December 2020. In red, stations are not used because the data are not considered reliable. In yellow, the stations used. The geographical coordinates of the weather stations can be found in Reference [31].
Figure 1. Positions of the weather stations considered in this study with solar data available from 1 January 2017 to 31 December 2020. In red, stations are not used because the data are not considered reliable. In yellow, the stations used. The geographical coordinates of the weather stations can be found in Reference [31].
Applsci 12 08529 g001
Figure 2. Presentation of GHI and GHIcs for 2 meteorological stations (V29 and C01) and 2 periods of 5 days in 2020 (winter and spring).
Figure 2. Presentation of GHI and GHIcs for 2 meteorological stations (V29 and C01) and 2 periods of 5 days in 2020 (winter and spring).
Applsci 12 08529 g002
Figure 3. Presentation of GHI and GHIcs for 2 meteorological stations (V29 and C01) in 2020.
Figure 3. Presentation of GHI and GHIcs for 2 meteorological stations (V29 and C01) in 2020.
Applsci 12 08529 g003
Figure 4. Proposed methodology for evaluation, correction, and cleaning of solar-irradiance data series.
Figure 4. Proposed methodology for evaluation, correction, and cleaning of solar-irradiance data series.
Applsci 12 08529 g004
Figure 5. Clear-sky modeling corrected with 20 min offset in A Capela Station (C01) during 2020.
Figure 5. Clear-sky modeling corrected with 20 min offset in A Capela Station (C01) during 2020.
Applsci 12 08529 g005
Figure 6. Visual validation for V29 and C01. X-axis is the day; Y-axis is the time in Universal Time Coordinated (UTC). The color of the surface, from blue (0 W·m−2) to yellow (1000 W·m−2), is the value of the data.
Figure 6. Visual validation for V29 and C01. X-axis is the day; Y-axis is the time in Universal Time Coordinated (UTC). The color of the surface, from blue (0 W·m−2) to yellow (1000 W·m−2), is the value of the data.
Applsci 12 08529 g006
Figure 7. The kt profiles and histograms for V29 and C01.
Figure 7. The kt profiles and histograms for V29 and C01.
Applsci 12 08529 g007
Figure 8. Descriptors correlations.
Figure 8. Descriptors correlations.
Applsci 12 08529 g008
Figure 9. Boxplot: red line represents the median; blue lines represent the 3rd quartile (up) and 1st quartile (down); and black broken lines are the extremities—min and max values.
Figure 9. Boxplot: red line represents the median; blue lines represent the 3rd quartile (up) and 1st quartile (down); and black broken lines are the extremities—min and max values.
Applsci 12 08529 g009
Figure 10. Köppen classification, updated from SIAR data for the years 2017–2020.
Figure 10. Köppen classification, updated from SIAR data for the years 2017–2020.
Applsci 12 08529 g010
Figure 11. Main clustering techniques.
Figure 11. Main clustering techniques.
Applsci 12 08529 g011
Figure 12. Using k-means for 5 clusters.
Figure 12. Using k-means for 5 clusters.
Applsci 12 08529 g012
Figure 13. Using k-medoids for 5 clusters.
Figure 13. Using k-medoids for 5 clusters.
Applsci 12 08529 g013
Figure 14. Using spectral for 5 clusters.
Figure 14. Using spectral for 5 clusters.
Applsci 12 08529 g014
Figure 15. Using hierarchical for 5 clusters.
Figure 15. Using hierarchical for 5 clusters.
Applsci 12 08529 g015
Figure 16. Using k-means for 3 clusters.
Figure 16. Using k-means for 3 clusters.
Applsci 12 08529 g016
Figure 17. Using k-medoids for 3 clusters.
Figure 17. Using k-medoids for 3 clusters.
Applsci 12 08529 g017
Figure 18. Using spectral for 3 clusters.
Figure 18. Using spectral for 3 clusters.
Applsci 12 08529 g018
Figure 19. Using hierarchical for 3 clusters.
Figure 19. Using hierarchical for 3 clusters.
Applsci 12 08529 g019
Figure 20. Various steps of the methodology.
Figure 20. Various steps of the methodology.
Applsci 12 08529 g020
Table 1. SIAR stations and quality control.
Table 1. SIAR stations and quality control.
2020201920182017
Total SIAR station542
Active SIAR Stations448
Selected * SIAR Stations94848278
Discarded ** SIAR stations10242
Subtotal84827876
* Solar data available and ** test failure (Section 2.3).
Table 2. Comparison of the main characteristics of the clustering algorithms [80].
Table 2. Comparison of the main characteristics of the clustering algorithms [80].
Clustering MethodBasis of AlgorithmInput to AlgorithmRequires Specified Number of ClustersCluster Shapes Identified
Hierarchical Distance between objectsPairwise distances between observationsNoArbitrarily shaped clusters, depending on the specified “Linkage” algorithm
k-Means
k-Medoids
Distance between objects and centroidsActual observationsYesSpheroidal clusters with equal diagonal covariance
Spectral Graph representing connections between data pointsActual observations or similarity matrixYes, but the algorithm also provides a way to estimate the number of clustersArbitrarily shaped clusters
Table 3. Rand Index (RI) for 5 clusters.
Table 3. Rand Index (RI) for 5 clusters.
k-Means
(%)
Spectral
(%)
k-Medoids
(%)
Hierarchical
(%)
Köppen
(%)
k-means10095993553
Spectral95100963252
k-medoids99961003553
Hierarchical 35323510051
Köppen53525351100
Table 4. Jaccard Index (JI) for 5 clusters.
Table 4. Jaccard Index (JI) for 5 clusters.
k-Means
(%)
Spectral
(%)
k-Medoids
(%)
Hierarchical
(%)
Köppen
(%)
k-means10091993749
Spectral91100923747
k-medoids99921003749
Hierarchical 37373710064
Köppen49474964100
Table 5. Rand Index (RI) for 3 clusters.
Table 5. Rand Index (RI) for 3 clusters.
k-Means
(%)
Spectral
(%)
k-Medoids
(%)
Hierarchical
(%)
Köppen
(%)
k-means10095704151
Spectral95100694052
k-medoids70691004460
Hierarchical 41404410053
Köppen51526053100
Table 6. Jaccard Index (JI) for 3 clusters.
Table 6. Jaccard Index (JI) for 3 clusters.
k-Means
(%)
Spectral
(%)
k-Medoids
(%)
Hierarchical
(%)
Köppen
(%)
k-means10096675358
Spectral96100634958
k-medoids67631005455
Hierarchical 53495410062
Köppen58585562100
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Garcia-Gutierrez, L.; Voyant, C.; Notton, G.; Almorox, J. Evaluation and Comparison of Spatial Clustering for Solar Irradiance Time Series. Appl. Sci. 2022, 12, 8529. https://doi.org/10.3390/app12178529

AMA Style

Garcia-Gutierrez L, Voyant C, Notton G, Almorox J. Evaluation and Comparison of Spatial Clustering for Solar Irradiance Time Series. Applied Sciences. 2022; 12(17):8529. https://doi.org/10.3390/app12178529

Chicago/Turabian Style

Garcia-Gutierrez, Luis, Cyril Voyant, Gilles Notton, and Javier Almorox. 2022. "Evaluation and Comparison of Spatial Clustering for Solar Irradiance Time Series" Applied Sciences 12, no. 17: 8529. https://doi.org/10.3390/app12178529

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop