On the Performance of Multi-Instrument Solar Flare Observations During Solar Cycle 24

The current fleet of space-based solar observatories offers us a wealth of opportunities to study solar flares over a range of wavelengths. Significant advances in our understanding of flare physics often come from coordinated observations between multiple instruments. Consequently, considerable efforts have been, and continue to be, made to coordinate observations among instruments (e.g. through the Max Millennium Program of Solar Flare Research). However, there has been no study to date that quantifies how many flares have been observed by combinations of various instruments. Here we describe a technique that retrospectively searches archival databases for flares jointly observed by the Ramaty High Energy Solar Spectroscopic Imager (RHESSI), Solar Dynamics Observatory (SDO)/EUV Variability Experiment (EVE – Multiple EUV Grating Spectrograph (MEGS)-A and -B, Hinode/(EUV Imaging Spectrometer, Solar Optical Telescope, and X-Ray Telescope), and Interface Region Imaging Spectrograph (IRIS). Out of the 6953 flares of GOES magnitude C1 or greater that we consider over the 6.5 years after the launch of SDO, 40 have been observed by 6 or more instruments simultaneously. Using each instrument’s individual rate of success in observing flares, we show that the numbers of flares co-observed by 3 or more instruments are higher than the number expected under the assumption that the instruments operated independently of one another. In particular, the number of flares observed by larger numbers of instruments is much higher than expected. Our study illustrates that these missions often acted in cooperation, or at least had aligned goals. We also provide details on an interactive widget (Solar Flare Finder), now available in SSWIDL, which allows a user to search for flaring events that have been observed by a chosen set of instruments. This provides access to a broader range of events in order to answer specific science questions. The difficulty in scheduling coordinated observations for solar-flare research is discussed with respect to instruments projected to begin operations during Solar Cycle 25, such as the Daniel K. Inouye Solar Telescope, Solar Orbiter, and Parker Solar Probe.


Introduction
The study of solar flares is a high-priority research area in the international heliophysics community. Understanding the physics of these energetic events is crucial, not only for the field of space weather, but also in the broader scope of astrophysics where similar processes are believed to occur in stellar flares, black-hole accretion disks, and in the Earth's magnetotail. Observations of solar flares are made by many different instruments, both in space and on the ground. These instruments provide imaging, photometric, and spectroscopic data over a range of wavelengths, from radio waves through the optical and EUV to X-rays and γ -rays: often the greatest advances in our understanding of solar flares come through various combinations of these datasets. From Fletcher et al. (2011, Section 7.2): The multifarious observations across the broad spectrum of phenomena each help us to characterize the equilibrium change in the corona and chromosphere that we call a flare, and it should be clear that the multi-wavelength approach is crucial in flare studies. It tells us where the flare energy starts and where it ends up, and something about the intermediate steps. It also provides some geometrical and diagnostic information about the flare magnetic environment, at different levels in the atmosphere, and how and when this changes as the flare proceeds. This big picture cannot be reached using one spectral region on its own. The multi-wavelength observations have many detailed applications as we try to understand specific mechanisms that are at work in various phases and regions of the flare development.
However, it is difficult to keep track of which flares have been observed by which instruments. While most currently operational missions have their own individual flare lists (e.g. Hinode Flare Catalog: Watanabe, Masuda, and Segawa, 2012 or Solar Dynamics Observatory (SDO)/EUV Variability Experiment (EVE): Hock, 2012), it was only recently that the first inter-instrument catalog became available, hosted by New Jersey Institute of Technology (NJIT) 1 (Sadykov et al., 2017). The Max Millennium Program for Solar Flare Research (see Bloomfield et al., 2016 for a recent review) and others have aimed to coordinate groundand space-based instrumentation to observe a flaring active region simultaneously in order to optimize the scientific return. However, this can be difficult due to factors such as coordinating across multiple time zones, planning schedules being uploaded days in advance, ground-based seeing conditions, competing scientific priorities, and so on.
Therefore when a solar flare is known to have been observed by a combination of instruments, the event can receive considerable attention as a consequence. A notable recent example of this is the 29 March 2014 X-class flare, which was observed by four space-based observatories and one ground-based telescope. 2 Consequently there have been 23 refereed publications that discuss this flare, according to a NASA ADS fulltext search on the Solar Object Locator keyword SOL2014-03-29. Similarly, the first X-class flare of Solar Cycle 24 (SOL2011-02-15) was simultaneously observed by multiple instruments at high cadence, resulting in 42 refereed publications to date. The exceptional data coverage of each of these events allowed Kleint et al. (2016) and Milligan et al. (2014), respectively, to investigate the redistribution of nonthermal electron energy. They were both able to compare radiative losses in the chromosphere across a range of wavelengths with the energy injected by nonthermal particles from hard X-ray observations. In both cases only 15 -20% of the nonthermal energy could be accounted for from longer-wavelength measurements. Understanding where this "missing energy" went to can only be answered by even better data coverage. Clearly there is great scientific merit in multi-instrument observations of the same event.
Likewise for other astronomical research areas where coordinated observations of transient objects ("Targets Of Opportunity") at different wavelengths are highly desirable. The study of supernovae, for example, is facilitated by the availability of both light-curves (to understand the evolution) and spectra (to understand the composition and dynamics). The Open Supernova Catalog (Guillochon et al., 2017) acts as a central repository providing access to data for over 42,000 known supernova events. According to the statistics page of the website 3 only 6% of these events have both photometric and spectroscopic data available (34% only have light-curves, 7% only have spectra, and 53% have neither).
This article presents an analysis of flare statistics by retrospectively cross-referencing metadata from a suite of instruments that take flare-relevant observations -the Ramaty High Energy Solar Spectroscopic Imager (RHESSI: Lin et al., 2002), the Multiple EUV Grating Spectrograph (MEGS; Crotser et al., 2004) -A and-B components of EVE (Woods et al., 2012), the EUV Imaging Spectrometer (EIS: Culhane et al., 2007), the Solar Optical Telescope (SOT: Tsuneta et al., 2008), the X-Ray Telescope (XRT: , and the Interface Region Imaging Spectrometer (IRIS: De Pontieu et al., 2014) -to search for flaring events observed simultaneously, either intentionally or serendipitously. The purpose of this article is to present an overview of how successful the solar community has been in capturing flare data through coordinated efforts. We also describe a database of these events that gives researchers access to multi-wavelength datasets with which to address a given science question. Section 2 describes how the various archives from each instrument were exploited. Section 3 presents the findings. The conclusions and a discussion are presented in Sections 4 and 5, respectively.

Data Analysis
In order to cross-reference datasets from different instruments to infer which observed a given solar flare simultaneously, it is important to define what exactly constitutes a flare. The most commonly accepted catalog is that of the Geostationary Operational Environmental Satellite (GOES) event list provided by NOAA/SWPC. This defines a solar flare as a continuous increase in the one-minute averaged X-ray flux in the long-wavelength channel (1 -8 Å) of the GOES X-ray Sensor (XRS: Hanser and Sellers, 1996) for the first four minutes of the event. The flux in the fourth minute must be at least 1.4 times the initial flux. The start time of the event is then defined as the first of these four minutes. The peak time is when the long-wavelength channel flux reaches a maximum, thus defining its class. The end of an The two vertical dotted lines denote the 6.5-year time range considered for this study. Note that SDO/EVE MEGS-A and IRIS only overlapped for ≈ 11 months. event is defined as the time when the long-channel flux reaches a level halfway between the peak and initial values. 4 However, in the vast majority of instances, the NOAA catalog does not provide information on the location of a flare on the solar disk. As this is necessary for cross-referencing with the pointing information for reduced field-of-view instruments, the location of each flare was determined from the SSW Latest Events list, which is accessible through the Heliophysics Events Knowledgebase 5 (HEK). Flare locations are determined by subtracting the SDO/Atmospheric Imaging Assembly (AIA: Lemen et al., 2012) 131 Å image closest to the GOES start time, from that image closest to the GOES peak time. The flare location is then extracted from the peak intensity of this difference image (S. Freeland, private communication, 2014). Knowing the timing and position of each event then allowed this information to be cross-referenced with the metadata from other instruments to determine whether or not they observed the same location at the same time. Note that this does not guarantee that a given instrument actually detected flaring emission, but only that the timing and pointing of a given dataset were consistent with the timing and location of the flare. B-class flares were not included in this study due to discrepancies between flare locations derived from RHESSI and SDO/AIA and were therefore deemed unreliable. The SSW Latest Events list also has several months of data missing. 6 Nevertheless, out of the 8090 flares of GOES class C1 or greater that appear in the NOAA event list, 6953 (86%) are also in the SSW Latest Events list and include location information.
For the purposes of this study, only flares greater than GOES C1 class that occurred over the 6.5 years of Solar Cycle 24 observed by SDO (Pesnell, Thompson, and Chamberlin, 2012) were considered. This defines the date range 1 May 2010 to 31 October 2016, as denoted by the vertical dotted lines in Figure 1. Also shown are the durations of the missions considered in this study. Note that EVE MEGS-A and IRIS were only operational together for around 11 months after IRIS was launched, and before MEGS-A suffered a power anomaly on 26 May 2014. 7

Figure 2
Sample event from this study that was observed by all instruments; an M1.5 flare that occurred on 4 February 2014. Upper-left panel: GOES/XRS light-curves in 1 -8 Å (solid-black curve) and 0.5 -4 Å (dotted-black curve), along with the GOES/EUVS-E (Lyα) profile in gray. Vertical dotted, solid, and dashed gray lines denote the start, peak, and end times of the GOES event, respectively. Dotted-and dashed-green ticks mark the start and end times of each Hinode/EIS raster, respectively, while red and yellow ticks mark the times of each SOT and XRT image, respectively. Horizontal-blue and -cyan lines illustrate the times at which MEGS-A and MEGS-B were exposed, respectively, while the horizontal purple line shows the time of the corresponding IRIS study. Lower-left panel: RHESSI light-curves up to the maximum energy detected, with GOES start, peak, and end times overlaid. Right panel: A PROBA2/SWAP 174 Å image taken near the peak of the flare. The white circle is 100 wide centered on the location derived from AIA 131 Å images, while the black contours mark out the 6 -25 keV emission observed by RHESSI. The fields of view of EIS, SOT, XRT, and IRIS are overplotted in green, yellow, red, and purple, respectively. Figure 2 shows a sample plot from the Solar Flare Finder widget, which was developed in tandem with this study (see Appendix A). Plots such as this have been generated for every SSW event since the launch of SDO, and they are being continuously updated. These plots allow the user to readily view the timing and pointing of each instrument during a chosen event. This particular plot shows one flare from this study that was found to have been observed by all seven instruments: an M1.5 flare that occurred on 4 February 2014.
The upper-left panel shows the GOES X-ray light-curves with the start, peak, and end times overlaid (vertical gray dotted, solid, and dashed lines, respectively). Note that for completeness, the time profiles of GOES EUVS-E (centered on the Lyman-α (Lyα) line of hydrogen at 1216 Å; Viereck et al., 2007) are also shown in gray. Milligan and Chamberlin (2016) recently showed that these data are more reliable for flare studies than the EVE MEGS-P data, given that the GOES/EUVS-E data exhibit a more impulsive profile -as one would expect for chromospheric emission -whereas current EVE MEGS-P data erroneously show a more gradually varying behavior.

The Ramaty High Energy Solar Spectroscopic Imager
RHESSI, launched on 5 February 2002, 8 observes the full disk of the Sun in X-rays and γ -rays. It orbits the Earth at an inclination angle of 38 • , at an altitude of ≈ 600 km, and as such suffers from eclipse passes and transits through the South Atlantic Anomaly. In order to determine whether or not RHESSI observed a given GOES flare event, the IDL routine hsi_whichflare.pro was run between the start and end times of each flare. This searches the RHESSI flare catalog 9 for the largest event detected in the time range of interest. If a RHESSI flare is detected, the fraction of the rise time (GOES start → GOES peak) that the RHESSI flare flag was active was also calculated. While RHESSI is a full-disk instrument, its orbit implies that it may have captured anywhere from a few seconds of a given flare up to around an hour (note that some long-duration flares are detectable over several RHESSI orbits).
From the light-curves presented in the lower-left panel of Figure 2 it can be seen that RHESSI captured the peak of the M1.5 flare up to an energy of 50 -100 keV. The contours of the RHESSI quicklook image (6 -25 keV; black contours overlaid on the EUV image) agree with the flare location computed from the AIA 131 Å data (white circle).

The EUV Variability Experiment
The SDO spacecraft is in a geosynchronous orbit allowing it to observe the full disk of the Sun continuously without interruption (except for the occasional lunar and terrestrial eclipses). For simplicity, it was assumed that both AIA and the Helioseismic and Magnetic Imager (HMI: Scherrer et al., 2012) were observing continuously throughout each event. The EVE instrument, however, is less straightforward. While MEGS-A, which provides spatially integrated Sun-as-a-star spectra over the 60 -370 Å range every ten seconds, was exposed to the Sun continuously from launch until it ceased operations on 26 May 2014, the MEGS-B (370 -1050 Å) and MEGS-P (Lyα) exposure times have been much more erratic due to unforeseen degradation soon after launch. For much of the mission MEGS-B has only been exposed for three hours per day in order to limit degradation, as well as five minutes per hour for the consistency of long-term variability studies. During periods of substantial solar activity it would observe continuously for 24 -48 hours. Recently the flight software was changed to allow MEGS-B to respond to a flare trigger based on the EVE EUV Solar Photometer (ESP) flux for events > M1. Although there is an EVE flare catalog online, 10 this includes events for which MEGS-B may have only been exposed for five minutes. Therefore for the purposes of this study, MEGS-B was considered to have observed a flare if it was exposed to the Sun continuously between the GOES start and GOES peak times as determined from the daily exposure times. 11 However, this does not necessarily mean that the flare itself will show up in the data, as EVE is often only sensitive to flares C5 level. The times at which MEGS-A and MEGS-B were exposed to the Sun around the time of a given flare are illustrated by the horizontal blue and cyan lines, respectively, as shown in the top-left panel of Figure 2.

Hinode
The Hinode spacecraft  was launched into a Sun-synchronous orbit on 22 September 2006 and comprises three instruments: EIS, SOT, and XRT. They were designed to study the interplay between the photosphere and the corona by working in unison.
However, by January 2008 Hinode had lost the use of its X-band transmitter, resulting in a dramatic reduction in the amount of data being transmitted to the ground.

The Extreme-Ultraviolet Imaging Spectrometer
EIS is a two-channel, normal-incidence EUV spectrometer. Its two channels cover the wavelength ranges 170 -210 Å and 250 -290 Å, selected to cover coronal emission lines with formation temperatures ranging from 8000 K (He II) to 16 MK (Fe XXIV). It has a mirror that is tiltable in the solar X-direction, and is used to build up rastered spectral images of portions of the Sun in up to 25 spectral ranges. Additionally, EIS has both narrow (1 and 2 wide) slits, and wider (40 and 266 wide) imaging slots, with up to 512 in the solar Y -direction.
For this study, a flare successfully observed by EIS must have had at least one raster begin, end, or straddle the GOES start and end times as determined from the eis_list_rasters.pro routine. If such a raster exists, then all rasters within −30 minutes and +60 minutes of the GOES start and end times, respectively, are returned. The flare location as projected from AIA must have also lain within the EIS field of view. This does not imply that EIS captured any flaring emission; due to the rastering nature of the instrument, the slit may not have been over the flare site at the opportune time. In the example shown in Figure 2, EIS was running a sequence of ≈ three-minute rasters (denoted by the vertical green-dotted and -dashed ticks) around the peak of the M1.5 flare. The associated regions of the Sun corresponding to each raster are also overlaid on the EUV image as green boxes.

The Solar Optical Telescope
SOT is the first large optical telescope flown in space to observe the Sun. It images sub-fulldisk portions of the Sun. Its aperture is 50 cm in diameter, the angular resolution is 0.25 (corresponding to 175 km on the Sun), and the wavelengths covered extend from 4800 to 6500 Å. SOT also includes the Focal Plane Package, which consists of a vector magnetograph and a spectrograph. The vector magnetograph provides time series of photospheric vector magnetograms, Doppler velocity, and photospheric intensity.
In order to determine whether SOT observed a given flare, the sot_cat.pro routine was run between the GOES start and end times. If the routine returned at least one image, and the flare location fell within the SOT field of view, then all corresponding images between −30 and +60 minutes of the GOES start and end times, respectively, were returned and plotted over the GOES X-ray light-curves as shown in Figure 2 (vertical yellow ticks). The associated regions of the Sun corresponding to each SOT image are also overlaid on the EUV image as yellow boxes.

The X-Ray Telescope
XRT is a high-resolution (1 ) grazing-incidence Wolter telescope that obtains highresolution soft X-ray images covering the energy range 0.2 to 2 keV. This reveals magneticfield configurations and their evolution, allowing the observation of energy buildup, storage, and release process in the corona for any transient event. XRT covers a wide temperature range from 0.5 to 10 million Kelvin allowing it to see coronal features that are not visible with a normal-incidence telescope. XRT can observe the full disk of the Sun, but can also return sub-full-disk images, depending on the science goal of the observation.
In order to determine whether XRT observed a given flare, the xrt_cat.pro routine was run between the GOES start and end times. If the routine returned at least one image, and the flare location fell within the XRT field of view, then all corresponding images between −30 and +60 minutes of the GOES start and end times, respectively, were returned and plotted over the GOES X-ray light-curves as shown in Figure 2 (vertical red ticks). The associated regions of the Sun corresponding to each XRT image are also overlaid on the EUV image as red boxes.

The Interface Region Imaging Spectrometer
Launched on 27 June 2013 into a Sun-synchronous polar orbit, IRIS obtains UV spectra and images with high spatial (1/3 ) and temporal resolution (one second) focused on the solar chromosphere and transition region. The instrument comprises an ultraviolet telescope combined with an imaging spectrograph. IRIS records observations of material at specific temperatures, ranging from 5000 K and 65,000 K, and up to 10 MK during solar flares. IRIS is a sub-full-disk instrument, imaging portions of the solar disk and limb.
The timing and pointing of IRIS observation studies that were run during the start and end times of a given GOES event were obtained using the iris_obs2hcr.pro routine. This searches the Heliophysics Coverage Registry for the OBSID 12 corresponding to the time of the flare, as shown by the horizontal purple line in the upper-left panel for Figure 2. Similar to the previously mentioned instruments with limited fields of view, the pointing information obtained from the OBSID was cross-referenced with the flare location to determine if IRIS was pointed at the required location (purple box overlaid on the EUV image in Figure 2).

Results
Based on the search criteria defined in Section 2, the number of flares, and their percentages of the total number of SSW Latest Events (which itself is a subset -86% -of the available NOAA/GOES events) that were considered to have been observed by each of the instruments are listed in Table 1. The instruments with full-disk capability and high duty cycles (RHESSI, MEGS-A, and Hinode/XRT) unsurprisingly were able to capture more than half of the total flares considered. The remaining instruments -which have either limited duty cycles and/or limited fields of view -were only able to capture around 20% or less of all flares during Solar Cycle 24. Similarly, the number of flares and their percentages that were observed by different combinations of instruments are listed in Table 2. Around 84% of all flares were observed by between one and three instruments. Most of the remaining 16% were observed by either four or five instruments, while a total of 37 flares were observed by different combinations of six instruments and only 3 out of 934 were observed by all seven instruments during the 11 months that they were simultaneously operating. Interestingly, 127 flares (1.8%) were not observed at all by any of the seven instruments considered.
The findings of how many solar flares were observed by different combinations of instruments are displayed in Figures 3 as UpSet R 13 plots (Lex et al., 2014). This type of plot enables the efficient visualization of common elements of a large number of sets (the more common and familiar Venn diagram approach produces ineffective visualizations for more  than ≈ five sets). The top panel of Figure 3 shows the intersections of the various combinations of datasets ordered by decreasing frequency (i.e. the most common combinations are on the left and decrease towards the right), while the bottom panel shows the same information only now ordered by increasing number of instruments (i.e. flares observed by individual instruments alone come first, with flares observed by all seven on the far right).
In each plot, the total number of flares observed by each instrument are given by the horizontal black bars in the bottom-left corner. The dots connected by lines at the bottom of each figure denote the combinations of instruments considered, while the histograms above give the number of events corresponding to a given combination. The most common combination of flare datasets was RHESSI+MEGS-A+Hinode/XRT (930 flares), due to their large fields of view and high duty cycles as mentioned above.

Evaluation of Measured Versus Expected Success Rates
It is difficult to give a good estimate of how many flares one would expect to see with each instrument, given their different science goals and operational constraints. Table 3 summarizes an attempt to estimate this expectation value [e] for each instrument considered in this article. The estimates are based on the average field-of-views times the duty cycles of each instrument. The area of consideration is estimated in two ways. The first estimate is simply the area of the full disk of the Sun. The second estimate assumes that there are four active regions on the Sun each with an area of 240 × 240 , and that the majority of the duty cycle is spent examining the active-region areas. These two estimates give an upper and lower range to the percentage field of view. The percentage field of view is calculated as the percentage of the area of consideration covered by the average field-of-view of the instrument disk. The duty cycle is estimated as the percentage of the time that the instrument could have observed a flare. Crucially, the estimates assume that a random location within the area of consideration (either the full disk of the Sun, or an estimated average area of active regions that the instrument could point to, assuming that active regions form the majority of target areas during the duty cycle). A very crude estimate of the "expected" success rate [e] is therefore the product of the duty cycle and the FOV. This can be readily compared to the measured success rate [m] for each instrument individually from the 11-month period during which all seven instruments were operational together. This time period also happened to coincide with the peak of the solar cycle as illustrated in Figure 1. These expected and measured values are presented in the last two columns of Table 3. The success rates over this 11-month period bear a reasonable agreement with the values measured over the entire 6.5 years under study that are presented in the final column of Table 1, and they can therefore be considered as characteristic of each instrument. They are also consistent with or better than the individual expected value implying that each pointing instrument is performing well. This reflects the fact that solar flares are a high-priority science goal for these instruments, and that operators of course do not point their instruments randomly.
The measured success rates of each individual instrument in Table 3 can be used to predict the number of flares expected to be seen by different combinations of instruments where k is the number of successful outcomes, N is the number of trials and is the binomial coefficient. Consider the case of two instruments observing the same flare. If the flare is observed by the first instrument with a probability m 1 , and by the second instrument with a probability m 2 , conditional on the first instrument having observed the flare, then the resulting probability of observing k flares from a possible N is This can be used to calculate n expected , the expected numbers of flares observed by arbitrary combinations of instruments. We define n expected to be the mean value of the probability mass functions (PMF) defined by Equation 3. This value can be compared to the actual number of flares observed [n measured ]. If the actual number of flares observed [n measured ] is much larger than the expected number due to chance [n expected ] then this can be taken as evidence that instruments were acting in cooperation, or at least had aligned goals. The number of distinct subsets of combinations of r instruments from the seven instruments that we are considering is 7 r (Equation 2). For example, there are 21 possible combinations of two out of seven instruments, 35 combinations of three, and so on. Figure 4 shows example PMFs for three combinations of instruments using Equation 3: RHESSI+XRT, EIS+SOT, and IRIS+EIS+SOT. The first two panels show that their respective probabilities display a distribution peaked on the most probable number of flares ob- Figure 5 The expected mean number of flares observed [n expected ] by various combinations of instruments versus the number actually observed [n measured ]. The diagonal dotted line marks the 1:1 ratio, while the diagonal dashed line denotes the 10:1 ratio. Some of the data points overlap since some combinations of instruments are subsets of combinations of more instruments. In the case when the mean number minus the standard deviation is less than zero, the error bar is extended to the lower value of the plot range. served (309 and 7, respectively, out of 934), while the right-hand panel shows that the most probable number of flares observed simultaneously by IRIS+EIS+SOT is zero. Defining n expected to be the mean of the PMF ensures that n expected > 0. The uncertainty on n expected is estimated by calculating the standard deviation of the PMF.
A scatter plot showing the expected mean number of flares out of a possible 934 that were observed [n expected ] by two -seven instruments, against the number actually observed [n measured ] is shown in Figure 5. Points close to the 1:1 (dotted) line indicate that those combinations of instruments are co-observing flares at a rate consistent with Equation 3, i.e. the measured co-observation rate is close to that expected by chance.
For combinations of four or more instruments, the number of flares actually observed is far larger than that expected randomly (Equation 3). While the expected mean number of flares observed is small (and sometimes less than unity) for increasing numbers of coordinating instruments the number of flares actually observed is often up to ten times greater than expected if the instruments operated without coordination. This shows that when a flare-productive active region is present on the Sun, many instrument planners will choose to track the region -within their operational constraints -thereby greatly increasing the likelihood of jointly observing a given flare in conjunction with other missions. The statistics for the expected and measured number of flares observed by each possible combination of two -six instruments is given in Appendix B.

Conclusions
A statistical analysis of how many solar flares (≥C1) were observed by various combinations of instruments during the 6.5 years after the launch of SDO in Solar Cycle 24 is presented. On average, over the entire 6.5 years, each flare was observed by 2.4 instruments. Out of the 6953 flares considered, only three were observed simultaneously by RHESSI, MEGS-A+B, Hinode/EIS+SOT+XRT and IRIS: a C2.3 flare on 1 February 2014, a C4.6 flare on 3 February 2014, and an M1.5 flare on 4 February 2014. The occurrence of these three events coincided with a Max Millennium Major Flare Watch campaign that ran from 30 January 2014 -8 February 2014 on NOAA active region 11967. 14 This illustrates the value of tracking the target region as advised by the Max Millennium Chief Observers when trying to optimize the scientific return on solar flare datasets. Note that all seven instruments were observing contemporaneously for only 11 months, and in this time 934 events are currently listed as SSW Latest Events; therefore 0.3% of all possible GOES flares were observed with all seven instruments. While this may not seem impressive, the probability of all seven instruments observing a single flare simultaneously by chance is 0.003%. Similarly, for combinations of four, five, or six instruments the number of flares captured is often a factor of ten or more greater than random. This shows that instrument planners are intentionally co-observing the same flare-productive active regions.
The analysis in Section 3 suggests that multi-instrument observations are occurring much more frequently than expected by chance. It should be noted that this conclusion is reached by assuming that each instrument is acting independently of all the others. This is a dubious assumption, as the community is aware of the scientific value of multi-instrument observations of solar flares, and many of the people who operate flare-observing instruments have a professional interest in studying flares. It does not take account of known existing community efforts that are designed to promote flare co-observation such as the Max Millennium Program, or joint observing programs such as the Hinode Operations Program 15 that often specifically request that multiple instruments point to the same target. As the number of instruments goes up, the deviation towards increased co-observation increases suggesting that the co-observation rate depends not only on which instruments are observing (the m i s in Equation 3) but also on the number of instruments. This suggests that instrument operators are more likely to co-observe if a number of other instruments are already co-observing a target.
Unsurprisingly the instruments with the longest duty cycles and largest fields of view (RHESSI, MEGS-A, XRT) performed the best individually. Reduced field-of-view instruments that require operations planning, while performing within their expected success rates, still only captured on the order of 20% or less of all flares. The possible reasons for this have already been touched upon, but may also be due to other specific factors. For example, until recently, EIS (which observed 6 -8% of flares) only received 15% of Hinode's total telemetry since January 2008, thereby limiting its daily duty cycle. This has since been revised up to 23 -43% 16 which should improve its statistics. Similarly, MEGS-B was often only exposed to the Sun for three hours per day to minimize detector degradation, but now responds to a flare trigger when the flux level at 1 -7 Å as measured by the ESP component of EVE exceeds the GOES M1 level (Milligan and Chamberlin, 2016). This effectively makes MEGS-B a dedicated flare instrument and it is likely to observe a higher fraction of flares in the future.

Discussion
This study raises a significant question for the solar-physics community: even though we seem to be co-observing flares at rates larger than those expected by chance, is the number of co-observed flares acceptable or not? This is not an easy question to answer. This study presents some analysis regarding the retrospective behavior of the community regarding co-observation of solar flares, but does not comment on what the solar-physics community wants to do, or should do. It seems obvious that increasing the number of co-observed flares is desirable, but there are three factors for the community to consider in relation to this question.
The first factor is the desire of the community to use limited instrumental resources to study flares compared to other solar features and phenomena. If the community decides that the study of solar flares is relatively more important than the study of other features and phenomena, then their relatively unpredictable occurrence means that a greater fraction of each instrument's observational resources should be devoted to capturing as much data as possible when a flare-productive region appears (e.g. in response to a Max Millennium Major Flare Watch). Other more "quiescent" targets (e.g. coronal holes, filaments, plage regions, etc.) are much more commonplace and can be observed at almost any time.
Having decided that flare research is important, the next factor to consider is our ability to predict when and where a flare will occur. Without a reliable method of predicting when and where a solar flare will occur, we are left with trying to optimize instrumental resources in the face of incomplete information as well as each instruments' operational constraints and competing scientific priorities. The Max Millennium Program aims to provide an assessment of the likelihood of a flare in a given region over the following 24 hours. As well as a human assessment of flare likelihood, we suggest that machine-learning techniques be employed as another tool to aid the human flare forecaster. For example, Bobra and Couvidat (2015) use support-vector machine-methods to determine flare probabilities. Another possible approach is to aggregate results from all existing flare-prediction tools to provide a single, combined measure assessing flare likelihood. It is also fundamentally important that support for the basic science of understanding how and why a solar flare is (or is not) triggered continues.
With a target selected, the final factor to consider is the number of co-observing instruments required to answer the particular science question. The utility of a set of multiinstrument flare observations depends on the science question being asked. All flares do not have to be observed by all instruments all of the time. For example, to understand the dynamic response of the chromosphere to energy deposited by nonthermal electrons, perhaps only RHESSI, EIS, and IRIS data are necessary (Brosius, Daw, and Inglis, 2016). For flare differential emission measure studies, maybe having simultaneous RHESSI and EVE (Caspi, McTiernan, andWarren, 2014) or EIS andXRT observations (O'Dwyer, Del Zanna, andMason, 2014) are desirable. This is the primary function of the IDL widget described in Appendix A: to allow users to quickly and easily search for joint datasets of solar-flare observations in order to answer a specific science question. Assessing the scientific impact of flare co-observations is difficult. It may be possible to measure the scientific impact of flare co-observation through citation analysis (for example, de Solla Price, 1965; Giles, Bollacker, and Lawrence, 1998;Kaur et al., 2012) of flare articles as a function of the number of instruments. This type of study is beyond the scope of this article, but it would provide more information to the community in understanding the scientific impact of flare co-observations.
Understanding how a solar flare operates is a fundamental challenge to our understanding of the Sun and the conditions of the heliosphere. In the upcoming Solar Cycle 25, the Daniel K. Inouye Solar Telescope, Solar Orbiter, and Parker Solar Probe will all be operational. These facilities all have limited duty cycles, and different operational constraints. Optimizing the solar-flare science return from these and other instruments relies on continued inter-instrument coordination where possible. We suggest that each instrument's observational plans be made available online, ideally in a commonly agreed format. Tools should be developed to read and visualize those plans (the Helioviewer Project clients helioviewer.org and JHelioviewer could be extended to present observation plans) that could take into account solar differential rotation, overplotting it on images from many different instruments. This will enable instrument operators, scientists, and other users to understand how and why particular observations are being planned. We suggest that increased planning transparency will inevitably lead to an increased understanding of how an instrument's operations create the revealed science priorities of an instrument, as opposed to its stated priorities. From this basis a better understanding of how to coordinate co-observations between instruments can be generated. Finally, it should be noted that co-observation of non-flaring regions is also of considerable scientific value. Co-observations that do not catch a flare are not without merit; much can be learned about the physics of active regions, the chromosphere-corona connection, polarity inversion lines, sunspots, etc., using observations from multiple instruments.  The measured (red diamond) and expected (blue triangle) probabilities of any given combination of (2, 3, 4, 5, or 6 out of 7) instruments successfully observing a solar flare. The solid-black circles denote the ratio of measured to expected rates.