Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Quantitative UV-C dose validation with photochromic indicators for informed N95 emergency decontamination

  • Alison Su ,

    Contributed equally to this work with: Alison Su, Samantha M. Grist

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Bioengineering, University of California, Berkeley, Berkeley, California, United States of America, University of California, Berkeley–University of California, San Francisco Graduate Program in Bioengineering, Berkeley, California, United States of America, N95DECON.org

  • Samantha M. Grist ,

    Contributed equally to this work with: Alison Su, Samantha M. Grist

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Resources, Software, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Bioengineering, University of California, Berkeley, Berkeley, California, United States of America, N95DECON.org

  • Alisha Geldert,

    Roles Investigation, Writing – review & editing

    Affiliations Department of Bioengineering, University of California, Berkeley, Berkeley, California, United States of America, University of California, Berkeley–University of California, San Francisco Graduate Program in Bioengineering, Berkeley, California, United States of America, N95DECON.org

  • Anjali Gopal,

    Roles Data curation, Methodology, Software, Writing – review & editing

    Affiliations Department of Bioengineering, University of California, Berkeley, Berkeley, California, United States of America, University of California, Berkeley–University of California, San Francisco Graduate Program in Bioengineering, Berkeley, California, United States of America, N95DECON.org

  • Amy E. Herr

    Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

    aeh@berkeley.edu

    Affiliations Department of Bioengineering, University of California, Berkeley, Berkeley, California, United States of America, University of California, Berkeley–University of California, San Francisco Graduate Program in Bioengineering, Berkeley, California, United States of America, N95DECON.org, Chan Zuckerberg Biohub, San Francisco, California, United States of America

Abstract

With COVID-19 N95 shortages, frontline medical personnel are forced to reuse this disposable–but sophisticated–multilayer respirator. Widely used to decontaminate nonporous surfaces, UV-C light has demonstrated germicidal efficacy on porous, non-planar N95 respirators when all surfaces receive ≥1.0 J/cm2 dose. Of utmost importance across disciplines, translation of empirical evidence to implementation relies upon UV-C measurements frequently confounded by radiometer complexities. To enable rigorous on-respirator measurements, we introduce a photochromic indicator dose quantification technique for: (1) UV-C treatment design and (2) in-process UV-C dose validation. While addressing outstanding indicator limitations of qualitative readout and insufficient dynamic range, our methodology establishes that color-changing dosimetry can achieve the necessary accuracy (>90%), uncertainty (<10%), and UV-C specificity (>95%) required for UV-C dose measurements. In a measurement infeasible with radiometers, we observe a striking ~20× dose variation over N95s within one decontamination system. Furthermore, we adapt consumer electronics for accessible quantitative readout and use optical attenuators to extend indicator dynamic range >10× to quantify doses relevant for N95 decontamination. By transforming photochromic indicators into quantitative dosimeters, we illuminate critical considerations for both photochromic indicators themselves and UV-C decontamination processes.

Introduction

Ultraviolet (UV) light in the UV-C wavelength range is one of three promising methods identified by the United States Centers for Disease Control and Prevention (CDC) for N95 respirator (N95) decontamination as a shortage mitigation strategy during the COVID-19 pandemic [1]. Building upon years of literature evidence demonstrating that specific UV-C doses inactivate viruses while preserving respirator fit and filtration [25], UV-C decontamination of N95 respirators has become a rapidly expanding area of interest for both research and implementation [6]. However, effective UV-C bioburden reduction (while appearing straightforward) requires exquisite attention to detail in both treatment design and validation of treatment parameters. Challenges and intricacies of UV-C measurements can stymie study translation when UV-C dose measurements reporting viral inactivation are not robustly characterized. Innovation is urgently needed to introduce new measurement workflows that are both quantitatively robust and translatable across UV-C systems and facilities.

UV-C pathogen inactivation critically depends on two physical properties: wavelength and dose (or fluence), where dose is defined as integrated irradiance over the exposure time. Longer UV-C wavelengths (240–280 nm) inactivate pathogens like SARS-CoV-2 by damaging their genetic material (absorption peak near 260 nm) [7] (Fig 1A); far (short-wavelength) UV-C also damages proteins [8]. Because UV-C decontamination relies upon pathogen interaction with electromagnetic radiation, efficacy depends on direct line-of-sight between the UV-C source and target surface. As is well established in the literature, UV-C irradiance, and therefore integrated dose, is attenuated throughout the thickness of an N95 respirator due to reflection, absorption, and scattering of UV-C photons as light passes through each porous N95 material layer (Fig 1B) [9]. Thus, in contrast to nonporous surfaces, effective decontamination of N95 respirators requires that the minimally acceptable UV-C dose is delivered not just to viral particles on the exterior surface, but also to those that may be embedded in interior N95 layers. Because integrating dosimeters into intact respirators is infeasible, decontamination efficacy throughout the N95 layers is typically measured in the peer-reviewed literature as a function of UV-C dose applied to the N95 surface. The established approach to quantify the minimum surface UV-C dose for N95 decontamination is to directly assess active virus recovered from throughout the N95 layers (e.g., using the TCID50 assay) vs. surface dose [3, 10, 11]. On the majority of N95 models, studies (almost all of which used 254 nm low-pressure mercury light) support ≥1.0 J/cm2 UV-C dose across the entire N95 surface for ≥3-log reduction of SARS-CoV-2 analogues [2, 4, 12]: a 100–1000× higher dose than that required for non-porous surface decontamination [13].

thumbnail
Fig 1. Mechanism and challenges of UV-C for N95 decontamination.

(a) UV-C at 254 nm primarily inactivates pathogens by damaging genomic material (absorption peak near 260 nm). (b) The multilayer porous N95 materials and 3D morphology reduce the irradiance (and thus dose) available for pathogen inactivation compared to the irradiance that reaches nonporous surfaces (IS), like the metal nosepiece (αlayer represents the layer-dependent attenuation factor). (c) UV-C detectors often have angle-dependent responses that differ from the ideal cosine response expected from a surface such as flat photochromic indicators. (d) The introduced workflow allows end users to both design and validate their UV-C systems, reducing source- and sensor-specific inaccuracies. Critically, assessment of treatment area dose nonuniformity informs N95 placement during on-N95 measurements; on-N95 measurements in turn determine minimum reference PCI doses that yield ≥1.0 J/cm2 to all N95 surfaces. On-N95 measurements are designed to specifically measure steep-angled or potentially shadowed N95 regions (S1 File). (e) Robust UV-C measurements must meet key specifications, including dynamic range of quantification (before the indicator saturates), relative measurement uncertainty (determined from error propagation from the confidence intervals on the calibration curve fit), accuracy of the measurement compared to a calibrated standard sensor, and specificity of the PCI response to the germicidal wavelength range (in order to accurately report germicidal activity). Nucleic acid absorbance spectrum modified from Voet et al. [14]. SARS-CoV-2 diagrams adapted from an image by Maya Peters Kostman for the Innovative Genomics Institute.

https://doi.org/10.1371/journal.pone.0243554.g001

Researchers have also used an augmented approach to measure UV-C attenuation through the N95 layers, then used this attenuation to scale the surface dose and quantify the inner-layer UV-C dose delivered to embedded viral particles [9]. Critically, measured attenuation varied by a factor of >100 between N95 models [9]; furthermore, the wide variation in N95 morphology enhances inter-model differences in applied UV-C dose because irradiance depends on the incident angle following Lambert’s cosine law (Fig 1B) [15]. Likely because of the impact of both model-dependent attenuation and morphology on UV-C dose reaching the N95’s inner layers, UV-C viral inactivation efficacy on N95s varies between models [3, 4, 9].

UV-C measurement challenges are further exacerbated by radiometer complexities [16]. The accuracy and relative uncertainty of digital UV-C radiometers are established through calibration to a known standard (e.g., from the National Institute of Standards and Technology) [17]; however, accuracy is dependent on sensor linearity, spectral sensitivity, and angular response [16, 18] (Fig 1C). Though some countries have adopted standards for comparison between sensors [19], no universal standards exist [20]. Consequently, there is large variability between sensors in environments differing from the calibration setup, compromising replicability when detailed reporting is omitted. Furthermore, radiometers are costly, limited, low-throughput, and bulky, precluding measurements on complex 3D surfaces (which require fine spatial resolution and ideal angular response). As a result, UV-C dose is often not robustly characterized, and relative doses over a 3D N95 surface have not yet been empirically quantified using sensors rigorously validated for this application.

Photochromic, color-changing UV-C indicators (PCIs) for evaluating surface decontamination are commercially available and address challenges presented by digital sensors. Due to their low cost and small, flexible form factor, PCIs are ideal for characterizing UV-C uniformity and have been applied for this characterization in hospital rooms [21]. PCIs are intended for qualitative validation; however, there has been effort to quantify color change (a topic of broader interest [2227]) to characterize water sterilization reactors [28].

In this work, we introduce a novel PCI-based dose quantification workflow (Fig 1D; details in S1 File) for informed design and validation of UV-C N95 decontamination systems. We first demonstrate that PCI color quantification can yield UV-C-specific quantitative dose measurements with high accuracy (Fig 1D(i)). We then use this relationship between color change and UV-C dose to show how PCIs can be implemented by end users: high throughput dose mapping within the treatment plane (Fig 1D(ii)), combined with assessment of dose distribution across the N95 surface (Fig 1D(iii)) allow PCIs to highlight critical locations to monitor (both on-respirator and on the treatment plane) for informed design. Relative dose measurements using PCIs can then be made on N95s positioned in the identified treatment locations (Fig 1D(iii)) in order to establish the minimum color change that reference PCIs on the treatment plane must undergo for all N95 surfaces to receive ≥1.0 J/cm2. Finally, we study how the addition of optical attenuator materials in front of the PCIs can extend the quantifiable UV-C dose range to ≥1.0 J/cm2 (Fig 1D(iv)), enabling the final critical step of the workflow: in-process dose validation at a characterized reference location during every decontamination cycle.

Results and discussion

UV-C dose measurements are frequently the only link between viral inactivation studies and implementation of each decontamination cycle. Decontamination efficacy and safety consequently depend on robust UV-C measurements, defined by several critical metrics (Fig 1E) for which we have defined marginal and ideal values (S1 Table). Here, we introduce a new technique using PCIs to address three critical challenges hindering UV-C decontamination processes: (1) accurate and high-throughput characterization of the UV-C treatment plane (Fig 1D(ii)), (2) spatially resolved dose quantification across complex 3D structures placed within the treatment plane (Fig 1D(iii)), and (3) translatable and reproducible in-process measurements to validate the dose of ≥1.0 J/cm2 delivered to all N95 surfaces during every UV-C treatment cycle (Fig 1D(iv)).

Novel PCI quantification accurately assesses spatial nonuniformities in UV-C treatment systems

PCIs have the potential to fill three urgent gaps in UV-C dose validation; however, a quantitative rather than qualitative readout strategy is required. To assess the indicators’ suitability for contributing to informed design of UV-C treatment processes, we introduce a novel quantification workflow and demonstrate the capability to measure spatial heterogeneity within a UV-C treatment system from a single exposure. We first assessed whether UV-C dose could be quantified from the color change of commercially available PCIs; quantification relies upon distinct, reproducible color change that follows a known, predictable relationship. Measurement of color differences between the sample and a reference (rather than absolute colors) improves quantification robustness as the difference between two colors measured under the same conditions is less sensitive to many confounding effects [22, 23]. To test whether two models of commercial PCIs (Intellego UVC 100 Dosimeter Dots: ‘PCI1’, and UV Process Supply UV-C Intensity Labels: ‘PCI2’) could meet the specifications of S1 Table, we exposed them to UV-C doses measured with a calibrated radiometer, quantified their endpoint color using an RM200QC spectrocolorimeter (outputting a single L*a*b* color per PCI), and computed the CIEDE2000 [29] industry-standard color difference (ΔE) from an unexposed indicator as a function of UV-C dose (Fig 2A). We see comparable dose-response data for other metrics of color difference (S2 File and S1 Fig) as well as good reproducibility between batches of PCI1 (S2 Fig). Both PCI models showed visually discernable color change up to ~0.15 J/cm2. PCI1 has a higher maximum ΔE of ~45 compared to ~25 for PCI2 (Fig 2A). Higher maximum ΔE will lead to lower relative uncertainty for a constant color difference measurement uncertainty.

thumbnail
Fig 2. Robust color measurement facilitates UV-C dose quantification from two models of PCIs.

(a) CIEDE2000 color difference between exposed and unexposed Intellego UVC Dosimeter Dot (PCI1, pink) and UV Process Supply UVC Intensity Label (PCI2, green) as a function of UV-C dose. Dose-responses for PCI1 were fit with a calibration function corresponding to first-order reaction kinetics (Eq 1: R2 = 0.998; a = 47.1 (46.1, 48.1); b = 80.4 (74.6, 86.3); 95% confidence interval on fit parameters reported in parentheses). Dose responses for PCI2 were fit with a calibration curve corresponding to second-order reaction kinetics (Eq 2: R2 = 0.992; a = 47.7 (45.9, 49.5); b = 0.00060 (0.00049, 0.00072)). PCI color is depicted by the RM200QC-measured color values (circles) and digital SLR camera (DSLR) image swatches in the comparison wheels. For each PCI type, the datapoints within the shaded region denote individual PCI measurements, line denotes best fit, and shaded region denotes 95% prediction interval on prediction of color change from observation of UV-C dose. (b) Relative quantification uncertainties using the PCI calibration workflow. Plots depict quantified 95% confidence intervals on measurements of UV-C dose from CIEDE2000 color difference between exposed and unexposed PCIs, normalized to and as a function of UV-C dose. (c-f) heatmaps and histograms of delivered UV-C dose to locations across the treatment plane, quantified with (c) Zemax OpticStudio simulations (plot depicts relative dose), (d) digital radiometer (with correction factor, mean of N = 3 measurements at each location), (e) PCI1 (mean of N = 2 measurements at each location), and (f) PCI2 (mean of N = 2 measurements at each location). The PCI2 model appears to underestimate both dose and nonuniformity. Heatmaps in (d-f) are plotted on the same color scale (up to the radiometer maximum measured dose), while heatmap in (c) depicts dose normalized to the highest value observed. White regions with ‘×’s in (d-f) were not measured.

https://doi.org/10.1371/journal.pone.0243554.g002

We next scrutinized whether fitting the ΔE vs. dose data to a calibration function could predict UV-C dose from ΔE with relative dose measurement uncertainty below the 10–20% thresholds of S1 Table. We fit the data to calibration functions based upon first- and second-order reaction kinetics as described in S3 File. For PCI1, we used a fit function corresponding to first-order reaction kinetics (a, b are fit parameters): (1) while for PCI2 we observed better goodness-of-fit with a fit function corresponding to second-order reaction kinetics (S3 Fig): (2) We note that although these fit functions serve as effective calibration functions with high goodness-of-fit, the current implementation does not facilitate extraction of reaction parameters (e.g., reaction order, reaction rate) from the curve fit because the relationship between CIEDE2000 and colored reaction product concentration is not known. While colorimetric absorbance data from commercial PCIs also show a UV-C dose response (S4 Fig), the unknown chemical composition of the commercial PCIs confounds determination of reaction parameters. Colorimetric absorbance of dye on paper has been found to deviate from Beer’s Law [25], so careful calibration of colorimetric absorbance over a range of known dye concentrations is required to quantify concentrations or reaction kinetics from colorimetric absorbance on paper [30]. Nevertheless, adoption of colorimetric absorbance approaches will be useful to inform design of new optimized chemistries for PCI materials.

We assessed the precision of the measurement by comparing the width of the dose measurement confidence intervals (CIs) to the respective dose values (Fig 2B). The relative 95% CIs on UV-C doses measured with the calibration function from known CIEDE2000 color differences were considerably larger for PCI2 than for PCI1, suggesting that PCI1 is better-suited to robust UV-C quantification using CIEDE2000. Dose quantification uncertainties are dependent on the ΔE uncertainty, encompassing both the uncertainty of the measurement tool and the variability in PCI coating color. Using an experimentally determined ΔE uncertainty of 0.273 for PCI1 and 0.083 for PCI2 (see Methods), we find that the two PCI models yield disparate relative uncertainties on the dose measurements. At a dose of ~0.1 J/cm2, the relative CI width (width of the CI divided by the measured dose) of PCI1 is 12.1%, equivalent to 6.05% relative uncertainty and meeting the <10% ideal relative uncertainty target. At the same dose, the relative CI width of PCI2 is 21.2%, equivalent to 10.6% relative uncertainty. PCI2 thus does not meet the ideal relative uncertainty target but does meet the marginally acceptable 20% relative uncertainty target. PCI1 relative uncertainty remains <10% up to ~0.20 J/cm2. We also quantify how the relative CI width on the PCI dose measurement varies with both measured dose and uncertainty on ΔE (S5 Fig). These results highlight the importance of quantifying the ΔE measurement uncertainty in order to accurately predict PCI dose quantification uncertainty. The relative quantification uncertainty of PCI1, while higher than that established for calibration of UV-C radiometers under ideal conditions [31], should still facilitate dose quantification as long as appropriate safety factors on applied dose (i.e., a multiplier >1) are included in the N95 treatment protocol to account for the propagated relative uncertainty in the dose measurement and ensure minimum doses are met.

Robust color quantification metrics that are well-suited to calibration should vary with applied UV-C dose in a reproducible and quantifiable manner with low relative quantification uncertainty. To better understand the calibration capacity of other standard metrics of color quantification, we scrutinized the relative quantification uncertainty on alternate color difference/color distance formulae: CIELAB 1976 (Euclidean ΔC) and Euclidean RGB ΔC (S6 Fig). To isolate specific color components well-suited to calibration, we also compared absolute differences in the red, green, and blue (ΔR, ΔG, ΔB) components and lightness, chroma, and hue (ΔL, ΔC, ΔH) components between exposed and unexposed PCIs (S6 Fig). We fit each metric to the same calibration functions defined in the Methods (Eq 1 for PCI1; Eq 2 for PCI2). Relative CI widths for each of these 9 color metrics were computed by comparing the PCI dose measurement CI widths to the respective dose values. Not surprisingly, the most favorable color difference metrics were dependent on PCI type. Given the benefits of CIEDE2000 for robust color difference determination across the full color space of different potential PCI colors [29], we chose to use CIEDE2000 for all subsequent quantification of both PCI models used in this study. We acknowledge, however, that different color metrics may be optimal for characterizing a single specific PCI model. For PCI1, the difference in hue angle (ΔH) yielded low quantification uncertainty (<10% up to the highest tested dose of 0.25 J/cm2) and may be an avenue for future research to improve quantification robustness compared to CIEDE2000 for certain PCI models. Additionally, measurements of the PCI material optical spectra as a function of exposure dose may help developers of new PCI chemistries identify the most promising color metrics for dose quantification.

We note that the PCI color changes are governed by reaction kinetics; thus, environmental factors (e.g., temperature and humidity) are expected to affect the rate of color change with dose [32, 33]. Additionally, we have observed PCI color instability after exposure; thus, PCIs should be quantified immediately (within 10–20 minutes of exposure for these models). Although the PCI1 quantifiable dynamic range of <0.2 J/cm2 is not sufficient for in-process validation (≥1.0 J/cm2 to all N95 surfaces [24]), it meets the ≥0.1 J/cm2 marginal threshold to assess relative doses for informed design of UV-C treatment systems.

We also used the quantification workflow to start to investigate PCI specificity to UV-C wavelengths (S4 File and S7 Fig). Specificity of the measurement tool to UV-C light is important because many UV-C sources (e.g., medium-pressure mercury or xenon arc lamps) emit wavelengths outside of the germicidal UV-C range [7]. Even near-monochromatic UV-C sources such as low-pressure mercury and amalgam lamps emit wavelengths >300 nm (Fig 1E) [34]. We asked two questions: (1) how much of the PCI color change from low-pressure amalgam bulbs is due to non-germicidal wavelengths, and (2) how susceptible are PCIs to perturbation by spurious solar exposure during transport or storage. When exposed to filtered (>300 nm) low-pressure amalgam illumination, one PCI (PCI1) showed negligible color change, thus meeting the <5% specification. In another PCI model (PCI2), the same longer-wavelength, non-germicidal components of the emission generated ~19% of the total color change resulting from 280 mJ/cm2 measured from the unfiltered source, highlighting how specificity to the germicidal range is PCI model-dependent. Similar results were observed when the two PCI models were exposed to natural sunlight (S4 File and S7 Fig). These results demonstrate the importance of UV-C specificity characterization when assessing PCIs. We see quantitative assessment and reporting of PCI color change in response to well-controlled, known non-germicidal wavelengths as beneficial to PCI development. Specifically, PCI color change arising from exposure to common UV sources including low, medium, and high-pressure mercury lamps, xenon arc lamps, and solar simulators would inform both end users and future PCI design iterations.

Having established a novel PCI quantification workflow, we next asked whether PCI measurements could scrutinize spatial dose uniformity within a UV-C treatment system as the first step towards informed design of N95 decontamination (Fig 1D(ii)). Guiding principles of optics dictate that irradiance nonuniformities will be present in nearly any UV-C treatment system; however, the accuracy and reproducibility of UV-C measurements is hindered by a lack of standardization of critical sensor properties such as angular response, which can drastically impact readings [18, 35] (with system-dependent impact). In the absence of a calibration reference, the sensor angular response can be obtained (either through measurement [18] or through the manufacturer) and used with optical modeling to estimate spatially dependent system- and sensor-specific correction factors (as described in S5 and S6 Files and S8S10 Figs). We first mapped UV-C dose within a Spectroline HCL-1500 UV-C source using simulation (Fig 2C) and 23 individual OAI 308 radiometer measurements (Fig 2D). We observed that the radiometer under-reports irradiance and dose due to its nonideal angular response (S11 Fig); the reported readings (Fig 2D) are post-correction. After correction, the irradiance measured near the corners of the treatment plane is ~40% of that measured at the center. The simulation underestimates this nonuniformity, as validated using another radiometer with near-ideal angular response (S11 Fig).

We leveraged the nonuniform treatment plane irradiance to validate our quantification workflow by comparing PCI-measured doses (Fig 2E–2F, quantified using the appropriate calibration curve depicted in Fig 2A) to corrected radiometer measurements (Fig 2D). The relative quantification error () for PCI1 is 7% ± 7% (mean ± standard deviation of N = 23 spatial measurements averaged across N = 2 replicates), meeting the >90% accuracy target. In contrast, the relative quantification error for PCI2 is 28% ± 10%, failing to meet the marginal >80% accuracy target. While it is unclear why PCI2 performs so discordantly in this test, the good agreement between PCI1 and the radiometer suggests not only that our PCI quantification workflow can capture nonuniformities in a single UV-C exposure (compared with 23 radiometer exposures), but also that color difference quantification should facilitate new classes of measurements not feasible with radiometers.

PCI quantification facilitates new types of measurements for informed design of UV-C treatment

PCI quantification facilitates measurements not possible with bulky radiometers (S12 Fig), such as dose mapping across complex 3D morphologies. To highlight the impact of our workflow, we mapped relative UV-C doses across the 3D morphology of a Gerson 1730 N95 respirator in three orientations (Fig 3A) informed by the treatment area dose mapping (Fig 2C–2F). We exposed PCI1 indicators located on exterior and interior N95 surfaces to sub-saturating UV-C treatments (Fig 3B–3D). Limited by PCI dynamic range, the exposure times were insufficient for N95 decontamination, but did measure relative dose delivered to different respirator regions (informed design, Fig 1D(iii)). We observe that while nonuniformities in the system alone suggest ~2.5× irradiance nonuniformity across the treatment plane (Fig 2C–2F), on-N95 measurements show that nearly 20× disparity exists across multiple N95s in the same treatment system (Fig 3B–3D). PCI2 dose heatmaps and dose values for both indicators are presented in S13 Fig and S2 Table, respectively.

thumbnail
Fig 3. Quantifying PCIs elucidates UV-C treatment questions not measurable with radiometers.

(a) Illustration of the three sets of on-N95 measurements, mapping dose across: (1) the exterior of an N95 placed in the treatment plane center (highest-dose region), (2) the interior of an N95 placed in the treatment plane center, (3) the exterior of an N95 placed in the treatment plane periphery (lowest-dose region). (b-d) Scanned PCI1 images and corresponding UV-C dose quantified from PCI1 at various respirator surface locations. Although PCI color differences can appear subtle, quantification reveals substantial dose variation. Each relative dose measurement is normalized to the measurement at the apex of the central ‘convex-up’-oriented (exterior) respirator. Scanned images show a representative replicate, on-N95 heatmaps plot the mean of N = 3 measurements, while the histograms below each measurement plot all individual measurements. (b) Exterior of central respirator; ~3–4× dose difference is measured across the respirator surface. (c) Interior of central respirator. (d) Exterior of peripheral respirator. The corner-facing side of the N95 at the peripheral location is only exposed to 6.3 ± 1.1% of the dose delivered to the apex of the central respirator. (e) PCIs are 2-dimensional surface-like sensors that facilitate spatially resolved measurements. We leveraged this characteristic to show that permanent marker (‘Cal’ pattern) on a UV-C-transparent film placed atop PCI1 can mask UV-C exposure, suggesting that markings on respirators should be minimized. PCI1 changes from yellow to pink as it is exposed to higher UV-C doses (see Fig 2A); yellow regions correspond to areas shadowed by the marker.

https://doi.org/10.1371/journal.pone.0243554.g003

The respirator morphology has a striking impact on delivered dose: even in the center of the treatment plane there are regions on the exterior (convex) N95 surface that receive only ~25% of the dose at the apex (Fig 3B). There is similar but less dramatic nonuniformity present on the respirator interior (exposed concave side-up) (Fig 3C). Perhaps most strikingly, there are regions of a respirator in the treatment plane periphery (Fig 3D) that receive only 6% of the dose at the apex of the central N95 (Fig 3B). Due to the angular dependence of irradiance [15] as well as respirator self-shadowing stemming from the 3D morphology with respect to the UV-C source, the entire N95 surface must be considered when estimating UV-C dose for decontamination; measuring the irradiance in an empty system does not sufficiently predict irradiance on the N95 surface. Scientific evidence suggests that all N95 surfaces must receive ≥1.0 J/cm2 UV-C dose for 3-log bioburden reduction of several enveloped viruses [24]; however, our results show that 1.0 J/cm2 delivered to the apex of the central N95 in this system would result in only 0.06 J/cm2 applied to the side of an N95 placed in the periphery of the treatment plane. While this dose heterogeneity is certainly system- and N95 model-specific, it underscores the challenges of N95 decontamination and the critical importance of considering complex 3D geometries when designing and validating UV-C decontamination workflows.

In contrast with single-point radiometers, each PCI also records spatially resolved doses (Fig 3E). As many N95 decontamination implementations track N95s using permanent marker labelling, we assessed whether such labels might shadow underlying respirator layers by positioning a pattern (‘Cal’) drawn on UV-C-transmitting film overtop a PCI1 indicator during exposure. We observe pattern transfer onto the indicator (Fig 3E), suggesting that material underneath marker labels may not be as effectively decontaminated as unmarked regions. These examples of on-respirator dose quantification and spatially resolved measurement illustrate the novel, robust measurements PCIs can provide when combined with suitable, spatially resolved readout tools (vs. the single-measurement spectrocolorimeter), better informing UV-C treatment design.

Device-specific calibration facilitates quantification using widely available imaging tools

To overcome spectrocolorimeter limitations (e.g., cost, availability, and throughput) as well as work towards capturing spatial information already recorded in the PCIs, we generated and assessed device-specific calibration curves using widely available imaging tools under controlled lighting conditions. The calibration curves were generated from images of PCIs acquired using a flatbed scanner (Canon LiDE-400), a digital SLR camera (DSLR, Nikon D5500), and a smartphone (iPhone X) (DSLR and iPhone images were acquired in a light box to minimize the impact of ambient illumination). All tools captured raw images of the entire surface of both the exposed PCI as well as an unexposed reference PCI. The resulting calibration curves were then compared to those generated with data from the RM200QC (Fig 4A). We observe the highest CIEDE2000 ΔE values from measurement with the cameras. Though the flatbed scanner measures the lowest ΔE values, its measurements trend with those of the RM200QC and conveniently do not require a light box. We further assessed the squared sums of the residuals (SSE) for all fits as a measure of calibration accuracy (Fig 4B) and include quantification of the dose measurement relative uncertainty in S14 Fig. We observe the lowest SSE for the RM200QC, but all imaging approaches yield PCI1 quantification meeting the 10% ideal target relative uncertainty for a ~0.10 J/cm2 dose. No PCI2 quantification met the ideal target, consistent with the model’s higher relative uncertainty (Fig 2). Color measurement literature stresses that careful control of lighting conditions (e.g., using an enclosed light box or contact measurement) is critical in order to minimize variation induced by changes in ambient lighting [23, 36]. Even under identical lighting conditions with tight control of acquisition parameters, different imaging devices have different spectral sensitivities and color processing. For this reason, device-specific calibration (using a stringent color reference chart with a range of known colors) has been proposed as an essential step for image-based color quantification for several applications [24, 25, 36, 37]. A smartphone algorithm has been generated for this purpose [27], and flatbed scanners may be a promising, accessible approach provided raw images are acquired (e.g., with third-party software). Overall, these results suggest that with rigorous characterization and proper implementation, widely available imaging tools are appealing for spatially resolved PCI quantification.

thumbnail
Fig 4. The potential applications for UV-C quantification from PCIs could be broadened using widely available color measurement tools.

(a) Comparison of calibration curve fits of CIEDE2000 ΔE from an unexposed sensor vs. UV-C dose, for PCI1 and PCI2 colors quantified using the digital SLR and iPhone X in a light box, RM200QC spectrocolorimeter, and flatbed scanner. Datapoints within the shaded region denote individual PCI measurements, line denotes best fit, and shaded region denotes 95% prediction interval on prediction of color change from observation of UV-C dose. (b) Squared sum of the residuals (SSE) for each curve fit in (a), along with color comparison wheels showing indicator color at various doses as captured by the different imaging devices. Quantification of the dose-dependent relative uncertainty for each of the 8 curve fits is presented in S14 Fig.

https://doi.org/10.1371/journal.pone.0243554.g004

Optical engineering extends the quantifiable dose range for in-process validation of UV-C dose during N95 decontamination

The commercial market for UV-C PCIs has focused on hard surface UV-C decontamination processes requiring orders-of-magnitude lower doses than required for N95 decontamination, and thus, at this time of this study, we determined that there were no commercially available PCIs that met the dose-range requirements for in-process validation of N95 decontamination. Given the benefits of PCIs over radiometers, we next assessed whether a single ‘snap-shot’ dose/irradiance measurement could be extrapolated to accurately estimate the time required to deliver the minimally acceptable dose for N95 decontamination (i.e., is irradiance constant?) (Fig 5A). Irradiance was found to substantially depend on UV-C system, warm-up status, and duration of exposure (Fig 5B and S7 File and S15 Fig), challenging use of ‘snap-shot’ approaches and necessitating innovation to extend the quantifiable PCI dose range for in-process validation of UV-C N95 decontamination.

thumbnail
Fig 5. Quantitative in-process UV-C dose validation of N95 decontamination cycles using PCIs could be feasible using optical attenuation to extend the dynamic range beyond 1.0 J/cm2.

(a) Treatment durations calculated from single ‘snap-shot’ dose measurements inaccurately assume constant irradiance by disregarding bulb warm-up and thermal output degradation during exposure. (b) Two near-identical UV-C exposure systems have significantly different output profiles over time, both during warm-up (left), and during long exposures (right). Plots depict mean (line) and standard deviation (shaded region) of the replicate measurements: N = 16 (System 1 warm-up); N = 10 (System 2 warm-up); N = 19 (System 1 long exposure); N = 11 (System 2 long exposure). (c-d) 1.1 mm thick Borofloat glass and 1.3 OD neutral density filters extend the dynamic range of (c) PCI1 and (d) PCI2 sensors. PCI1 no filter R2 = 0.998, a = 47.1, b = 80.4. PCI1 with Borofloat filter R2 = 0.999, a = 47.3, b = 699. PCI1 with 1.3 OD neutral density filter R2 = 0.998, a = 44.2, b = 2728. PCI2 no filter R2 = 0.992, a = 47.7, b = 0.00060. PCI2 with Borofloat filter R2 = 0.990, a = 61.8, b = b = 3.63x10-5. PCI2 with 1.3 OD neutral density filter R2 = 0.992, a = 62.7, b = 1.10x10-5. Color comparison wheels show PCI colors corresponding to doses marked along the x-axis, except in “No Filter” cases due to space constraints on the x-axis. Datapoints within the shaded region denote individual PCI measurements, line denotes best fit, and shaded region denotes 95% prediction interval on prediction of color change from observation of UV-C dose. (e-f) The relative width of quantified 95% confidence intervals on UV-C dose measurements from CIEDE2000 color difference between exposed and unexposed samples of (e) PCI1 and (f) PCI2, as a function of UV-C dose, plotted to the right of the corresponding dose-response curve.

https://doi.org/10.1371/journal.pone.0243554.g005

There are two potential solutions to extend the PCI dose range: (1) engineer the indicator (e.g., modified chemistry), or (2) engineer the system surrounding the indicator. Towards (2), we assessed the capacity of several materials to attenuate the UV-C irradiance reaching the indicator to a sufficient degree to facilitate dose quantification beyond 1.0 J/cm2 (Fig 5C–5D). We observe that commercial UV neutral density filters (1.3 OD) extend the quantifiable dose (<10% relative measurement uncertainty on the PCI1 measurements) from 0.2 J/cm2 to at least 5.0 J/cm2 to meet the in-process validation dose specification (Fig 5E and S1 Table). After confirming that the quantifiable dose range could be extended beyond 1.0 J/cm2 with attenuation, we investigated a less expensive, widely available glass option. Although standard borosilicate or soda-lime glass slides and coverslips block UV-C and are thus not appropriate filter options, 1.1 mm Borofloat glass offers much higher UV-C transmittance [38] and is available in a range of sizes and shapes from multiple suppliers. The Borofloat glass filters extended the quantifiable range of both PCIs beyond 1.0 J/cm2 (Fig 5C–5F, with the PCI1 measurement uncertainty remaining below 10% up to 2.0 J/cm2 (below 20% up to the highest tested dose of 2.5 J/cm2).

The dose-response curves presented in Fig 5C–5D illustrate how optical attenuators can be coupled with PCIs to extend quantifiable dose range; however, the implementation of this type of approach requires careful characterization. First, before implementing any filter material, both the inter-filter transmittance variability and the transmittance change with UV-C exposure (e.g., due to solarization [39]) need to be characterized. Transmittance variability contributes to the uncertainty on any filtered dose measurement, while transmittance changes determine the usable lifetime of a filter (single-use vs. reuse). Second, the filter transmittance angular response needs to be assessed. Angular response can vary from the ideal cosine response based on a number of factors, including the angle-dependent optical path length through the attenuator or the angle-dependent reflectance. For a glass filter, these can be modelled using the Beer-Lambert law coupled with the Fresnel equations and Snell’s law [40]. Filter angular response could introduce similar measurement artefacts to those reported for the uncorrected radiometer in S5 File and thus should be understood prior to implementation. Third, filter materials should either be combined with a validated UV-C-specific photochromic indicator or have well-controlled transmission spectra to avoid a filter-indicator pair that primarily detects non-germicidal UV-A or UV-B wavelengths [7, 41]. Many common materials such as glass and plastics have lower UV-C transmission than that at longer wavelengths [7], and thus may filter out the critical wavelength range to be measured. The ideal filter would block all non-germicidal light and attenuate UV-C; however, as solarization rapidly changes transmittance and translatability requires inexpensive, widely available materials, the ideal filter is not easily attainable. Neutral density filters or even filters that attenuate UV-C to a greater degree than longer wavelengths are acceptable when coupled with UV-C specific PCIs. Although important properties of the filter-indicator pair need to be characterized prior to implementation, the extension of quantifiable dose demonstrated in Fig 5C–5F illustrates how Borofloat glass or other attenuating materials can help to address the urgent need for in-process UV-C validation, complementing future innovation in photochromic chemistry.

Conclusions

Quantifying color from PCIs addresses urgent needs in UV-C dose measurement for (and beyond) N95 respirator decontamination. By tailoring established color measurement protocols to PCIs, we designed and validated a photochromic quantification workflow and then applied it to conduct measurements not robustly quantifiable with existing tools. Novel aspects of our workflow include quantifying CIEDE2000 and a suite of alternate color difference metrics for PCIs, implementing calibration informed by chemical kinetics, and quantifying PCI dose measurement uncertainty. Our workflow quantified performance specifications and revealed that while performance was highly PCI model-dependent, one indicator model met all specifications for informed design of UV-C N95 treatment systems: UV-C dose measurement range up to 0.2 J/cm2 with relative measurement uncertainty of 6.05% at 0.1 J/cm2, <5% response to UV-A/UV-B, and >90% accuracy compared to a calibrated digital radiometer. Our workflow enabled on-respirator dose quantification using PCIs, identifying nearly 20× dose nonuniformity across different N95 surface regions within a treatment system. As a result, the target dose delivered to the treatment plane within the UV-C system may need to be much higher than 1.0 J/cm2 to ensure that all N95 surfaces are exposed to ≥1.0 J/cm2. Because these dose nonuniformities across the N95 surface are model- and configuration-dependent, each treatment system should be characterized with the N95 models in situ for informed design of UV-C N95 treatment processes. PCI calibration curves for widely available imaging tools like flatbed scanners, iPhones, and DSLRs also meet minimum performance specifications and facilitate accessible, spatially resolved dose measurements. In future work, intercalation of PCIs between each N95 material layer would quantify spatially resolved UV-C attenuation in the interstices of each porous layer, improving our understanding of complex multi-layer materials. Finally, PCI dynamic range can be extended by coupling with optical attenuators of known transmittance. Although important open questions remain for these attenuators (such as optical transmission stability and angular response), filter-coupled PCIs are promising for high-throughput in-process dose validation for UV-C N95 decontamination. We anticipate that the PCI quantification workflow will be widely applied to meet the current urgent validation need, facilitating (1) informed design of UV-C treatment protocols to ensure that all N95 surfaces are exposed to the minimum dose, (2) in-process dose validation of each cycle, and (3) characterization of the robustness of new PCI materials.

Materials and methods

UV-C sensors

A Model 308 data-logging UV radiometer equipped with a 254 nm sensor (Optical Associates, Inc., OAI) was used for all irradiance measurements. An ILT1254/TD UV-C (International Light Technologies, ILT) radiometer with a near-ideal cosine angular response was used for secondary validation of irradiance measurements. Both radiometers are NIST-traceable and were calibrated within 2 months of data collection. Dose was calculated from irradiance data measured by the OAI radiometer and data logging software over the exposure time:

UV-C sources

Two different Spectroline UV treatment systems (same dimensions) were used as the UV-C source for all experiments. The XL-1500 Spectrolinker (“System 2”) was equipped with six low-pressure mercury bulbs (BLE-1T155, uvebay.com). In order to record the dose delivered in this enclosure using the radiometer, the OAI meter was wrapped in UV-C blocking material (PVC) and placed along the back wall of the chamber. This meter was plugged into a Microsoft Surface Pro tablet wrapped in multiple layers of UV-C blocking materials positioned on the left-hand side of the chamber floor. The tablet was controlled remotely using TeamViewer to record irradiance values over time. All photochromic indicator (PCI) dose-response curves were measured near the center of the chamber, beside the Surface tablet. In addition, a Spectroline HCL-1500 (with the same chamber materials and dimensions as System 2, referred to as ‘System 1’) equipped with six low pressure amalgam bulbs (BLE-1T155, Spectroline) was generously donated by Spectroline with a small notch in the door to accommodate a sensor cable. With this modified instrument, data logging could be performed with the meter and tablet outside of the UV-C chamber.

UV-C dose-response of PCIs

Commercial PCIs marketed for UV-C detection from two different companies were assessed: UVC 100 Dosimeter Dots from Intellego (‘PCI1’) and Control-Cure® UV-C Intensity Labels (N010-004) from UV Process Supply (‘PCI2’). Dose measurements were quantified by integrating irradiance measurements logged by the OAI radiometer over time using a custom Python script. PCIs were placed on a plastic container of similar height to the sensor (16 mm). The irradiance at the PCI location was verified to be within 0.01 mW/cm2 of the irradiance at the radiometer location prior to measurements. PCIs were cut into pieces and a single sample was placed on either the digital sensor or plastic container and exposed during bulb warm-up to serve as a saturated reference. D65/10° L*a*b* measurements of both saturated and unsaturated reference PCIs were recorded using an RM200QC spectrocolorimeter (X-Rite). After bulb warm-up, sample PCIs were irradiated for a set amount of time using the “time” operating mode of the UV-C treatment system. After UV-C exposure, the color of the exposed PCI was immediately (within 5 minutes) assessed using the RM200QC spectrocolorimeter (set to report the average of three measurements of each sample).

Quantifying dose-response curves of PCIs

D65 L*a*b* measurements of PCI color assessed using the RM200QC spectrocolorimeter, along with UV-C doses (integrated from irradiance measurement logs of the radiometer readings: were compiled into a spreadsheet format using custom Python scripts, and then analyzed in MATLAB® using scripts custom-written for this application. In order to minimize the impact of imaging/measurement conditions on the PCI color measurement, color difference from an unexposed PCI was assessed in all cases, rather than absolute PCI color. There are a range of color difference metrics [22], and for this work we quantified and compared several.

CIELAB (1976) color difference was computed as the Euclidean distance between the L*a*b* values of the exposed (E) and reference (unexposed, R) PCIs: ΔL *, Δa *, and Δb * are the differences between the exposed and reference sensor L*a*b* coordinates. Similarly, the L*a*b* colors were converted to the RGB color space using built-in MATLAB functions and the Euclidean RGB color difference was computed as: Similar as in the L*a*b* color space, ΔR,ΔG, and ΔB are the differences between the exposed and reference RGB coordinates. We also plotted, as a function of exposure dose, the differences in individual components ΔR,ΔG, and ΔB, as well as differences in lightness (), chroma (), and the CIE 1976 Metric Hue Difference (), where s = 1 if a*R b*E > a*E b*R and -1 otherwise [22].

We compute red, green, and blue channel colorimetric absorbance as [25]: where γ is the device-dependent gamma correction factor, IRGB is the red, green, or blue channel intensity of the exposed sensor and IRGB,0 is the respective channel intensity of the unexposed reference sensor. IRGB was computed from the RM200QC-measured L*a*b* values using the ‘lab2rgb’ MATLAB function with γ assumed to be 1. Finally, we computed the sets of equations for the CIEDE2000 ΔE color difference, as defined by Luo, Cui, and Rigg [29]. Our MATLAB implementation of CIEDE2000 was tested using the example color pairs presented by Luo, Cui, and Rigg [29], and found to yield the reported ΔE values for the 10 sample-reference pairs.

Extending the dynamic range of PCIs

In order to assess the amount by which the dynamic range of the PCIs could be extended, two different filter materials were studied: a mounted 1.3 OD neutral density filter (NDUV13A, Thorlabs) and 1.10 mm thick Borofloat® glass specified with 80/50 scratch/dig (Precision Glass & Optics). PCIs were placed on the plastic container underneath the filter material while the radiometer recorded unfiltered irradiance over time. UV-C transmission was measured using the OAI digital radiometer and calculated as the peak irradiance through the filtering material divided by the peak irradiance in the absence of filtering material.

Characterizing variability across the treatment plane

A 279.4 mm x 431.8 mm paper grid with 63.5 mm markings was centered on the floor of the treatment plane. After bulb warm-up, the digital UV-C radiometer was placed at specified grid locations (S16 Fig) and peak irradiance was recorded over 15–20 seconds. The irradiance at the center of the treatment plane was verified to remain constant every 3–6 measurements to minimize variability caused by bulb output changes. The irradiances at all designated spatial locations were measured in triplicate. For PCI measurements (performed in duplicate), indicators were secured to the spatial locations on a copy of the 63.5 mm grid using double-sided tape. The grid was then inserted into the treatment system atop the master grid. The digital radiometer was placed in its designated location for data logging (S16 Fig). After exposure, PCIs were transferred to a consolidated layout for RM200QC analysis and measured within ~15 minutes.

Quantifying unknown doses using PCIs

In order to quantify unknown UV-C doses (e.g. across the treatment plane of the UV-C exposure system, or across the surface of an N95 respirator), color measurements from the RM200QC were read in from a spreadsheet into a custom MATLAB® script. Previously generated calibration datasets (CIEDE2000 ΔE measured with the same instrument vs. known UV-C dose, as described in “Quantifying dose-response curves of PCIs” above) were read in and fitted with the calibration functions described in S3 File. For each measurement, the L*a*b* color values for the exposed PCI and unexposed PCI reference (measured on the same day with the same instrument) were read in and the CIEDE2000 ΔE between this pair was computed as previously described. The UV-C exposure dose was predicted from the CIEDE2000 ΔE using the calibration curve. First, the inverse of the fit function was used to predict the dose from the color change. For the fit function corresponding to first-order reaction kinetics: For the fit function corresponding to second-order reaction kinetics: To estimate the uncertainty on the predicted dose measurement (udose), methods for estimating uncertainties of calibrated values via propagation of error, along with uncertainties on the fitted parameters (standard deviations sa and sb) and ΔE measurement (standard deviation sΔE), were used to estimate the variance of the measured value [42]: Where sab denotes the covariance between a and b. To complete this computation, sa, sb, and sab were computed from the curve fit covariance matrix, and the partial derivatives of the inverse fit functions used in the computation of are as described in Table 1.

thumbnail
Table 1. Fit functions, inverse fit functions, and partial derivatives used in uncertainty calculations for calibrated measurements.

https://doi.org/10.1371/journal.pone.0243554.t001

The ΔE measurement uncertainty sΔE was measured from the standard deviation of 15 replicate measurements of unexposed PCI1 or PCI2 using the RM200QC, each compared to the same measurement of an exposed (saturated) PCI1 or PCI2, respectively. To understand the uncertainty on each type of color quantification, this standard deviation was calculated for color quantification via CIEDE2000 ΔE, CIELAB 1976 ΔC, RGB ΔC, ΔR, ΔG, ΔB, ΔL, ΔC, ΔH, and colorimetric absorbances AbsR, AbsG, and AbsB. The resulting uncertainties are presented in Table 2.

thumbnail
Table 2. RM200QC measurement uncertainties sΔE for various metrics of color quantification and two models of PCI.

Each uncertainty reports the standard deviation of N = 15 measurements of replicate unexposed PCIs. We observe higher measurement uncertainty for unexposed PCI1, which we attribute to heterogeneity (dots and striations) in the colored PCI coating.

https://doi.org/10.1371/journal.pone.0243554.t002

Ninety-five percent confidence intervals for predicted doses from each curve fit (α = 0.05) were predicted from the estimated variance ()as [43]: where is the student’s t-inverse cumulative distribution (tinv in MATLAB®), and ν is the degrees of freedom for the calibration curve fit. The relative widths of these 95% CIs (normalized to the measured dose) are thus: In experiments where triplicate PCI measurements of unknown doses were acquired and quantified using the calibration curve process described above, the measured doses were first equalized by correcting with a factor related to the dose logged by the radiometer during each exposure to correct for differences in the exposure time/dose between replicate measurements. To perform this correction, the doses measured from the PCI color change (as well as the confidence intervals and standard deviation of the measured value ) were multiplied by a target dose (constant across the replicate datasets) and divided by the logged OAI radiometer dose. After this correction for differences in the dose to which the PCIs were exposed, the uncertainty estimated from the standard deviation of the replicate measurements was combined with the uncertainty from the calibration fit measurements by root sum of squares: where is as described above, and is the squared standard deviation of replicate measurements. For several datasets, dose measurement data are presented as relative doses (dosenorm), normalized to measurements at a different location or in a different experimental setup: For these normalized measurements, the uncertainty is calculated from the uncertainties on both the measured and reference estimated doses via propagation of error as follows: Measured doses were plotted as heatmaps and histograms using the ‘inferno’ perceptually uniform, colorblind-friendly colormap, which was created by Stéfan van der Walt and Nathaniel Smith and adapted from Python’s matplotlib for use in MATLAB® by Ander Biguri [44].

PCI response to non-germicidal light

A 300 nm longpass filter (#46–417, Edmund Optics) was used to assess the reactivity of the PCIs to wavelengths longer than the germicidal (200–280 nm) UV-C range. For each experiment, one PCI was placed beneath the longpass filter on top of the plastic container and one PCI was placed on the digital sensor as an unfiltered control. Post-exposure color was measured using the RM200QC. In order to assess the reactivity of the PCIs to sunlight, both models of commercial PCI were taped to the same white background using double-sided tape and covered with black cardstock during transport outside. The exposure to sunlight began at 17:50 on May 30th, 2020 in Berkeley, CA, USA, when the UV index [45] was reported as 1 by Apple Weather. The color change was recorded over 5 minutes via iPhone 8 video. Both pre- and post-exposure PCIs were imaged using the Nikon D5500 and quantified using the RM200QC.

Measuring dose received by N95 respirator surface

PCIs were affixed to the appropriate location on the surface of a NIOSH-approved Gerson 1730 N95 respirator using double-sided tape. Due to the limited dose range of the PCIs, preliminary experiments were conducted to determine an exposure time that caused all PCIs to change color within the dynamic range of the color calibration curves. For all but one condition, the exposure time was set for 8 seconds. For two exposures using PCI2 to quantify dose on a peripheral N95, the time was set for 19 seconds to take advantage of more of the PCI2 indicators’ range. These differences in exposure were compensated for in the analysis workflow described in “Quantifying unknown doses using PCIs” above. The respirator was positioned in its marked location within the UV-C source (either center or periphery) (S17 Fig). In the center, the straps were spread away from the respirator to minimize shadowing. For measurements of the respirator on the periphery of the treatment plane, the straps were taped together and tucked under the respirator. The OAI radiometer, with a corresponding PCI on top, was placed in its designated location for irradiance logging (S17 Fig). The color of all PCIs after exposure was recorded using the RM200QC.

Assessing alternative imaging systems (iPhone, flatbed scanner, and digital SLR)

After each PCI exposure, the exposed indicator was imaged between unexposed and saturated references with the iPhone and Nikon D5500 within a FotodioX LED Studio-in-a-Box (FOSIAB2424, B&H) with the grey background installed. A platform was frequently inserted underneath the grey background to raise the PCIs closer to the cameras. The included diffuser sheet was cut and installed to cover the LED lights but not the top hatch. Within the Studio-in-a-Box, raw images of the PCIs were acquired using a Nikon D5500 equipped with a 40 mm macro lens or using Halide on an iPhone X at 2× optical zoom. The settings for both cameras were set manually and kept consistent within each experiment. At the conclusion of each experiment, the PCIs were scanned using VueScan, set to acquire raw images, on a flatbed scanner (LiDE 400, Canon).

Color quantification from different imaging systems

In order to compare color quantification from the RM200QC spectrocolorimeter ‘gold standard’ tool with that from more widely available imaging devices, images of the PCIs acquired with multiple imaging devices were compared. For iPhone and DSLR images, a set of images (one for each exposed PCI) was acquired, each containing the exposed PCI between an unexposed and saturated PCI, with nearby white-balance region and Pantone® color match to the exposed PCI. For the flatbed scanner images, a single image of all of the exposed PCIs from a dose-response experiment, along with a single unexposed and single saturated PCI, was acquired on a white background. iPhone and DSLR images were acquired after each PCI exposure; scanner images were acquired once all PCI exposures in an experiment were complete. Raw images (.DNG for iPhone X, .NEF for DSLR, .TIF for flatbed scanner) were acquired and converted to .TIF format to be read into MATLAB® and analyzed using custom scripts.

In the image analysis script, each image was read in sequentially and the user prompted to draw rectangular areas over (a) the exposed PCI, (b) the Pantone® match to the PCI, (c) the white region proximal to the PCI(s), (d) the unexposed PCI, and (e) the saturated PCI. In all cases, care was taken to draw a region encompassing only the region of interest (i.e., not edges, dust, or shadowed regions). For the camera images (an image for each PCI), all 5 regions were denoted on each image (for each exposed PCI). For the scanner images (a single image for all PCIs), a single region was denoted for the white, unexposed, and saturated regions, respectively, and used in the analysis for all exposed PCIs in one experiment, with only the PCI region denoted for each exposure dose (Pantone® matches were not scanned). After all regions on each image were selected, the average RGB value for the white region was used to white-balance and exposure-correct the image before computing the average RGB values for the other region types. The RGB value for each region was then converted to the L*a*b* color space using MATLAB®’s built-in rgb2lab function. RGB and L*a*b* values from the processed images were then subjected to the same processing for color difference calculations as described above for the measured RM200QC L*a*b* values in “Quantifying dose-response curves of PCIs”.

CIEDE2000 color differences from an unexposed PCI, computed from each image type as well as the RM200QC measurements of the same set of PCIs, were fitted to the appropriate calibration function and plotted (along with 95% prediction intervals) as a function of exposure dose, in order to compare the relative dose-responses and calibration uncertainties measured with each tool. The squared sum of the residuals from the curve fit (SSE) for each dataset was computed and compared as a metric of calibration robustness for each color readout method.

Visualizing reduced UV-C transmission through permanent marker ink

To demonstrate spatially resolved measurement, we visualized the UV-C shadowing abilities of permanent marker ink. The “Cal” university logo was drawn with Sharpie® permanent marker on a UV-C-transmissive (~82% transmittance) plastic plate sealer adhesive film. The plastic film with permanent marker logo was then placed atop a PCI1 indicator within the UV-C treatment plane and exposed to UV-C for ~10s (applied UV-C not precisely controlled for this qualitative test). After exposure, the film and exposed PCI were imaged using the flatbed scanner.

Assessing temporal fluctuations in irradiance

Irradiances over time logged using the OAI radiometer either during system warm-up or during long-exposures after warm-up were parsed from the output .txt files using a custom Python script and read into MATLAB®. Warm-up datasets approximated the variance that would be present in applied conditions because the time since previous use was not controlled (the datasets began with the lamps in varying states of warm-cool). Each dataset was analyzed to automatically detect the iteration (iend) at which lamp shutoff occurred (from the change from the previous measurement). The irradiance data were plotted until 2 measurements prior to that measurement iteration (iend-2). For the system warm-up datasets, warm-up rise time was computed as the time for the irradiance to rise from 10% of the maximum recorded value to 90% of the maximum recorded value. For the long exposure datasets, the output degradation was assessed by extracting the irradiance degradation slope from linear least-squares curve fitting.

The estimated time to reach 1.0 J/cm2 from each exposure was computed as the target dose (1.0 J/cm2) divided by the mean irradiance. To assess the effects of temporal instability of the lamp output, this calculation was computed for both a mean irradiance at the beginning of each exposure (taking the mean irradiance over the 10th to 20th iterations of the data logger) and a mean irradiance at the end of each exposure (taking the mean irradiance over the last 11 iterations prior to the detected end point (iend, automatically detected from lamp shutoff as described above).

Supporting information

S1 Fig. Comparison of alternative color difference metrics.

https://doi.org/10.1371/journal.pone.0243554.s001

(TIF)

S2 Fig. Comparison dose-response curves of two different batches of PCI1.

https://doi.org/10.1371/journal.pone.0243554.s002

(TIF)

S3 Fig. Comparison of calibration fit functions for PCI2.

https://doi.org/10.1371/journal.pone.0243554.s003

(TIF)

S4 Fig. Calibration curve fit and relative uncertainty on measurements using red, green, and blue colorimetric absorbance.

https://doi.org/10.1371/journal.pone.0243554.s004

(TIF)

S5 Fig. Relative quantification uncertainty depends on both the measured UV-C dose and the measured ΔE uncertainty.

https://doi.org/10.1371/journal.pone.0243554.s005

(TIF)

S6 Fig. Relative uncertainty on measurements using alternate color difference metrics.

https://doi.org/10.1371/journal.pone.0243554.s006

(TIF)

S7 Fig. Assessing PCI specificity to germicidal UV-C wavelengths.

https://doi.org/10.1371/journal.pone.0243554.s007

(TIF)

S9 Fig. Correction factor validation using mask/aperture setup.

https://doi.org/10.1371/journal.pone.0243554.s009

(TIF)

S10 Fig. Correction factor validation using PCIs.

https://doi.org/10.1371/journal.pone.0243554.s010

(TIF)

S11 Fig. Angular response affects quantification of spatial nonuniformity.

https://doi.org/10.1371/journal.pone.0243554.s011

(TIF)

S14 Fig. Quantification uncertainty for imaging using widely available tools.

https://doi.org/10.1371/journal.pone.0243554.s014

(TIF)

S15 Fig. Irradiance variability over time and between systems.

https://doi.org/10.1371/journal.pone.0243554.s015

(TIF)

S16 Fig. Measurement map for characterizing the treatment plane using the OAI sensor and the PCIs.

https://doi.org/10.1371/journal.pone.0243554.s016

(TIF)

S17 Fig. Measurement map for on-N95 dose characterization.

https://doi.org/10.1371/journal.pone.0243554.s017

(TIF)

S1 Table. Specifications for robust UV-C measurements.

https://doi.org/10.1371/journal.pone.0243554.s019

(DOCX)

S1 File. Informed UV-C system design and validation PCI workflow example.

https://doi.org/10.1371/journal.pone.0243554.s021

(DOCX)

S2 File. Comparison of color difference metrics outlined in ASTM D2244-16.

https://doi.org/10.1371/journal.pone.0243554.s022

(DOCX)

S3 File. Generation of PCI calibration functions.

https://doi.org/10.1371/journal.pone.0243554.s023

(DOCX)

S4 File. Assessing specificity of PCIs to germicidal UV-C.

https://doi.org/10.1371/journal.pone.0243554.s024

(DOCX)

S5 File. Radiometer correction factor determination.

https://doi.org/10.1371/journal.pone.0243554.s025

(DOCX)

S6 File. Correction factor validation using a mask/aperture setup.

https://doi.org/10.1371/journal.pone.0243554.s026

(DOCX)

S7 File. Nonuniformities in and between UV-C sources necessitate rigorous UV-C dose characterization.

https://doi.org/10.1371/journal.pone.0243554.s027

(DOCX)

Acknowledgments

This urgent study could not have been completed so quickly without tremendous support from a large number of generous individuals. We sincerely thank C. Cameron Miller, PhD, Maritoni Litorja, PhD, and Thomas Larason, MS, from the Optical Radiation Group at NIST, as well as Clarence Zarobila, MS, from the Remote Sensing group at NIST for developing the virtual calibration approach and conducting the Zemax OpticStudio optical modelling simulations. We are immensely grateful to Margaret Belska, Susan Farnand, PhD, Robin Jenkin, PhD, Elaine Jin, PhD, Norman Koren, MA, Ronnier Luo, PhD, Michael Pointer, PhD, Jackson Roland, Eric Walowit, Stephen Westland, PhD, and Dietmar Wüller, Dipl.-Ing., for helpful discussions on color quantification. We appreciate contributions from Geoff McConohy, Mazzin Elsamaloty, and Josh Molho, PhD, towards preliminary attenuator characterization. We are grateful for the generosity of Intellego, UV Process Supply, and Precision Glass and Optics in providing critical materials for the study, and gratefully acknowledge helpful discussions and generous donation of time and materials from Daniel Tristan, Gustavo Garcia, Betty Cheng, MS, Philip Chau, and Mike Fleming from Spectro UV and Spectronics Corporation. We thank Ronald Moody and Evan Palmer from Optical Associates, Inc. (OAI) for support and acquiring angle-response characterization data for our purchased sensor. We would also like to thank Kyle Balston, MASc and Ellen Plane, MLA, MCP, for support and helpful discussions regarding data analysis and experimental setup. Finally, we acknowledge the other members of the N95DECON scientific consortium and medical/external partners (especially Benjamin P. Sullivan, MS, Jonathan Posner, PhD, Martin Purschke, PhD, Mark Schweitzer, and Mike Marschner) for helpful needs-finding discussions.

References

  1. 1. CDC. Decontamination and Reuse of Filtering Facepiece Respirators [Internet]. Centers for Disease Control and Prevention. 2020 [cited 2020 Jun 19]. Available from: https://www.cdc.gov/coronavirus/2019-ncov/hcp/ppe-strategy/decontamination-reuse-respirators.html
  2. 2. Lore MB, Heimbuch BK, Brown TL, Wander JD, Hinrichs SH. Effectiveness of Three Decontamination Treatments against Influenza Virus Applied to Filtering Facepiece Respirators. Ann Occup Hyg. 2011 Aug 22;56(1):92–101. pmid:21859950
  3. 3. Mills D, Harnish DA, Lawrence C, Sandoval-Powers M, Heimbuch BK. Ultraviolet germicidal irradiation of influenza-contaminated N95 filtering facepiece respirators. Am J Infect Control. 2018 Jul;46(7):e49–55. pmid:29678452
  4. 4. Heimbuch B, Harnish D. Research to Mitigate a Shortage of Respiratory Protection Devices During Public Health Emergencies [Internet]. Applied Research Associate, Inc; 2019 [cited 2020 Mar 27]. Report No.: HHSF223201400158C. Available from: https://www.ara.com/wp-content/uploads/MitigateShortageofRespiratoryProtectionDevices_3.pdf
  5. 5. Lindsley WG, Martin SB, Thewlis RE, Sarkisian K, Nwoko JO, Mead KR, et al. Effects of Ultraviolet Germicidal Irradiation (UVGI) on N95 Respirator Filtration Performance and Structural Integrity. J Occup Environ Hyg. 2015 Aug 3;12(8):509–17. pmid:25806411
  6. 6. John J. Lowe, Katie D. Paladino, Jerald D. Farke, Kathleen Bouleter, Kelly Cawcutt, Mark Emodi, et al. N95 Filtering Facemask Respirator Ultraviolet Germicidal Irradiation (UVGI) Process for Decontamination and Reuse [Internet]. 2020. Available from: https://www.nebraskamed.com/sites/default/files/documents/covid-19/n-95-decon-process.pdf
  7. 7. Kowalski W. Ultraviolet Germicidal Irradiation Handbook: UVGI for Air and Surface Disinfection [Internet]. Berlin, Heidelberg: Springer Berlin Heidelberg; 2009 [cited 2020 Apr 17]. Available from: http://link.springer.com/10.1007/978-3-642-01999-9
  8. 8. Beck SE, Hull NM, Poepping C, Linden KG. Wavelength-Dependent Damage to Adenoviral Proteins Across the Germicidal UV Spectrum. Environ Sci Technol. 2018 Jan 2;52(1):223–9. pmid:29261289
  9. 9. Fisher EM, Shaffer RE. A method to determine the available UV-C dose for the decontamination of filtering facepiece respirators: UV-C decontamination of respirators. J Appl Microbiol. 2011 Jan;110(1):287–95. pmid:21054699
  10. 10. Ozog DM, Sexton JZ, Narla S, Pretto-Kernahan CD, Mirabelli C, Lim HW, et al. The Effect of Ultraviolet C Radiation Against Different N95 Respirators Inoculated with SARS-CoV-2. Int J Infect Dis. 2020 Sep;224–9. pmid:32891736
  11. 11. Cadnum JL, Li D, Redmond SN, John AR, Pearlmutter B, Donskey C. Effectiveness of Ultraviolet-C Light and a High-Level Disinfection Cabinet for Decontamination of N95 Respirators. Pathog Immun. 2020 May 2;5(1):52–67. pmid:32363254
  12. 12. Heimbuch BK, Wallace WH, Kinney K, Lumley AE, Wu C-Y, Woo M-H, et al. A pandemic influenza preparedness study: Use of energetic methods to decontaminate filtering facepiece respirators contaminated with H1N1 aerosols and droplets. Am J Infect Control. 2011 Feb;39(1):e1–9. pmid:21145624
  13. 13. Tseng C-C, Li C-S. Inactivation of Viruses on Surfaces by Ultraviolet Germicidal Irradiation. J Occup Environ Hyg. 2007 Apr 23;4(6):400–5. pmid:17474029
  14. 14. Voet D, Gratzer WB, Cox RA, Doty P. Absorption spectra of nucleotides, polynucleotides, and nucleic acids in the far ultraviolet. Biopolymers. 1963;1(3):193–208.
  15. 15. Reifsnyder WE. Radiation geometry in the measurement and interpretation of radiation balance. Agric Meteorol. 1967 Jul;4(4):255–65.
  16. 16. Bolton JR, Linden KG. Standardization of Methods for Fluence (UV Dose) Determination in Bench-Scale UV Experiments. J Environ Eng. 2003 Mar;129(3):209–15.
  17. 17. Lawal O, Dussert B, Howarth C, Platzer K, Sasges M, Muller J, et al. Method for the Measurement of the Output of Monochromatic (254 nm) Low-Pressure UV Lamps. IUVA News. 19(1):9–16.
  18. 18. Reed NG, Wengraitis S, Sliney DH. Intercomparison of Instruments Used for Safety and Performance Measurements of Ultraviolet Germicidal Irradiation Lamps. J Occup Environ Hyg. 2009 Apr 6;6(5):289–97. pmid:19259871
  19. 19. Schmalwieser AW. Fifteen years of experience with standardized reference radiometers for controlling low-pressure UV disinfection plants for drinking water. Water Supply. 2017 Jul 1;17(4):975–84.
  20. 20. Poster DL, Miller CC, Obeng Y, Postek MT, Cowan TE, Martinello RA. Innovative approaches to combat healthcare-associated infections using efficacy standards developed through industry and federal collaboration. In: Sakdinawat AE, Attias A-J, Panchapakesan B, Dobisz EA, editors. Nanoengineering: Fabrication, Properties, Optics, and Devices XV [Internet]. San Diego, United States: SPIE; 2018 [cited 2020 Dec 3]. p. 55. Available from: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/10730/2500431/Innovative-approaches-to-combat-healthcare-associated-infections-using-efficacy-standards/10.1117/12.2500431.full
  21. 21. Lindblad M, Tano E, Lindahl C, Huss F. Ultraviolet-C decontamination of a hospital room: Amount of UV light needed. Burns. 2020 Jun;46(4):842–9. pmid:31676249
  22. 22. ASTM International. Standard Practice for Calculation of Color Tolerances and Color Differences from Instrumentally Measured Color Coordinates [Internet]. ASTM Standard D2244-16. 2016 [cited 2020 Dec 3]. Available from: https://www.astm.org/Standards/D2244.htm
  23. 23. Cui G, Luo MR, Rhodes PA, Rigg B, Dakin J. Grading textile fastness. Part 1: Using a digital camera system. Color Technol. 2003 Jul;119(4):212–8.
  24. 24. Carpenter K, Farnand S. Assessing the use of smartphones to determine crop ripeness. Electron Imaging [Internet]. 2020 [cited 2020 Apr 12]; Available from: https://www.ingentaconnect.com/content/10.2352/ISSN.2470-1173.2020.12.FAIS-173
  25. 25. Soda Y, Bakker E. Quantification of Colorimetric Data for Paper-Based Analytical Devices. ACS Sens. 2019 Dec 27;4(12):3093–101. pmid:31744290
  26. 26. Singh G, Raj P, Singh H, Singh N. Colorimetric detection and ratiometric quantification of mercury using azophenol dye: ‘dip & read’ based handheld prototype device development. J Mater Chem C. 2018;6(46):12728–38.
  27. 27. Yetisen AK, Martinez-Hurtado JL, Garcia-Melendrez A, da Cruz Vasconcellos F, Lowe CR. A smartphone algorithm with inter-phone repeatability for the analysis of colorimetric tests. Sens Actuators B Chem. 2014 Jun;196:156–60.
  28. 28. Solari F, Girolimetti G, Montanari R, Vignali G. A New Method for the Validation of Ultraviolet Reactors by Means of Photochromic Materials. Food Bioprocess Technol. 2015 Nov;8(11):2192–211.
  29. 29. Luo MR, Cui G, Rigg B. The development of the CIE 2000 colour-difference formula: CIEDE2000. Color Res Appl. 2001 Oct;26(5):340–50.
  30. 30. Soda Y, Robinson KJ, Cherubini TJ, Bakker E. Colorimetric absorbance mapping and quantitation on paper-based analytical devices. Lab Chip. 2020;20(8):1441–8. pmid:32211667
  31. 31. Larason T, Ohno Y. Calibration and characterization of UV sensors for water disinfection. Metrologia. 2006 Apr;43(2):S151–6.
  32. 32. Abdel-Fattah AA, El-Kelany M, Abdel-Rehim F. Development of a radiation-sensitive indicator. Radiat Phys Chem. 1996 Oct 1;48(4):497–503.
  33. 33. El Seoud OA, Baader WJ, Bastos EL. Practical Chemical Kinetics in Solution. In: Wang Z, editor. Encyclopedia of Physical Organic Chemistry, 5 Volume Set [Internet]. Hoboken, NJ, USA: John Wiley & Sons, Inc.; 2016 [cited 2020 May 29]. p. 1–68. Available from: http://doi.wiley.com/10.1002/9781118468586.epoc1012
  34. 34. Schmid J, Hoenes K, Rath M, Vatter P, Hessling M. UV-C inactivation of Legionella rubrilucens. GMS Hyg Infect Control. 2017 Apr 10;12:1–6. pmid:28451517
  35. 35. Larason TC, Cromer CL. Sources of error in UV radiation measurements. J Res Natl Inst Stand Technol. 2001 Jul;106(4):649. pmid:27500041
  36. 36. Nixon M, Outlaw F, MacDonald LW, Leung TS. The importance of a device specific calibration for smartphone colorimetry. Color Imaging Conf. 2019 Oct 21;2019(1):49–54.
  37. 37. Martinez AW, Phillips ST, Carrilho E, Thomas SW, Sindi H, Whitesides GM. Simple Telemedicine for Developing Regions: Camera Phones and Paper-Based Microfluidic Devices for Real-Time, Off-Site Diagnosis. Anal Chem. 2008 May;80(10):3699–707. pmid:18407617
  38. 38. SCHOTT Technical Glass Solutions GmbH. BOROFLOAT® 33 –Optical Properties [Internet]. [cited 2020 Jul 7]. Available from: https://www.schott.com/d/borofloat/bde16ad3-70e5-48a0-b8ac-9146fcd34511/1.0/borofloat33_opt_en_web.pdf
  39. 39. Natura U, Ehrt D, Naumann K, Glas S. Formation of radiation defects in high-purity silicate glasses in dependence on dopants and UV radiation sources. Glas Ber Glass Sci Technol. 2001;74:23–31.
  40. 40. Furler RA. Angular Dependence of Optical Properties of Homogeneous Glasses. ASHRAE Trans. 1991;98:1–9.
  41. 41. Lytle CD, Sagripanti J-L. Predicted Inactivation of Viruses of Relevance to Biodefense by Solar Radiation. J Virol. 2005 Nov 15;79(22):14244–52. pmid:16254359
  42. 42. NIST/SEMATECH. 2.3.6.7.1. Uncertainty for quadratic calibration using propagation of error [Internet]. NIST/SEMATECH e-Handbook of Statistical Methods. 2020. Available from: https://www.itl.nist.gov/div898/handbook/mpc/section3/mpc3671.htm DOI: https://doi.org/10.18434/M32189.
  43. 43. NIST/SEMATECH. 4.5.2.1. Single-Use Calibration Intervals [Internet]. NIST/SEMATECH e-Handbook of Statistical Methods. 2020. Available from: https://www.itl.nist.gov/div898/handbook/pmd/section5/pmd521.htm#:~:text=Although%20calibration%20confidence%20intervals%20have,for%20the%20true%20average%20response. DOI: https://doi.org/10.18434/M32189.
  44. 44. Biguri A. Perceptually uniform colormaps [Internet]. MATLAB Central File Exchange. 2020 [cited 2020 Jun 13]. Available from: https://www.mathworks.com/matlabcentral/fileexchange/51986-perceptually-uniform-colormaps
  45. 45. Rehfuess E, World Health Organization. Global solar UV index: a practical guide. Geneva, Switzerland: World Health Organization; 2002. https://doi.org/10.1128/mcb.22.16.5669-5678.2002 pmid:12138179