Elsevier

Astroparticle Physics

Volume 104, January 2019, Pages 42-53
Astroparticle Physics

Particle identification in camera image sensors using computer vision

https://doi.org/10.1016/j.astropartphys.2018.08.009Get rights and content

Abstract

We present a deep learning, computer vision algorithm constructed for the purposes of identifying and classifying charged particles in camera image sensors. We apply our algorithm to data collected by the Distributed Electronic Cosmic-ray Observatory (DECO), a global network of smartphones that monitors camera image sensors for the signatures of cosmic rays and other energetic particles, such as those produced by radioactive decays. The algorithm, whose core component is a convolutional neural network, achieves classification performance comparable to human quality across four distinct DECO event topologies. We apply our model to the entire DECO data set and determine a selection that achieves  ≥ 90% purity for all event types. In particular, we estimate a purity of 95% when applied to cosmic-ray muons. The automated classification is run on the public DECO data set in real time in order to provide classified particle interaction images to users of the app and other interested members of the public.

Introduction

The ubiquity of smartphone devices worldwide has sparked an explosion in the field of distributed sensors; their widespread adoption has effectively instrumented global population centers with a variety of detectors. The CMOS image sensors in modern smartphones are based on similar semiconductor technology to that found in professional telescopes and particle physics detectors, enabling them to detect cosmic rays and other ionizing charged particles. These particles have long been a background nuisance for CCDs used in astronomical cameras [1], however several recent projects including the Distributed Electronic Cosmic-ray Observatory [2] seek to use this background as signal for both scientific and educational purposes. It may be possible for such networks of smartphones to detect extensive air showers created by ultra-high energy cosmic rays (UHECR) above 1020 eV, if challenging user density targets are met [3]. This is a powerful and cost-effective way to extend UHECR measurements to higher energies, but there are substantial hurdles to achieving this goal [4]. Since it is also possible to detect local radioactivity with camera sensors [5], networks of smartphones could be used as radiation monitors. More exotic analyses have also been proposed, such as searching for correlated extensive air showers created when an ultra-high-energy photon interacts with the heliosphere [6]. One major hurdle limiting these scientific pursuits is accurate and efficient particle identification, which is necessary to reject the radioactive background for cosmic-ray measurements or vice-versa for radiation measurements. In this paper we describe a computer vision algorithm developed to identify the charged particles detected by camera image sensors. We then apply it to the data set produced by the Distributed Electronic Cosmic-ray Observatory (DECO) [2], [7], the first publicly available cosmic-ray smartphone application.

DECO detects cosmic rays by way of an Android application that began beta testing in October 2012 and was released publicly in September 2014. DECO is designed to detect ionizing radiation that traverses silicon image sensors in smartphones. The resulting dataset consists of images recorded by users worldwide (Fig. 1) that contain evidence of charged particle interactions. Due to the diverse ecosystem of Android phones on the market, the systematic variation in data taking conditions, and the variety of particle event morphologies, classification of DECO events presents a unique challenge. Our initial work using straight cuts to classify events in the highly heterogeneous dataset was moderately successful in classifying some event types, but identifying a cosmic-ray muon sample with high purity proved challenging. We present a computer vision algorithm based on a convolutional neural network for classifying DECO events. Additional cosmic-ray cell phones apps mentioned above could also benefit from the approach described here. We presented initial results from our CNN classification in [8]. More recently, during preparation of this paper,  Borisyak et al. [9] appeared and describes a CNN algorithm intended for use as an online cosmic-ray muon trigger.

Section snippets

DECO App

The DECO detection technique uses similar ionization-detecting semiconductor technology to that found in the silicon trackers of professional particle physics experiments [10], [11]. Ionizing charged particles that travel through the sensitive region (i.e. depleted region) of a phone’s image sensor are detected via the electron-hole pairs they create. The DECO app, which can be run on any Android device with Android version  ≥  2.1, is designed to be run with the camera face down or covered in

Background

Deep learning is a subset of machine learning focused on building models that are capable of learning how to describe data at multiple levels of abstraction. This is achieved with a nested hierarchy of simple algorithms that when combined can form highly complex and diverse representations. At each layer of the nested hierarchy, a non-linear transformation of the previous layer’s output is typically performed, which results in the deeper layers of the model seeing a progressively more abstract

Constructing a DECO CNN

In the sections that follow, we describe the construction and optimization of a DECO-specific convolutional neural network. We begin by introducing the dataset and the challenges associated with both human classification error and the small number of training images. We explain how data augmentation was used to make the model approximately invariant to rotations as well as artificially boost the number of training images. We then discuss the problem of overfitting and the techniques used to

Model performance

To estimate the overall performance of the model, independent sets of human-classified images were evaluated using the method of stratified k-fold cross-validation [54]. In this procedure, the set of training images is split into k groups, where each group contains a roughly equal number of images from each of the categories represented in the model. k otherwise identical versions of the model are then trained, each time setting aside one group for testing and k1 for training the model.

Conclusions and future work

We have described the development and validation of a convolutional neural network for the classification of images obtained by users running the DECO application. This new approach to image classification resulted in significant improvements over previous classification of DECO images using straight cuts. Event classification using the straight-cuts approach produced a track sample with 20% purity after applying the rescaling procedure described in Section 5.5. The CNN model, on the other

Acknowledgements

DECO is supported by the American Physical Society, the Knight Foundation, the Simon Strauss Foundation, QuarkNet, and by National Science Foundation Grant #1707945. We are grateful for beta testing, software development, and valuable conversations with Colin Adams, Raaha Azfar, Keith Bechtol, Segev BenZvi, Andy Biewer, Paul Brink, Patricia Burchat, Duncan Carlsmith, Alex Drlica-Wagner, Mike Duvernois, Brett Fisher, Lucy Fortson, Stefan Funk, Mandeep Gill, Laura Gladstone, Giorgio Gratta, Jim

References (55)

  • D. Whiteson et al.

    Searching for ultra-high energy cosmic rays with smartphones

    Astropart. Phys.

    (2016)
  • D. Groom

    Cosmic rays and other nonsense in astronomical CCD imagers

    Exp. Astron.

    (2002)
  • J. Vandenbroucke et al.

    Detecting particles with cell phones: the distributed electronic cosmic-ray observatory

    PoS

    (2016)
  • M. Unger, G. Farrar, Feasability of studying ultra-high-energy cosmic rays with smartphones, 2015....
  • J.J. Cogliati, K.W. Derr, J. Wharton, Using CMOS sensors in a cellphone for gamma detection and classification, 2014....
  • P. Homola

    Search for extensive photon cascades with the cosmic-ray extremely distributed observatory

    Photon 2017: International Conference on the Structure and the Interactions of the Photon and 22th International Workshop on Photon-Photon Collisions and the International Workshop on High Energy Photon Colliders CERN, Geneva, Switzerland, May 22–26, 2017

    (2018)
  • J. Vandenbroucke et al.

    Measurement of cosmic-ray muons with the distributed electronic cosmic-ray observatory, a network of smartphones

    J. Instrum.

    (2016)
  • M. Meehan et al.

    The particle detector in your pocket: the distributed electronic cosmic-ray observatory

    Proceedings, 35th International Cosmic Ray Conference (ICRC 2017): Bexco, Busan, Korea, July 12–20, 2017

    (2017)
  • M. Borisyak et al.

    Muon trigger for mobile phones

    J. Phys. Conf. Ser.

    (2017)
  • M. Ackermann

    The fermi large area telescope on orbit: event classification, instrument response functions, and calibration

    Astrophys. J. Suppl. Ser.

    (2012)
  • The CMS Collaboration

    The CMS experiment at the CERN LHC

    J. Instrum.

    (2008)
  • ...
  • W.E. Lorensen et al.

    Marching cubes: a high resolution 3d surface construction algorithm

    Comput. Graph

    (1987)
  • S. van der Walt et al.

    The Scikit-Image Contributors, scikit-image: image processing in Python

    PeerJ

    (2014)
  • C. Patrignani

    Review of particle physics

    Chin. Phys.

    (2016)
  • Y.D. Khan et al.

    Iris recognition using image moments and k-means algorithm

    Sci. World J.

    (2014)
  • Y. Bengio

    Learning deep architectures for AI

    Found. Trends Mach. Learn.

    (2009)
  • F. Rosenblatt

    Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms

    (1962)
  • R.D. Reed et al.

    Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks

    (1998)
  • I. Goodfellow et al.

    Deep Learning

    (2016)
  • V. Nair et al.

    Rectified linear units improve restricted Boltzmann machines

    Proceedings of the 27th International Conference on International Conference on Machine Learning

    (2010)
  • A.L. Maas et al.

    Rectifier nonlinearities improve neural network acoustic models

    ICML Workshop on Deep Learning for Audio, Speech and Language Processing

    (2013)
  • D.E. Rumelhart et al.

    Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1

    (1986)
  • Y. LeCun et al.

    Efficient backprop

    Neural Networks: Tricks of the Trade, This Book is an Outgrowth of a 1996 NIPS Workshop

    (1998)
  • L. Bottou, F.E. Curtis, J. Nocedal, Optimization methods for large-scale machine 935 learning, 2016....
  • Y. LeCun et al.

    Gradient-based learning applied to document recognition

    Proc. IEEE

    (1998)
  • P.Y. Simard et al.

    Best practices for convolutional neural networks applied to visual document analysis

    Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 2

    (2003)
  • Cited by (0)

    View full text