Anish Susarla
ABSTRACT
Time series prediction models have played a vital role in guiding effective policymaking and response during the COVID-19 pandemic by predicting future cases and deaths at the country, state, and county levels. However, for emerging diseases, there is not sufficient historic data to fit traditional supervised prediction models. In addition, such models do not consider human mobility between regions. To mitigate the need for supervised models and to include human mobility data in the prediction, we propose Spatial Probabilistic Contrastive Predictive Coding (SP-CPC) which leverages Contrastive Predictive Coding (CPC), an unsupervised time-series representation learning approach. We augment CPC to incorporate a covariate mobility matrix into the loss function, representing the relative number of individuals traveling between each county on a given day. The proposal distribution learned by the algorithm is then sampled by the Metropolis-Hastings algorithm to give a final prediction of the number of COVID-19 cases. We find that the model applied to COVID-19 data can make accurate short-term predictions, more accurate than ARIMA and simple time-series extrapolation methods, one day into the future. However, for longer-term prediction windows of seven or more days into the future, we find that our predictions are not as competitive and require future research.
- V. Araujo. Vgaraujov/cpc-nlp-pytorch: Implementation of contrastive predictive coding for natural language https://github.com/vgaraujov/CPC-NLP-PyTorch.Google Scholar
- F. Brauer. Compartmental models in epidemiology. In Mathematical epidemiology, pages 19--79. Springer, 2008.Google ScholarCross Ref
- CDC. Coronavirus Disease 2019 (COVID-19), Feb. 2020.Google Scholar
- S. Deldari, D. V. Smith, H. Xue, and F. D. Salim. Time series change point detection with self-supervised contrastive predictive coding. In Proceedings of the Web Conference 2021, pages 3124--3135, 2021.Google ScholarDigital Library
- J. Elarde, J.-S. Kim, H. Kavak, A. Züfle, and T. Anderson. Change of human mobility during covid-19: A united states case study. PLOS ONE, 16(11), 2021.Google Scholar
- M. Gutmann and A. Hyvärinen. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Artificial Intelligence and Statistics, pages 297--304, Mar. 2010.Google Scholar
- K. Healy. County and state fips codes https://github.com/kjhealy/fips-codes.Google Scholar
- O. J. Hénaff, A. Srinivas, J. D. Fauw, A. Razavi, C. Doersch, S. M. A. Eslami, and A. van den Oord. Data-efficient image recognition with contrastive predictive coding. CoRR, abs/1905.09272, 2019.Google Scholar
- R. J. Hyndman, A. V. Kostenko, et al. Minimum sample size requirements for seasonal forecasting models. foresight, 6(Spring):12--15, 2007.Google Scholar
- Y. Kang, S. Gao, Y. Liang, M. Li, J. Rao, and J. Kruse. Multiscale dynamic human mobility flow dataset in the us during the covid-19 epidemic. Scientific data, 7(1):1--13, 2020.Google ScholarCross Ref
- F. Kato, Y. Cao, and M. Yoshikawa. Pct-tee: Trajectory-based private contact tracing system with trusted execution environment. ACM Transactions on Spatial Algorithms and Systems (TSAS), 8(2):1--35, 2021.Google Scholar
- R. Ke, E. Romero-Severson, S. Sanche, and N. Hengartner. Estimating the reproductive number R0 of SARS-CoV-2 in the United States and eight European countries and implications for vaccination. Journal of Theoretical Biology, 517:110621, 2021.Google ScholarCross Ref
- W. O. Kermack and A. G. McKendrick. A contribution to the mathematical theory of epidemics. Proceedings of the royal society of london. Series A, Containing papers of a mathematical and physical character, 115(772):700--721, 1927.Google ScholarCross Ref
- C. C. Kerr, R. M. Stuart, D. Mistry, R. G. Abeysuriya, et al. Covasim: an agent-based model of covid-19 dynamics and interventions. PLOS Computational Biology, 17(7):e1009149, 2021.Google ScholarCross Ref
- B. Millidge, A. Seth, and C. L. Buckley. Predictive Coding: A Theoretical and Experimental Review, July 2022.Google Scholar
- M. Mokbel, M. Sakr, L. Xiong, A. Züfle, et al. Dagstuhl reports, vol. 12, issue 1 issn 2192-5283. 2022.Google Scholar
- C. J. Murray and P. Piot. The potential future of the covid-19 pandemic: will sars-cov-2 become a recurrent seasonal infection? Jama, 325(13):1249--1250, 2021.Google ScholarCross Ref
- B. Nikparvar, M. Rahman, F. Hatami, J.-C. Thill, et al. Spatio-temporal prediction of the covid-19 pandemic in us counties: modeling with a deep lstm neural network. Scientific reports, 11(1):1--12, 2021.Google ScholarCross Ref
- Nytimes. Nytimes/covid-19-data: An ongoing repository of data on coronavirus cases and deaths in the u.s.Google Scholar
- A. v. d. Oord, Y. Li, and O. Vinyals. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018.Google Scholar
- J. Pesavento, A. Chen, R. Yu, J.-S. Kim, H. Kavak, T. Anderson, and A. Züfle. Data-driven mobility models for covid-19 simulation. In ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities, pages 29--38, 2020.Google ScholarDigital Library
- S. Rambhatla, S. Zeighami, K. Shahabi, C. Shahabi, and Y. Liu. Toward accurate spatiotemporal covid-19 risk scores using high-resolution real-world mobility data. ACM TSAS, 8(2):1--30, 2022.Google ScholarDigital Library
- M. Rivière, A. Joulin, P.-E. Mazaré, and E. Dupoux. Unsupervised pretraining transfers well across languages, 2020.Google ScholarCross Ref
- C. P. Robert and G. Casella. The metropolis---hastings algorithm. In Monte Carlo statistical methods, pages 231--283. Springer, 1999.Google ScholarCross Ref
- R. K. Singh, M. Rani, A. S. Bhagavathula, et al. Prediction of the covid-19 pandemic for the top 15 affected countries: Advanced autoregressive integrated moving average (arima) model. JMIR Public Health Surveill, 6(2):e19115, May 2020.Google ScholarCross Ref
- J. Tolles and T. Luong. Modeling epidemics with compartmental models. Jama, 323(24):2515--2516, 2020.Google ScholarCross Ref
- F.-M. Tseng and G.-H. Tzeng. A fuzzy seasonal arima model for forecasting. Fuzzy Sets and Systems, 126(3):367--376, 2002.Google ScholarDigital Library
Recommendations
Spatiotemporal prediction of foot traffic
LocalRec '21: Proceedings of the 5th ACM SIGSPATIAL International Workshop on Location-based Recommendations, Geosocial Networks and GeoadvertisingFoot traffic is a business term to describe the number of customers that enter a point of interest (POI). This work aims to predict future foot traffic: the number of people from each census block group (CBG) that will visit each POI of a study region ...
Spatiotemporal prediction of carbon emissions using a hybrid deep learning model considering temporal and spatial correlations
AbstractAccurate prediction of carbon emissions plays a crucial role in enabling government decision-makers to formulate appropriate policies and plan necessary response measures in a timely manner. This study explored the spatiotemporal prediction ...
Highlights- We propose a deep learning-based hybrid prediction model for carbon emissions.
- The model considers temporal and spatial correlations.
- The model enables one- and multi-step spatiotemporal prediction of carbon emissions.
- The ...
Action-dependent bidirectional contrastive predictive coding for neural belief representations
Highlights- Contrastive learning improves the data utilization of belief representations in POMDPs.
AbstractThe key to solving the complex, partially observable Markov decision process (POMDP) with high-dimensional observations lies in explicit belief representations. However, the existing methods generally adopted the black-box model for ...
Comments