Inference of the kinetic Ising model with heterogeneous missing data

Carlo Campajola, Fabrizio Lillo, and Daniele Tantari
Phys. Rev. E 99, 062138 – Published 28 June 2019

Abstract

We consider the problem of inferring a causality structure from multiple binary time series by using the kinetic Ising model in datasets where a fraction of observations is missing. Inspired by recent work on mean field methods for the inference of the model with hidden spins, we develop a pseudo-expectation-maximization algorithm that is able to work even in conditions of severe data sparsity. The methodology relies on the Martin-Siggia-Rose path integral method with second-order saddle-point solution to make it possible to approximate the log-likelihood in polynomial time, giving as output an estimate of the couplings matrix and of the missing observations. We also propose a recursive version of the algorithm, where at every iteration some missing values are substituted by their maximum-likelihood estimate, showing that the method can be used together with sparsification schemes such as lasso regularization or decimation. We test the performance of the algorithm on synthetic data and find interesting properties regarding the dependency on heterogeneity of the observation frequency of spins and when some of the hypotheses that are necessary to the saddle-point approximation are violated, such as the small couplings limit and the assumption of statistical independence between couplings.

  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
2 More
  • Received 22 March 2019

DOI:https://doi.org/10.1103/PhysRevE.99.062138

©2019 American Physical Society

Physics Subject Headings (PhySH)

Statistical Physics & ThermodynamicsNetworks

Authors & Affiliations

Carlo Campajola1,*, Fabrizio Lillo2, and Daniele Tantari3

  • 1Scuola Normale Superiore di Pisa, piazza dei Cavalieri 7, 56126 Pisa, Italy
  • 2University of Bologna - Department of Mathematics, piazza di Porta San Donato 5, 40126 Bologna, Italy
  • 3University of Florence - Department of Economics and Management, via delle Pandette 9, 50127 Firenze, Italy

  • *carlo.campajola@sns.it

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 99, Iss. 6 — June 2019

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review E

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×