Abstract
The article studies prediction under some background assumptions and tests the assumptions. We use a conformal predictors framework and obtain predictions as regions. This is done by an on-line compression model that satisfies our assumptions. If the assumptions are appropriate for data, the prediction regions are automatically valid. The validity means that for successive predictions an error rate does not exceed a prefixed significance level (up to statistical fluctuation). It is important to test our assumptions to maintain the validity property; or otherwise the predictions can be misleading. We perform testing by calculating martingales. The martingales here are functions of p-values that are the output of the on-line compression model. Large values of the martingales reflect departures from the assumptions. This article extends our previous work on martingale testing and focusses on the Gauss linear assumption. The article presents experiments for the predictions and testing. We use four synthetic datasets as well as a benchmark Abalone dataset that is assumed to agree with the Gauss linear assumption.
Article PDF
Similar content being viewed by others
References
Fedorova, V., Nouretdinov, I., Gammerman, A., Vovk, V.: Plug-in martingales for testing exchangeability on-line., In: Proceedings of the 29th International Conference on Machine Learning (ICML 2012), Edinburgh, Scotland, UK (2012)
Frank, A., Asuncion, A.: UCI repository, 2010. Accessed 19 May (2012)
Gammerman A., Vovk V.: Hedging predictions in machine learning. The Computer Journal. 50(2), 151–163 (2007)
Gosset,W.S. (Student): The probable error of a mean. Biometrika, 6, 1–25 (1908)
Schervish M.J.: Theory of statistics. Springer, New York (1995)
Snelson, E., Rasmussen, C.E., Ghahramani, Z.: Warped Gaussian processes. In: Advances in Neural Information Processing Systems 16 (NIPS), (2004)
Vapnik V.N.: Statistical learning theory. John Wiley & Sons, Inc., New York (1998)
Ville J.: Etude critique de la notion de collectif. Gauthier-Villars, Paris (1939)
Vovk V., Gammerman A., Shafer G.: Algorithmic learning in a random world. Springer, New York (2005)
Vovk, V., Nouretdinov, I., Gammerman, A.: Testing exchangeability on-line. In: Proceedings of the 20th International Conference on Machine Learning (ICBM 2003), pp. 768–775, Washington, DC, (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fedorova, V., Nouretdinov, I. & Gammerman, A. Testing the Gauss linear assumption for on-line predictions. Prog Artif Intell 1, 205–213 (2012). https://doi.org/10.1007/s13748-012-0022-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13748-012-0022-x