Skip to main content
Log in

Multimodal Event Detection in Twitter Hashtag Networks

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Event detection in a multimodal Twitter dataset is considered. We treat the hashtags in the dataset as instances with two modes: text and geolocation features. The text feature consists of a bag-of-words representation. The geolocation feature consists of geotags (i.e., geographical coordinates) of the tweets. Fusing the multimodal data we aim to detect, in terms of topic and geolocation, the interesting events and the associated hashtags. To this end, a generative latent variable model is assumed, and a generalized expectation-maximization (EM) algorithm is derived to learn the model parameters. The proposed method is computationally efficient, and lends itself to big datasets. Experimental results on a Twitter dataset from August 2014 show the efficacy of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10

Similar content being viewed by others

Notes

  1. The issue of unknown number of events can be handled using the silhouette values.

References

  1. Farzindar, A., & Khreich, W. (2015). A survey of techniques for event detection in Twitter. Computational Intelligence, 31(1), 132–164.

    Article  MathSciNet  Google Scholar 

  2. Liu, K.L., Li, W., & Guo, M. (2012). Emoticon smoothed language models for Twitter sentiment analysis. In AAAI Conference on artificial intelligence.

  3. Amer-Yahia, S., Anjum, S., Ghenai, A., Siddique, A., Abbar, S., Madden, S., Marcus, A., & El-Haddad, M. (2012). MAQSA: A system for social analytics on news. In ACM SIGMOD international conference on management of data.

  4. Zhao, Z., Resnick, P., & Mei, Q. (2015). Enquiring minds: early detection of rumors in social media from enquiry posts. In International world wide web conference.

  5. Oselio, B., Kulesza, A., & Hero, A. (2015). Information extraction from large multi-layer social networks. In IEEE International conference on acoustics, speech, and signal processing.

  6. Tumasjan, A., Sprenger, T.O., Sandner, P.G., & Welpe, I.M. (2012). Predicting elections with Twitter: What 140 characters reveal about political sentiment. In International conference on weblogs and social media.

  7. Wang, X., Gerber, M.S., & Brown, D.E. (2012). Automatic crime prediction using events extracted from Twitter posts. In International conference on social computing, behavioral-cultural modeling and prediction.

  8. Yang, Y., Pierce, T., & Carbonell, J. (1998). A Study of retrospective and on-line event detection. In ACM SIGIR conference on research and development in information retrieval.

  9. Phuvipadawat, S., & Murata, T. (2010). Breaking news detection and tracking in Twitter. In IEEE/WIC/ACM International conference on web intelligence and intelligent agent technology.

  10. Popescu, A.M., Pennacchiotti, M., & Paranjpe, D. (2011). Extracting events and event descriptions from Twitter. In: International conference companion on world wide web.

  11. Benson, E., Haghighi, A., & Barzilay, R. (2011). Event discovery in social media feeds. In Annual meeting of the association for computational linguistics: human language technologies.

  12. Sakaki, T., Okazaki, M., & Matsuo, Y. (2010). Earthquake shakes Twitter users: real-time event detection by social sensors. In International conference on world wide web.

  13. Petrovic, S., Osborne, M., & Lavrenko, V. (2010). Streaming first story detection with application to Twitter. In Human language technologies: annual conference of the north american chapter of the association for computational linguistics.

  14. Becker, H., Naaman, M., & Gravano, L. (2011). Beyond trending topics: real-world event identification on Twitter. In: International conference on weblogs and social media.

  15. Long, R., Wang, H., Chen, Y., Jin, O., & Yu, Y. (2011). Towards effective event detection, tracking and summarization on microblog data. In Wang, H., Li, S., Oyama, S., Hu, X., & Qian, T. (Eds.) Web-age information management, vol. 6897 of lecture notes in computer science (pp. 652–663). Berlin/Heidelberg: Springer.

  16. Weng, J., & Lee, B.-S. (2011). Event detection in Twitter. In International conference on weblogs and social media.

  17. Cordeiro, M. (2012). Twitter event detection: combining wavelet analysis and topic inference summarization. In Doctoral symposium on informatics engineering.

  18. Yılmaz, Y., & Hero, A. (2015). Multimodal factor analysis. IEEE international workshop on machine learning for signal processing.

  19. Khan, M.E., Bouchard, G., Marlin, B.M., & Murphy, K.P. (2010). Variational bounds for mixed-data factor analysis. In Neural information processing systems (NIPS) conference.

  20. Adali, T., Levin-Schwartz, Y., & Calhoun, V.D. (2015). Multimodal data fusion using source separation: two effectivemodels based on ICA and IVA and their properties. Proceedings of the IEEE, 103(9), 1478–1493.

    Article  Google Scholar 

  21. Bramon, R., Boada, I., Bardera, A., Rodriguez, J., Feixas, M., Puig, J., & Sbert, M. (2012). Multimodal data fusion based on mutual information. IEEE Transactions on Visualization and Computer Graphics, 18(9), 1574–1587.

    Article  Google Scholar 

  22. Wu, Y., Chang, K.C.-C., Chang, E.Y., & Smith, J.R. (2004). Optimal multimodal fusion for multimedia data analysis. In ACM international conference on multimedia.

  23. Sui, J., Adali, T., Yu, Q., Chen, J., & Calhoun, V.D. (2012). A review of multivariate methods for multimodal fusion of brain imaging data. Journal of Neuroscience Methods, 204(1), 68–81.

    Article  Google Scholar 

  24. Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., & Ng, A.Y. (2011). Multimodal deep learning. In International conference on machine learning.

  25. Christoudias, C.M., Urtasun, R., & Darrell, T. (2008). Multi-view learning in the presence of view disagreement. In Conference on uncertainty in artificial intelligence.

  26. He, J., & Lawrence, R. (2011). A graph-based framework for multi-task multi-view learning. In International conference on machine learning.

  27. Sun, S. (2013). A survey of multi-view machine learning. Neural Computing and Applications, 23(7), 2031–2038.

    Article  Google Scholar 

  28. Mardia, K.V., & Jupp, P.E. (2000). Directional statistics. Chichester: Wiley.

    MATH  Google Scholar 

  29. Mardia, K.V., & El-Atoum, S.A.M. (1976). Bayesian inference for the Von Mises-Fisher distribution. Biometrika, 63(1), 203– 206.

    Article  MathSciNet  MATH  Google Scholar 

  30. Harman, H.H. (1976). Modern factor analysis. University of Chicago Press.

  31. Abramowitz, M., & Stegun, I.A. (1972). Handbook of Mathematical Functions. National Bureau of Standards Applied Mathematics Series, 55.

  32. Banerjee, A., Dhillon, I.J., Ghosh, J., & Sra, S. (2005). Clustering on the unit hypersphere using von Mises-Fisher distributions. Journal of Machine Learning Research, 6, 1345–1382.

    MathSciNet  MATH  Google Scholar 

  33. Böhning, D. (1992). Multinomial logistic regression algorithm. Annals of the Institute of Statistical Mathematics, 44(1), 197–200.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

This work was funded in part by the Consortium for Verification Technology under Department of Energy National Nuclear Security Administration award number DE-NA0002534, and the Army Research Office (ARO) under grants W911NF-11-1-0391 and W911NF-12-1-0443.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yasin Yılmaz.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yılmaz, Y., Hero, A.O. Multimodal Event Detection in Twitter Hashtag Networks. J Sign Process Syst 90, 185–200 (2018). https://doi.org/10.1007/s11265-016-1151-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-016-1151-4

Keywords

Navigation