Skip to main content
SpringerLink
Log in

Phrase-level sentence patterns for estimating positive and negative emotions using Neuro-fuzzy model for information retrieval applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The paper proposes phrase-level emotion patterns using Neuro-Fuzzy model. At the initial stage, the emotional patterns at phrase level are obtained using POS Tags and EMOT Actifiers that results into 16 patterns. These patterns works well with the sentences having single emotion and classifies them into Positive and Negative polarities. However, it is observed that these patterns are unable to define the exact boundary between positive and negative polarities of these sentence patterns. Thus, this issue will affect the classification accuracy due to imprecise boundary between the sentences. Mixed emotions exist in long sentences with multi phrases and therefore the sentences are broken at Phrase-level. The patterns are extracted at phrase-level and converted as fuzzy rules for the classification of mixed emotion patterns. Intensity grades are calculated for the patterns based on the features of phrases and their structure in the sentence. These intensity grades classify the patterns at phrase level into Positive and Negative emotions. Based on the intensity grades, a suitable weighing mechanism is proposed for the multi phrasal sentence structure which decides the degree of Positive and Negative polarities of emotion in a sentence. Higher weighted phrasal pattern decides the Positive and Negative polarities of emotion in a sentence. Proposed approach performs well and achieves good F-Scores compared with other comparative approaches on benchmark datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Agichtein E, Gravano L (2000) Snowball: Extracting relations from large plain-text collections. 5th ACM International Conference on Digital Libraries (ACM DL):85–94

  2. Asghar MZ, Khan A, Ahmad S, Qasim M, Khan IA (2017) Lexicon-enhanced sentiment analysis framework using rule-based classification scheme. PLoS ONE 12(2):e0171649. https://doi.org/10.1371/journal.pone.0171649

    Article  Google Scholar 

  3. Abid F, Alam M, Yasir M, Li C (2019) Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Future Gener. Comput. Syst. 95:292–308

    Google Scholar 

  4. Balahur A, Hermida JM, Montoyo A (2012) Building and exploiting EmotiNet, a knowledge base for emotion detection based on the appraisal theory model. IEEE Trans. Affect. Comput. 3(1):88–101

    Google Scholar 

  5. Balahur A, Hermida JM, Montoyo A, Munoz R (2013) Detecting implicit expressions of affect in text using EmotiNet and its extensions. Data & Knowledge Engineering, Elsevier Science 88:113–125

    Google Scholar 

  6. Breiman L, Friedman J, Olshen RA, Charles JS (1985) Classification and regression trees. Wadsworth and Brooks, Monterey

    MATH  Google Scholar 

  7. Brin S (1998) Extracting patterns and relations from the World Wide Web. In: 1998 International Workshop on Web and Databases(Web DB 1998), 172–183.

  8. Berland M, Charniak E (1999) Finding parts in very large corpora. In: 37th annual meeting of the Association for computational Linguistics on Computational Linguistics (ACL’99). In: 57–64

    Google Scholar 

  9. Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J. Mach. Learn. Res. 3:993–1022

    MATH  Google Scholar 

  10. Bao S, Xu S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: The 9th IEEE International Conference on Data Mining. In: 699–704

    Google Scholar 

  11. Barnaghi P, Breslin J, Ghaffari P (2016) Opinion Mining and Sentiment Polarity on Twitter and Correlation Between Events and Sentiment. In: The IEEE 2nd International Conference on Big Data Computing Service and Applications. In: 52–57

    Google Scholar 

  12. Bandhakavi N, Padmanabhan WD, Massie S (2017) Lexicon based feature extraction for emotion text classification. Pattern Recognit. Lett. 93:133–142

    Google Scholar 

  13. Basiri ME, Abdar M, Kabiri A, Nemati S, Zhou X, Allahbakhshi F, Yen NY (2020). Improving sentiment polarity detection through target identification. IEEE Transactions on Computational Social Systems,7(1): 113–128. doi: https://doi.org/10.1109/TCSS.2019.2951326.

  14. Chaumartin FR (2007) UPAR7: a knowledge-based system for headline sentiment tagging. In: The 4th International Workshop on Semantic Evaluations, ACL. In: 422–425

    Google Scholar 

  15. Cambria E, Hussain E, Havasi C, Eckl C (2009) AffectiveSpace: blending common sense and affective knowledge to perform emotive reasoning. In: The 1st Workshop on Opinion Mining and Sentiment Analysis (WOMSA). Seville, Spain, pp 32–41

    Google Scholar 

  16. Ceron A, Curini L, Iacus SM (2016) iSA: a fast, scalable and accurate algorithm for sentiment analysis of social media content. Inf. Sci. 367–368:105–124

    Google Scholar 

  17. Chen T, Xu R, He Y, Wang X (2017) Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN. Expert Syst. Appl. 72:221–230

    Google Scholar 

  18. Chen C, Zhuo R, Ren J (2019) Gated recurrent neural network with sentimental relations for sentiment classification. Inf. Sci. 502:268–278

    Google Scholar 

  19. Desmet B, Hoste V (2013) Emotion detection in suicide notes. Expert Syst. Appl. 40:6351–6358

    Google Scholar 

  20. Dyer M (1987) Emotions and their computations: three computer models. Cogn. Emot. 1:323–347

    Google Scholar 

  21. Danisman T, Alpkocak A (2008) Feeler: Emotion classification of text using vector space model. In: The AISB 2008 Symposium on Affective Language in Human and Machine, University of Aberdeen, UK, pp 53–59

  22. Das D, Bandyopadhyay S (2009) word to sentence level emotion tagging for Bengali Blogs. ACL-IJCNL:149–152

  23. Das D, Bandyopadhyay S (2010) Sentence level emotion tagging on blog and news corpora. J. Intelligent System. 19(2):125–134

    Google Scholar 

  24. Ekman P (1992) An Argument for basic emotions. Cogn. Emot. 6:169–200

    Google Scholar 

  25. Esuli A, Sebastiani F (2005). Determining the semantic polarities of terms through gloss analysis. In: 14th ACM international conference on Information and knowledge management (CIKM), 617–624. https://doi.org/10.1145/1099554.1099713

  26. Ekbal A, Bandyopadhyay S (2008) Web-based Bengali news Corpus for Lexicon development and POS tagging. POLIBITS 37:20–29

    Google Scholar 

  27. Fellbaum C (1995) Co-occurrence and antonymy. Int. J. Lexicogr. 8:281–303

    Google Scholar 

  28. Grassi M (2009) Developing HEO human emotions ontology. Lecture Notes in Computer Science 5707

  29. Galitsky BA, de la Rosa JL, Dobrocsi G (2012) Inferring the semantic properties of sentences by mining syntactic parse trees. Data Knowl. Eng.:21–45 http://www.sciencedirect.com/science/article/pii/S0169023X12000699

  30. He X, Chu WC, Yang H, Yang SJH (1999) A new approach to verify rule-based systems using petri nets. In: IEEE proceeding of 23th Annual International Computer Software and Applications Conference (COMPSAC), vol 99, pp 462–467

    Google Scholar 

  31. Hai Z, Cong G, Chang K, Cheng P, Miao C (2017) Analyzing sentiments in one go: A supervised joint topic modeling approach. IEEE Trans. Knowl. Data Eng. 29(6):1172–1185

    Google Scholar 

  32. Huq MR, Ali A, Rahman A (2017) Sentiment analysis on Twitter data using KNN and SVM. Int. J. Adv. Comput. Sci. Appl. 8(6):19–25

    Google Scholar 

  33. Haq MU, Shahzad A, Mahmood Z, ShahA A (2019) Boosting the face recognition performance of ensemble based LDA for pose, non-uniform illuminations, and low-resolution images KSII Transactions on internet and information systems. 13(6):3144–3166

  34. James W (1884) What is an emotion? Mind 9(34):188–205 http://www.jstor.org/stable/2246769

    Google Scholar 

  35. Jang JSR (1993) ANFIS: adaptive-network-based fuzzy inference system. In: IEEE Trans Syst. Man Cybernet. 23(5/6):665–685

    Google Scholar 

  36. Jurek MD, Mulvenna, Bi Y (2015). Improved lexicon-based sentiment analysis for social media analytics. Secur. Informat. 4(1): 9.

  37. Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for Twitter sentiment analysis. IEEE Access 6:23253–23260

    Google Scholar 

  38. Ji P, Zhang H-Y, Wang J-Q (2019) A fuzzy decision support model with sentiment analysis for items comparison in E-commerce: The case study of PConline.Com. IEEE Trans. Syst. Man Cybern. Syst. 49(10):1993–2004

    Google Scholar 

  39. Katz P, Singleton M, Wicentowski R (2007). Swat-MP: the semeval-2007 systems for task 5 and task 14. In: The 4th International Workshop on Semantic Evaluations, ACL, 308–313.

  40. Kolya A, Das D, Ekbal A, Bandyopadhyay S (2011) Identifying event-sentiment association using lexical equivalence and co-reference approaches. Workshop on Relational Models of Semantics Collocated with ACL, In, pp 19–27

    Google Scholar 

  41. Keshavarz H, Abadeh MS (2017) ALGA: Adaptive lexicon learning using genetic algorithm for sentiment analysis of microblogs. Knowl.-Based Syst. 122:1–16

    Google Scholar 

  42. Liu H, Lieberman H, Selker T (2003). A Model of Textual Affect Sensing using Real-World Knowledge. In: The 8th international conference on intelligent user interfaces, ACM, 125–132

  43. Lin KH-Y, Yang C, Chen H-H (2007). What emotions do news articles trigger in their readers? In: The 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 733–734.

  44. Long W, Tang Y-R, Tian Y-J (2018) Investor sentiment identification based on the universum SVM. Neural Comput. Appl. 30(2):661–670

    Google Scholar 

  45. Liang H, Ganeshbabu U, Thorne T (2020) A dynamic bayesian network approach for analysing topic-sentiment evolution. IEEE Access 8:54164–54174. https://doi.org/10.1109/ACCESS.2020.2979012

    Article  Google Scholar 

  46. Li W, Xu H (2014) Text-based emotion classification using emotion cause extraction. Expert Syst. Appl. Elsevier science. 41:1742–1749

    Google Scholar 

  47. Martin JR, White PR (2005) Language of evaluation: appraisal in English. Palgrave, Macmillan

    Google Scholar 

  48. Malandrakis N, Potamianos A, Iosif E, Narayanan S (2013) Distributional semantic models for affective text analysis. IEEE TransAudio, Speech, Language Process. 21(11):2379–2390

    Google Scholar 

  49. Neviarouskaya A, Prendinger H, Ishizuka M (2007) Narrowing the Social Gap among People Involved in Global Dialog: Automatic emotion Detection in Blog Posts. In: In: International Conference on Weblogs and Social Media (ICWSM’07), pp 293–294

    Google Scholar 

  50. Picard R (1995). Affective computing. M.I.T media laboratory perceptual computing section technical report No. 321.

  51. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up?: sentiment classification using machine learning techniques. In: The Conference on Empirical Methods in Natural Language Processing. PA, Philadelphia, pp 79–86

    Google Scholar 

  52. Pantel P, Ravichandran D (2004). Automatically labeling semantic classes. In: The human language technology conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL-04), Boston, Massachusetts, USA 321–328

  53. Pong-inwong C, Songpan W (2019) Sentiment analysis in teaching evaluations using sentiment phrase pattern matching (SPPM) based on association mining. Int. J. Mach. Learn. & Cyber. 10:2177–2186. https://doi.org/10.1007/s13042-018-0800-2

    Article  Google Scholar 

  54. Phan HT, Nguyen NT, Tran VC, Hwang D (2019) A sentiment analysis method of objects by integrating sentiments from tweets. IFS 37(6):7251–7263

    Google Scholar 

  55. Phan HT, Tran VC, Nguyen NT, Hwang D (2020) Improving the Performance of Sentiment Analysis of Tweets Containing Fuzzy Sentiment Using the Feature Ensemble Model. IEEE Access 8:14630–14641

    Google Scholar 

  56. Rivera JD (1977) A structural theory of the emotions. Psychological Issues, Monograph. 4(40)

  57. Retna Raj RJ, Das P, Sahu P (2020) Emotion classification on twitter data using word embedding and lexicon based approach. In: In: IEEE 9th International Conference on Communication Systems and Network Technologies (CSNT’2020), pp 150–154

    Google Scholar 

  58. Riloff E, Wiebe J (2003). Learning extraction patterns for subjective expressions. In: The 2003 Conference on Empirical Methods in Natural Language Processing (EMNLP), 105–112

  59. Read J (2004) Recognizing affect in text using point wise mutual information. University of Sussex, Master’s thesis

    Google Scholar 

  60. Rosen-Zvi M, Griffiths T, Steyvers M, Smyth P (2004) The author-topic model for authors and documents. In: The. In: 20th Conference in Uncertainty in Artificial Intelligence, pp 487–494

    Google Scholar 

  61. Scherer KR (1994) Studying the emotion-antecedent appraisal process: An expert system approach. Cognition and emotion 7(3–4):325–355. https://doi.org/10.1080/02699939308409192

    Article  Google Scholar 

  62. Subasic P, Huettner A (2000) Affect analysis of text using fuzzy semantic typing. IEEE Trans. Fuzzy Syst. 9:483–496

    Google Scholar 

  63. Strapparava C, Valitutti A (2004) Word net-affect: an affective extension of word net. In: In: The 4th International Conference on Language Resources and Evaluation (LREC-2004), pp 1083–1086

    Google Scholar 

  64. Suchanek FM, Kasneci G, Weikum G (2007) YAGO: A core of semantic knowledge unifying Word Net and Wikipedia. The World Wide Web Conference, In, pp 697–706

    Google Scholar 

  65. Strapparava C, Mihalcea R (2007). Semeval-2007 task 14: affective text. In: The 4th International Workshop on Semantic Evaluations, (ACL’ 07), 70–74.

  66. Saad SE, Yang J (2019) Twitter sentiment analysis based on ordinal regression. IEEE Access 7:163677–163685. https://doi.org/10.1109/ACCESS.2019.2952127

    Article  Google Scholar 

  67. Sanagar S, Gupta D (2020) Unsupervised genre-based multidomain sentiment lexicon learning using corpus-generated polarity seed words. IEEE Access 8:118050–118071

    Google Scholar 

  68. Swaminathan A, Vadivel A, Arock M (2020) ferce: facial expression recognition for combined emotions using ferce algorithm. IETE Journal of Research. https://doi.org/10.1080/03772063.2020.1756471

  69. Turney PD (2002). Thumbs up or thumbs down? semantic polarities applied to unsupervised Classification of reviews. In: 40th Annual Meeting of the Association for Computational Linguistics (ACL), 417–424.

  70. Vincent B, Xu L, Chesley P, Srhari RK (2006). Using Verbs and Adjectives to automatically classify blog sentiment. In: Symposium on Computational Approaches to Analyzing Weblogs (AAAI-CAAW), 27–29.

  71. Wang W, Chen L, Thirunarayan K, Sheth AP (2012) Harnessing Twitter ‘Big Data’ for Automatic emotion Identification. In: In: ASE/IEEE International Conference on Social Computing and 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust, pp 587–592. https://doi.org/10.1109/SocialCom-PASSAT.2012.119

    Chapter  Google Scholar 

  72. Wu F, Song Y, Huang Y (2016) Microblog sentiment classification with heterogeneous sentiment knowledge. Inf. Sci. 373:149–164

    Google Scholar 

  73. Wikarsa L, Thahir SN (2015). A text mining application of emotion classifications of Twitters Users using Nave Bayes Method. In: 1st international Conference on Wireless and Telematics (ICWT), 1–6

  74. Xia R, Xu F, Yu J, Qi Y, Cambria E (2016) Polarity shift detection elimination and ensemble: A three-stage model for document-level sentiment analysis. Inform Process Manag, Elsevier. 52(1):36–45

    Google Scholar 

  75. Yu L, Yang Z, Nie P, Zhao X, Zhang Y (2015) Multi-source emotion tagging for online news. In: 12th Web Information System and Application Conference (WISA), Jinan, 49–52. https://doi.org/10.1109/WISA.2015.24

  76. Zhang Y, Li Z, Ren F, Kuroiwa S (2008) A preliminary research of Chinese emotion classification model. International Journal of Computer Science and Network Security (IJCSNS) 8(11):127–132

    Google Scholar 

  77. Zeng D, Dai Y, Li F, Wang J, Sangaiah AK (2019) Aspect based sentiment analysis by a linguistically regularized CNN with gated mechanism. J. Intell. Fuzzy Syst. 36(5):3971–3980

    Google Scholar 

  78. Zhou F, Kong S, Fowlkes CC, ChenT LB (2020) Fine-grained facial expression analysis using dimensional Emotion Model. Neurocomputing 392(7):38–49

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Dayananda Sagar University, Bangalore, India

    M. S. M. Prasanna & S. G. Shaila

  2. Department of Computer Science and Engineering, IcfaiTech, ICFAI Foundation for Higher Education, Hyderabad, Telangana, India

    A. Vadivel

Authors
  1. M. S. M. Prasanna
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. G. Shaila
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Vadivel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Vadivel.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Prasanna, M.S.M., Shaila, S.G. & Vadivel, A. Phrase-level sentence patterns for estimating positive and negative emotions using Neuro-fuzzy model for information retrieval applications. Multimed Tools Appl 80, 20151–20190 (2021). https://doi.org/10.1007/s11042-020-10422-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10422-6

Keywords

Search

Navigation