Komparasi Naïve Bayes dan SVM Analisis Sentimen RUU Kesehatan di Twitter

Authors

  • Tetrian Widyanto Magister Ilmu Komputer, Universitas Budi Luhur, Jakarta, Indonesia
  • Ina Ristiana Magister Ilmu Komputer, Universitas Budi Luhur, Jakarta, Indonesia
  • Arief Wibowo Magister Ilmu Komputer, Universitas Budi Luhur, Jakarta, Indonesia

DOI:

https://doi.org/10.31598/sintechjournal.v6i3.1433

Keywords:

Support Vector Machine, Multinomial Naïve Bayes, Bill of health, Inset Lexicon

Abstract

This research focuses on sentiment analysis regarding the plan to ratify the Health Bill which has become a hot topic of conversation on social media, especially Twitter. This research aims to classify tweets that reflect various opinions regarding the Health Bill, including support, rejection and neutrality. In this research, the author uses two types of classification algorithms, namely the Multinomial Naïve Bayes Algorithm and the Support Vector Machine (SVM) Algorithm. Previously, tweets were labelled using the Lexicon InSet dictionary. The research was conducted in the Python programming language and using Google Collaboratory. Data validation was carried out using the K-fold cross-validation method. The research results indicate that both algorithms predominantly produce positive sentiments over negative ones. However, SVM with a linear kernel achieves a higher accuracy rate of 0.87, compared to Multinomial Naïve Bayes, which has an accuracy of 0.82. SVM also records a precision of 0.87, recall of 0.97, and an F1-score of 0.91, while Multinomial Naïve Bayes shows a precision of 0.81, recall of 0.98, and an F1-score of 0.89. Overall, this research confirms that SVM excels in text sentiment classification, while Multinomial Naïve Bayes also provides good results in recognising positive and negative sentiment. These results have important implications for understanding public sentiment regarding the Health Bill on the Twitter platform.

Downloads

Download data is not yet available.

References

F. Natasha, L. Christin, and Ferdinandus Winandy Soesilo, “The Effect of Entrepreneurial Orientation on Social Media Adoption and Business Performance Moderated by Innovation Capability in Healthy Food SMEs in DKI Jakarta,” J. Account. Financ. Manag., vol. 4, no. 1, pp. 104–117, 2023, doi: 10.38035/jafm.v4i1.197.

F. Sidik, I. Suhada, A. H. Anwar, and F. N. Hasan, “Analisis Sentimen Terhadap Pembelajaran Daring Dengan Algoritma Naive Bayes Classifier,” J. Linguist. Komputasional, vol. 5, no. 1, p. 34, 2022, doi: 10.26418/jlk.v5i1.79.

M. Pan, “Discussion of Online Reviews Impacts on Consumers Behaviors,” J. Educ. Humanit. Soc. Sci. MAMEE, vol. 13, pp. 219–225, 2023.

K. Fithriasari, W. Rakhmah, W. Mayasari, and W. Setya, “Surabaya Government Performance Evaluation using Tweet Analysis,” 2020. [Online]. Available: www.matematika.utm.my

F. S. Pamungkas and I. Kharisudin, “Analisis Sentimen dengan SVM, NAIVE BAYES dan KNN untuk Studi Tanggapan Masyarakat Indonesia Terhadap Pandemi Covid-19 pada Media Sosial Twitter,” in PRISMA, Prosiding Seminar Nasional Matematika, 2021, vol. 4, pp. 628–634. [Online]. Available: https://journal.unnes.ac.id/sju/index.php/prisma/

P. Arsi and R. Waluyo, “Analisis Sentimen Wacana Pemindahan Ibu Kota Indonesia Menggunakan Algoritma Support Vector Machine (SVM),” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 1, pp. 147–156, 2021, doi: 10.25126/jtiik.202183944.

A. M. Pravina, I. Cholissodin, and P. P. Adikara, “Analisis Sentimen Tentang Opini Maskapai Penerbangan pada Dokumen Twitter Menggunakan Algoritme Support Vector Machine (SVM),” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 3, no. 3, pp. 2789–2797, 2019, [Online]. Available: http://j-ptiik.ub.ac.id

A. Wibowo, F. Noor Hasan, L. Akbar Ramadhan, R. Nurhayati, and dan Arief Wibowo, “Jurnal Asiimetrik: Jurnal Ilmiah Rekayasa Dan Inovasi Analisis Sentimen Opini Masyarakat Terhadap Keefektifan Pembelajaran Daring Selama Pandemi COVID-19 Menggunakan Naïve Bayes Classifier,” vol. 4, pp. 239–248, 2022.

R. Azhar, A. Surahman, and C. Juliane, “Analisis Sentimen Terhadap Cryptocurrency Berbasis Python TextBlob Menggunakan Algoritma Naïve Bayes,” J. Sains Komput. Inform., vol. 6, no. 1, pp. 267–281, 2022.

A. Noviriandini and N. Nurajijah, “Analisis Kinerja Algoritma C4.5 Dan Naïve Bayes Untuk Memprediksi Prestasi Siswa Sekolah Menengah Kejuruan,” JITK (Jurnal Ilmu Pengetah. dan Teknol. Komputer), vol. 5, no. 1, pp. 23–28, 2019, doi: 10.33480/jitk.v5i1.607.

I. P. Dedy, W. Darmawan, G. Aditra Pradnyana, I. Bagus, and N. Pascima, “Optimasi Parameter Support Vector Machine Dengan Algoritma Genetika Untuk Analisis Sentimen Pada Media Sosial Instagram,” Sci. Inf. Technol. SINTECH J., vol. 6, no. 1, pp. 58–67, 2023, [Online]. Available: https://doi.org/10.31598

N. Seddari, A. Derhab, M. Belaoued, W. Halboob, J. Al-Muhtadi, and A. Bouras, “A Hybrid Linguistic and Knowledge-Based Analysis Approach for Fake News Detection on Social Media,” IEEE Access, vol. 10, pp. 62097–62109, 2022, doi: 10.1109/ACCESS.2022.3181184.

E. Hauthal, D. Burghardt, C. Fish, and A. L. Griffin, “Sentiment Analysis,” Int. Encycl. Hum. Geogr. Second Ed., pp. 169–177, 2019, doi: 10.1016/B978-0-08-102295-5.10593-1.

A. Kurniawan and S. Adinugroho, “Analisis Sentimen Opini Film Menggunakan Metode Naïve Bayes dan Lexicon Based Features,” vol. 3, no. 9, pp. 8335–8342, 2019, [Online]. Available: http://j-ptiik.ub.ac.id

F. Koto and G. Y. Rahmaningtyas, “Inset lexicon: Evaluation of a word list for Indonesian sentiment analysis in microblogs,” in Proceedings of the 2017 International Conference on Asian Language Processing, IALP 2017, Feb. 2018, vol. 2018-January, pp. 391–394. doi: 10.1109/IALP.2017.8300625.

. Analisis Dan Penerapan, A. Handayanto, K. Latifa, N. D. Saputro, and R. R. Waliyansyah, “Analisis dan Penerapan Algoritma Support Vector Machine (SVM) dalam Data Mining untuk Menunjang Strategi Promosi (Analysis and Application of Algorithm Support Vector Machine (SVM) in Data Mining to Support Promotional Strategies),” vol. 7, no. 2, pp. 71–79, 2019.

J. Han, M. Kamber, and J. Pe, Data Mining: Concepts and Techniques. 2011. doi: 10.1016/C2009-0-61819-5.

A. Sabrani, I. W. Gede Putu Wirarama Wedashwara, and F. Bimantoro, “Metode Multinomial Naïve Bayes Untuk Klasifikasi Artikel Online Tentang Gempa Di Indonesia,” JTIKA, vol. 2, no. 1, pp. 89–100, 2020, [Online]. Available: http://jtika.if.unram.ac.id/index.php/JTIKA/

M. Wongkar and A. Angdresey, “Sentiment Analysis Using Naive Bayes Algorithm Of The Data Crawler: Twitter,” Proc. 2019 4th Int. Conf. Informatics Comput. ICIC 2019, pp. 1–5, 2019, doi: 10.1109/ICIC47613.2019.8985884.

N. Zhang and J. Liu, “Fake Financial News Detection with Deep Learning: Evidence from China,” Procedia Comput. Sci., vol. 221, pp. 154–160, 2023, doi: 10.1016/j.procs.2023.07.022.

M. Qorib, T. Oladunni, M. Denis, E. Ososanya, and P. Cotae, “Covid-19 vaccine hesitancy: Text mining, sentiment analysis and machine learning on COVID-19 vaccination Twitter dataset,” Expert Syst. Appl., vol. 212, no. August 2022, p. 118715, 2023, doi: 10.1016/j.eswa.2022.118715.

F. Tempola, M. Muhammad, and A. Khairan, “Perbandingan Klasifikasi Antara Knn Dan Naive Bayes Pada Penentuan Status Gunung Berapi Dengan K-Fold Cross Validation,” J. Teknol. Inf. dan Ilmu Komput., vol. 5, no. 5, pp. 577–584, 2018, doi: 10.25126/jtiik20185983.

Downloads

Published

2023-12-31

How to Cite

[1]
T. Widyanto, I. Ristiana, and A. Wibowo, “Komparasi Naïve Bayes dan SVM Analisis Sentimen RUU Kesehatan di Twitter”, SINTECH Journal, vol. 6, no. 3, pp. 147-161, Dec. 2023.