Sentiment Analysis Model for the Free Lunch Program in Indonesia on Twitter (X) Based on Machine Learning
DOI:
https://doi.org/10.65780/bima.v1i3.18Keywords:
Sentiment Analysis, Free Lunch Program, Random Forest, Support Vector Machine (SVM), Naïve BayesAbstract
Social media has become a primary platform for the public to voice their opinions on various public policies, including the free lunch program initiated by the Indonesian government. This study aims to analyze public sentiment toward this program through the Twitter (X) platform by utilizing machine learning algorithms. Data collection was conducted from January 2025 to June 2025, with a total of 2,045 comments successfully gathered. Sentiment labeling was performed manually, and only positive and negative sentiments were considered. The data, in the form of relevant comments, were pre-processed and classified into positive and negative sentiments. Three algorithms used in this study are Support Vector Machine (SVM), Naïve Bayes, and Random Forest. Evaluation was performed using data splitting schemes of 70:30 and 80:20, along with 5-fold cross-validation. Unlike previous studies, which primarily focused on sentiment analysis of general social issues or specific topics without emphasizing public policy, this study specifically investigates the public's sentiment regarding a government policy (the free lunch program) and compares the performance of different machine learning models. The results of the study show that the Random Forest model outperformed SVM and Naïve Bayes, achieving an accuracy of 89.41% with a standard deviation of 0.0138. Meanwhile, SVM achieved an accuracy of 88.96% and Naïve Bayes 88.72%. These findings suggest that Random Forest is the most optimal and consistent model for sentiment analysis of public policies on social media.
Downloads
References
[1] Z. Alhaq, A. Mustopa, S. Mulyatun, and J. D. Santoso, "Penerapan metode support vector machine untuk analisis sentimen pengguna Twitter," Journal of Information System Management (JOISM), vol. 3, no. 2, pp. 44–49, 2021. doi: 10.24076/joism.2021v3i2.558.
[2] M. I. Amal, E. S. Rahmasita, E. Suryaputra, and N. A. Rakhmawati, "Analisis klasifikasi sentimen terhadap isu kebocoran data kartu identitas ponsel di Twitter," Jurnal Teknik Informatika dan Sistem Informasi, vol. 8, no. 3, 2022. doi: 10.28932/jutisi.v8i3.5483.
[3] I. Ardiansah and R. H. Permana, Memulai Python: Belajar Python dari Nol, CV. Cendekia Press, 2023.
[4] T. F. Basar, D. E. Ratnawati, and I. Arwani, "Analisis sentimen pengguna Twitter terhadap pembayaran cashless menggunakan Shopeepay dengan algoritma Random Forest," unpublished.
[5] H. Satria, "Cara mendapatkan data (crawl) Twitter X - Maret 2024," Helmi Satria, Jul. 2, 2024. [Online]. Available: https://helmisatria.com/blog/updated-crawl-data-twitter-x-maret-2024/
[6] D. Daryanti and T. Widodo, "Analisis sentimen ulasan penumpang maskapai penerbangan Indonesia menggunakan Support Vector Machine, Naive Bayes, dan Random Forest," The Indonesian Journal of Computer Science, vol. 13, no. 5, 2024. doi: 10.33022/ijcs.v13i5.4452.
[7] F. Z. Emeraldien, R. J. Sunarsono, and R. Alit, "Twitter sebagai platform komunikasi politik di Indonesia," Scan: Jurnal Teknologi Informasi Dan Komunikasi, vol. 14, no. 1, pp. 21–30, 2019. doi: 10.33005/scan.v14i1.1457.
[8] F. Rahutomo, P. Y. Saputra, and M. A. Fidyawan, "Implementasi Twitter sentiment analysis untuk review film menggunakan algoritma Support Vector Machine," Jurnal Informatika Polinema, vol. 4, no. 2, pp. 93, 2018. doi: 10.33795/jip.v4i2.152.
[9] G. Ginabila and A. Fauzi, "Analisis sentimen terhadap pemutar musik online Spotify dengan algoritma Naive Bayes dan Support Vector Machine," Jurnal Ilmiah ILKOMINFO - Ilmu Komputer & Informatika, vol. 6, no. 2, pp. 111–122, 2023. doi: 10.47324/ilkominfo.v6i2.180.
[10] A. A. Haikal and H. H. Anbiya, "Pengaruh program makan siang dan susu gratis Prabowo Gibran terhadap sektor industri manufaktur," unpublished.
[11] F. F. Irfani, "Analisis sentimen review aplikasi Ruangguru menggunakan algoritma Support Vector Machine," JBMI (Jurnal Bisnis, Manajemen, dan Informatika), vol. 16, no. 3, pp. 258–266, 2020. doi: 10.26487/jbmi.v16i3.8607.
[12] W. Irmayani, "Visualisasi data pada data mining menggunakan metode klasifikasi Naïve Bayes," Karimah Tauhid, vol. 2, no. 1, pp. 2, 2021.
[13] I. Kurniawan, A. L. Hananto, S. S. Hilabi, A. Hananto, and A. Y. Rahman, "Perbandingan algoritma Naive Bayes dan SVM dalam sentimen analisis marketplace pada Twitter," vol. 10, no. 1, 2023.
[14] K. Kusnawi and A. H. Pratama, Belajar Mudah dan Singkat Machine Learning: Panduan Praktis dengan Studi Kasus, Kode Program, dan Dataset, Penerbit Andi, 2024.
[15] S. Mahmuda, "Implementasi metode Random Forest pada kategori konten kanal Youtube," JURNAL JENDELA MATEMATIKA, vol. 2, no. 1, pp. 21–31, 2024. doi: 10.57008/jjm.v2i01.633.
[16] T. Mardiana, H. Syahreva, and T. Tuslaela, "Komparasi metode klasifikasi pada analisis sentimen usaha waralaba berdasarkan data Twitter," Jurnal Pilar Nusa Mandiri, vol. 15, no. 2, pp. 267–274, 2019. doi: 10.33480/pilar.v15i2.752.
[17] E. Martantoh and N. Yanih, "Implementasi metode Naïve Bayes untuk klasifikasi karakteristik kepribadian siswa di sekolah MTS Darussa’adah menggunakan PHP MySQL," Jurnal Teknologi Sistem Informasi, vol. 3, no. 2, pp. 166–175, 2022. doi: 10.35957/jtsi.v3i2.2896.
[18] F. S. Pamungkas and I. Kharisudin, "Analisis sentimen dengan SVM, Naïve Bayes dan KNN untuk studi tanggapan masyarakat Indonesia terhadap pandemi Covid-19 pada media sosial Twitter," vol. 4, 2021.
[19] Z. Purwanti and S. Sugiyono, "Pemodelan text mining untuk analisis sentimen terhadap program makan siang gratis di media sosial X menggunakan algoritma Support Vector Machine (SVM)," Jurnal Indonesia: Manajemen Informatika Dan Komunikasi, vol. 5, no. 3, Article 3, 2024. doi: 10.35870/jimik.v5i3.1001.
[20] E. Salim and M. Syafrullah, "Analisis sentimen pada ulasan pelayanan suku dinas kependudukan dan pencatatan sipil Kota Administrasi Jakarta Barat menggunakan algoritme K-Nearest Neighbor," Bit (Fakultas Teknologi Informasi Universitas Budi Luhur), vol. 20, no. 1, pp. 58, 2023. doi: 10.36080/bit.v20i1.2186.
[21] M. Samantri and N. Afiyati, "Perbandingan algoritma Support Vector Machine dan Random Forest untuk analisis sentimen terhadap kebijakan pemerintah Indonesia terkait kenaikan harga BBM tahun 2022," Jurnal JTIK (Jurnal Teknologi Informasi dan Komunikasi), vol. 8, no. 1, pp. 1–9, 2024. doi: 10.35870/jtik.v8i1.1202.
[22] R. Saputra and F. N. Hasan, "Analisis sentimen terhadap program makan siang & susu gratis menggunakan algoritma Naive Bayes," Jurnal Teknologi Dan Sistem Informasi Bisnis, vol. 6, no. 3, pp. 411–419, 2024. doi: 10.47233/jteksis.v6i3.1378.
[23] A. Y. Simanjuntak and I. S. S. Simatupang, "Implementasi data mining menggunakan metode Naïve Bayes classifier untuk data kenaikan pangkat dinas ketenagakerjaan Kota Medan," unpublished.
[24] A. Sitanggang, Y. Umaidah, and R. I. Adam, "Analisis sentimen masyarakat terhadap program makan siang gratis pada media sosial X menggunakan algoritma Naïve Bayes," Jurnal Informatika Dan Teknik Elektro Terapan, vol. 12, no. 3, Article 3, 2024. doi: 10.23960/jitet.v12i3.4902.
[25] T. Thoyyibah, F. Kurniawan, and T. Taryo, Dasar-Dasar Machine Learning pada Google Colabs, Eureka Media Aksara, 2024. [Online]. Available: https://repository.penerbiteureka.com/uk/publications/567741/
[26] E. Yuspita and R. R. Suryono, "Perbandingan berbagai metode klasifikasi teks untuk sentimen kebijakan makan gratis di Indonesia," The Indonesian Journal of Computer Science, vol. 13, no. 5, 2024. doi: 10.33022/ijcs.v13i5.4440.
[27] F. N. Zaman, M. A. Fadhilah, M. A. Ulinuha, and K. Umam, "Menganalisis respons netizen Twitter terhadap program makan siang gratis menerapkan NLP metode Naïve Bayes," Jurnal Sistem Informasi, vol. 14, no. 3, 2024..
