IndoBERT-Based Sentiment Analysis of Electric Motorcycle Policy in Indonesia Using Instagram Data
DOI:
https://doi.org/10.23917/saintek.v2i2.17021Keywords:
sentiment analysis, IndoBERT, deep learning, public opinion, electric motorcycles, social media analytics, instagram data, public policy, sustainable transportationAbstract
This study aims to analyze public sentiment toward the procurement of electric motorcycles within the Nutritional Service Fulfillment Unit/ Satuan Pelayanan Pemenuhan Gizi (SPPG) program in Indonesia by utilizing data from Instagram. The approach employed is a deep learning-based sentiment analysis using the IndoBERT model, which has been fine-tuned to classify data into positive, negative, and neutral categories. The research stages include data collection, preprocessing, labeling, model development, and model evaluation using accuracy, precision, recall, and F1-score metrics. The results indicate that public sentiment is predominantly negative at 80%, followed by positive sentiment at 15% and neutral sentiment at 5%. Further analysis reveals that negative sentiment is primarily driven by issues related to budget prioritization, infrastructure readiness, and policy effectiveness, while positive sentiment is associated with environmental benefits and improved service distribution efficiency. The model evaluation demonstrates that IndoBERT achieves high performance, with an accuracy of 0.89, precision of 0.88, recall of 0.90, and F1-score of 0.89. These findings indicate that IndoBERT is effective in capturing the contextual nuances of the Indonesian language in unstructured social media data. This study contributes to the advancement of transformer-based sentiment analysis methods and provides data-driven insights to support more responsive and evidence-based policymaking.
Downloads
References
[1] L. L. Evinita, J. E. M. Tangkau, P. J. Pesak, and S. Cahyono, “Policy Framework to Improve MSME Competitiveness and Financial Performance with Indonesia’s Asta Cita Vision Goals,” Journal of Risk and Financial Management, vol. 18, no. 12, p. 692, Dec. 2025, doi: 10.3390/jrfm18120692.
[2] T.-M. Baierl, F. G. Kaiser, and F. X. Bogner, “The supportive role of environmental attitude for learning about environmental issues,” J. Environ. Psychol., vol. 81, p. 101799, Jun. 2022, doi: 10.1016/j.jenvp.2022.101799.
[3] S. M. Anugerah, R. Wijaya, and M. A. Bijaksana, “Sentimen Analysis Social Media for Disaster using Naïve Bayes and IndoBERT,” INTEK: Jurnal Penelitian, vol. 11, no. 1, pp. 51–58, Apr. 2024, doi: 10.31963/intek.v11i1.4771.
[4] F. E. Muzayyana, K. Hulliyah, F. Arifadilah, I. M. Shofi, and N. Wafiqni, “Comparison of the Indobert Optimization Hyperparameter Algorithm for Radicalism Sentiment Analysis,” in 2023 11th International Conference on Cyber and IT Service Management (CITSM), IEEE, Nov. 2023, pp. 1–6. doi: 10.1109/CITSM60085.2023.10455590.
[5] F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” in Proceedings of the 28th International Conference on Computational Linguistics, Stroudsburg, PA, USA: International Committee on Computational Linguistics, 2020, pp. 757–770. doi: 10.18653/v1/2020.coling-main.66.
[6] H. Imaduddin, F. Y. A’la, and Y. S. Nugroho, “Sentiment Analysis in Indonesian Healthcare Applications using IndoBERT Approach,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 8, 2023, doi: 10.14569/IJACSA.2023.0140813.
[7] M. Françoise et al., “Evidence based policy making during times of uncertainty through the lens of future policy makers: four recommendations to harmonise and guide health policy making in the future,” Archives of Public Health, vol. 80, no. 1, p. 140, Dec. 2022, doi: 10.1186/s13690-022-00898-z.
[8] M. Mozafari, R. Farahbakhsh, and N. Crespi, “A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Media,” 2020, pp. 928–940. doi: 10.1007/978-3-030-36687-2_77.
[9] G. A. Ruz, P. A. Henríquez, and A. Mascareño, “Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers,” Future Generation Computer Systems, vol. 106, pp. 92–104, May 2020, doi: 10.1016/j.future.2020.01.005.
[10] H. J. Prayitno et al., “The Politeness Comments on The Indonesian President Jokowi Instagram Official Account Viewed From Politico Pragmatics and The Character Education Orientation in The Disruption Era,” Indonesian Journal on Learning and Advanced Education (IJOLAE), vol. 1, no. 2, pp. 52–71, Jul. 2019, doi: 10.23917/ijolae.v1i2.8785.
[11] H. Ardhiansya, A. Burhanuddin, and S. D. Alika, “Analisis Sentimen Pendapat Masyarakat Terhadap PPKM DKI Jakarta Dengan Metode Naïve Bayes,” vol. 10, no. 2, pp. 60–70, 2023, [Online]. Available: http://jurnal.mdp.ac.id
[12] E. Supriyadi and P. N. Makatita, “Sentiment Analysis of TikTok User Comments on QRIS Adoption in Indonesia Using IndoBERT,” Procedia Comput. Sci., vol. 269, pp. 121–130, 2025, doi: 10.1016/j.procs.2025.08.265.
[13] “Advanced Sentiment Analysis in Health Care Using Hybrid Transformer with LSTM-Based Deep Learning: A Social Media Data Perspective,” International Journal of Intelligent Engineering and Systems, vol. 18, no. 11, pp. 229–240, Dec. 2025, doi: 10.22266/ijies2025.1231.14.
[14] Y. S. Nugroho et al., “How are project-specific forums utilized? A study of participation, content, and sentiment in the Eclipse ecosystem,” Empir. Softw. Eng., vol. 26, no. 6, p. 132, Nov. 2021, doi: 10.1007/s10664-021-10032-2.
[15] N. V. Babu and E. G. M. Kanaga, “Sentiment Analysis in Social Media Data for Depression Detection Using Artificial Intelligence: A Review,” SN Comput. Sci., vol. 3, no. 1, p. 74, Jan. 2022, doi: 10.1007/s42979-021-00958-1.
[16] S. Srivastava, V. K. Tripathi, S. Tripathi, A. Samy, M. Bhat, and A. Kumar, “Real-Time Social Media Sentiment Prediction Using BERT, CNN, and LSTM Techniques,” in 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI), IEEE, Mar. 2025, pp. 1–6. doi: 10.1109/IATMSI64286.2025.10985197.
[17] M. Pota, M. Ventura, H. Fujita, and M. Esposito, “Multilingual evaluation of pre-processing for BERT-based sentiment analysis of tweets,” Expert Syst. Appl., vol. 181, p. 115119, Nov. 2021, doi: 10.1016/j.eswa.2021.115119.
[18] Y. Lian, H. Tang, M. Xiang, and X. Dong, “Public attitudes and sentiments toward ChatGPT in China: A text mining analysis based on social media,” Technol. Soc., vol. 76, p. 102442, Mar. 2024, doi: 10.1016/j.techsoc.2023.102442.
[19] R. Cai et al., “Sentiment Analysis About Investors and Consumers in Energy Market Based on BERT-BiLSTM,” IEEE Access, vol. 8, pp. 171408–171415, 2020, doi: 10.1109/ACCESS.2020.3024750.
[20] E. Aramaki, S. Wakamiya, S. Yada, and Y. Nakamura, “Natural Language Processing: from Bedside to Everywhere,” Yearb. Med. Inform., vol. 31, no. 01, pp. 243–253, Aug. 2022, doi: 10.1055/s-0042-1742510.
[21] V. Tejaswini, K. Sathya Babu, and B. Sahoo, “Depression Detection from Social Media Text Analysis using Natural Language Processing Techniques and Hybrid Deep Learning Model,” ACM Transactions on Asian and Low-Resource Language Information Processing, vol. 23, no. 1, pp. 1–20, Jan. 2024, doi: 10.1145/3569580.
[22] H. M. Ramdhan, M. Dwifebri Purbolaksono, and B. Bunyamin, “Sentiment Analysis of Beauty Product Reviews Using the IndoBERT Method and Naive Bayes Classification,” in 2024 12th International Conference on Information and Communication Technology (ICoICT), IEEE, Aug. 2024, pp. 397–404. doi: 10.1109/ICoICT61617.2024.10698198.
[23] M. Guia, R. Silva, and J. Bernardino, “Comparison of Naïve Bayes, Support Vector Machine, Decision Trees and Random Forest on Sentiment Analysis,” in Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, SCITEPRESS - Science and Technology Publications, 2019, pp. 525–531. doi: 10.5220/0008364105250531.
[24] D. Marutho and V. Gayuh Utomo, “Benchmarking IndoBERT and Transformer Models for Sentiment Classification on Indonesian E-Government Service Reviews,” Jurnal Transformatika, vol. 23, no. 1, pp. 86–95, Jul. 2025, doi: 10.26623/transformatika.v23i1.12095.
[25] N. Mahfudiyah and A. Alamsyah, “Understanding User Perception of Ride-Hailing Services Sentiment Analysis and Topic Modelling using IndoBERT and BERTopic,” in 2023 International Conference on Digital Business and Technology Management (ICONDBTM), IEEE, Aug. 2023, pp. 1–6. doi: 10.1109/ICONDBTM59210.2023.10327320.
[26] W. Zhai, H. Yu, and C. Y. Song, “Disaster Misinformation and Its Corrections on Social Media: Spatiotemporal Proximity, Social Network, and Sentiment Contagion,” Ann. Am. Assoc. Geogr., vol. 114, no. 2, pp. 408–435, Feb. 2024, doi: 10.1080/24694452.2023.2271549.
[27] F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, “Transformer models for text-based emotion detection: a review of BERT-based approaches,” Artif. Intell. Rev., vol. 54, no. 8, pp. 5789–5829, Dec. 2021, doi: 10.1007/s10462-021-09958-2.
[28] H. Peters, J. B. Bayer, S. C. Matz, Y. Chi, S. S. Vaid, and G. M. Harari, “Social media use is predictable from app sequences: Using LSTM and transformer neural networks to model habitual behavior,” Comput. Human Behav., vol. 161, p. 108381, Dec. 2024, doi: 10.1016/j.chb.2024.108381.
[29] P. Rajapaksha, R. Farahbakhsh, and N. Crespi, “BERT, XLNet or RoBERTa: The Best Transfer Learning Model to Detect Clickbaits,” IEEE Access, vol. 9, pp. 154704–154716, 2021, doi: 10.1109/ACCESS.2021.3128742.
[30] M. S. Adhantoro, A. Rakhmadi, H. Imaduddin, R. F. Rahmadzani, G. Tribuana Kurniaji, and N. Ishartono, “Integration of BERT Model and Temporal Clustering for Real-Time Detection of Events on Social Media,” in 2025 12th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), IEEE, Sep. 2025, pp. 574–579. doi: 10.1109/EECSI67060.2025.11290443.
[31] R. K. Kaliyar, A. Goswami, and P. Narang, “FakeBERT: Fake news detection in social media with a BERT-based deep learning approach,” Multimed. Tools Appl., vol. 80, no. 8, pp. 11765–11788, Mar. 2021, doi: 10.1007/s11042-020-10183-2.
[32] S. Saadah, Kaenova Mahendra Auditama, Ananda Affan Fattahila, Fendi Irfan Amorokhman, Annisa Aditsania, and Aniq Atiqi Rohmawati, “Implementation of BERT, IndoBERT, and CNN-LSTM in Classifying Public Opinion about COVID-19 Vaccine in Indonesia,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 6, no. 4, pp. 648–655, Aug. 2022, doi: 10.29207/resti.v6i4.4215.
[33] Y. Chen, J. Yuan, Q. You, and J. Luo, “Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM,” in Proceedings of the 26th ACM international conference on Multimedia, New York, NY, USA: ACM, Oct. 2018, pp. 117–125. doi: 10.1145/3240508.3240533.
[34] F. Bertacchini, C. Scuro, P. Pantano, and E. Bilotta, “A Project Based Learning Approach for Improving Students’ Computational Thinking Skills,” Front. Robot. AI, vol. 9, Mar. 2022, doi: 10.3389/frobt.2022.720448.
[35] M. A. K. Fata, S. Sumpeno, A. D. Wibawa, and D. A. Feryando, “Evaluating the Sentiment Analysis from Auto-Generated Summary Text Using IndoBERT Fine-Tuning Model in Indonesian News Text,” in 2023 IEEE 15th International Conference on Computational Intelligence and Communication Networks (CICN), IEEE, Dec. 2023, pp. 822–829. doi: 10.1109/CICN59264.2023.10402345.
[36] N. Istiqomah and F. Novika, “Comparative Performance of IndoBERT and IndoLEM Baseline Models for Post-Disaster Health Information Extraction from Indonesian Online News,” Journal of Computer Science and Informatics Engineering, vol. 4, no. 3, pp. 158–174, Jul. 2025, doi: 10.55537/cosie.v4i3.1174.
Downloads
Submitted
Accepted
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Muhammad Syahriandi Adhantoro, Faris Athoil Haq, Dody Hartanto, Aninditawidagda Pandam Sudaryanto
This work is licensed under a Creative Commons Attribution 4.0 International License.
