Gated Recurrent Unit with Self-Attention for Sentiment Analysis of Amazon Kindle Store Reviews

Authors

  • Nanang Susanto Universitas Pelita Bangsa

DOI:

https://doi.org/10.32493/jiup.v10i4.54830

Keywords:

Sentiment Analysis, Deep Learning, CNN, LSTM, GRU, Self-Attention

Abstract

Sentiment analysis of customer reviews is vital for e-commerce, yet conventional CNNs and LSTMs face architectural constraints when processing unstructured Amazon Kindle Store feedback data. Specifically, CNNs prioritize local n-gram features over long-range semantic dependencies, while LSTMs often suffer from information dilution in the lengthy narratives typical of e-book product reviews. To address these identified research gaps and technical challenges, this study proposes an enhanced hybrid deep learning architecture integrating Gated Recurrent Units (GRU) with a Self-Attention mechanism. The methodology utilizes a large-scale dataset of 982,619 review instances, mapping five-point rating scales into binary sentiment categories while employing trainable GloVe embeddings and fixed-length sequences of 100 tokens to capture intricate domain-specific features. Furthermore, Random Oversampling is rigorously applied to mitigate inherent class imbalances between positive and negative reviews. Experimental results demonstrate that the GRU-Attention architecture achieves a superior classification accuracy of 0.973 and a training loss of 0.0930, significantly outperforming the CNN (0.961) and LSTM (0.948) baselines. The proposed model effectively prioritizes sentiment-critical tokens within reviews, attaining balanced Precision, Recall, and F1-scores of 0.973. These findings confirm the efficacy of attention-based recurrent networks in modeling unstructured textual data, offering stakeholders high-precision analytical insights to optimize customer satisfaction strategies and objectives.

References

Basiri, M. E., Nemati, S., Abdar, M., Cambria, E., & Acharya, U. R. (2021). ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis. Future Generation Computer Systems, 115, 279–294. https://doi.org/10.1016/j.future.2020.08.005

Chen, W., Zheng, H.-T., Wang, Y., Wang, W., & Zhang, R. (2021). Utilizing Generative Adversarial Networks for Recommendation based on Ratings and Reviews. http://www.ieee.org/publications. https://doi.org/10.1609/aaai.v35i16.17651

Chen, W., Zheng, H.-T., Wang, Y., Wang, W., & Zhang, R. (2021). Utilizing Generative Adversarial Networks for Recommendation based on Ratings and Reviews. https://doi.org/10.1109/IJCNN.2019.8851822

Gandhi, U. D., Malarvizhi Kumar, P., Chandra Babu, G., & Karthick, G. (2021). Sentiment Analysis on Twitter Data by Using Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM). Wireless Personal Communications. https://doi.org/10.1007/s11277-021-08580-3

Huang, Y., Dai, X., Yu, J., & Huang, Z. (2023). SA-SGRU: Combining Improved Self-Attention and Skip-GRU for Text Classification. Applied Sciences (Switzerland), 13(3). https://doi.org/10.3390/app13031296

Kirtika. (2024). INTELLIGENT SYSTEMS AND APPLICATIONS IN Enhancing Sentiment Classification Accuracy of Amazon Product Reviews via NLP Approaches. International Journal of Intelligent Systems and Applications in Engineering (IJISAE), 12(4), 5752–5760. https://ijisae.org/index.php/IJISAE/article/view/7601

Manoharan, G., Durai, S., Rajesh, G. A., & Ashtikar, S. P. (2023). Sentiment analysis of customer reviews for online stores that support customer buying decisions. In Handbook of Research on AI and Knowledge Engineering for Real-Time Business Intelligence (pp. 234–242). IGI Global. https://doi.org/10.4018/978-1-6684-6519-6.ch015

Mottaghi, V., & Farnia, H. A. (2022). Weighted Bi-directional GRU Capsule Ensemble Approach for Multi-Domain Sentiment Analysis. Computational Sciences and Engineering, 2(1), 125–142. https://dx.doi.org/10.22124/cse.2022.21884.1027

Prova, N. N. I., Ravi, V., Singh, M. P., Srivastava, V. K., Chippagiri, S., & Singh, A. P. (2026). Multilingual sentiment analysis in e-commerce customer reviews using GPT and deep learning-based weighted-ensemble model. International Journal of Cognitive Computing in Engineering, 7(1), 268–286. https://doi.org/10.1016/j.ijcce.2025.10.003

Rosita, R., & Prasetyaningrum, P. T. (2025). Comparative Analysis of Machine Learning Algorithms for Sentiment Classification of Discord App Reviews. Journal of Information Systems and Informatics, 7(4), 4384–4406. https://doi.org/10.63158/journalisi.v7i4.1367

Setiadi, D. R. I. M., Warto, W., Muslikh, A. R., Nugroho, K., & Safriandono, A. N. (2025). Aspect-Based Sentiment Analysis on E-commerce Reviews using BiGRU and Bi-Directional Attention Flow. Journal of Computing Theories and Applications, 2(4), 470–480. https://doi.org/10.62411/jcta.12376

Imron, S., Setiawan, E. I., Santoso, J., & Purnomo, M. H. (2023). Aspect based sentiment analysis marketplace product reviews using BERT, LSTM, and CNN. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), 7(3), 586-591 https://doi.org/10.29207/resti.v7i3.4751

Susanto, N., & Pardede, H. F. (2024). Feature Learning using Deep Variational Autoencoder for Prediction of Defects in Car Engine. 2024 International Conference on Information Technology Research and Innovation (ICITRI), 2024. https://doi.org/10.1109/ICITRI62858.2024.10699115

Wankhade, M., Chandra, A., Rao, S., & Kulkarni, C. (2022). and challenges (Issue 0123456789). Springer Nature. https://doi.org/https://doi.org/10.1007/s10462-022-10144-1

Downloads

Published

2025-12-30

Issue

Vol. 10 No. 4 (2025): JURNAL INFORMATIKA UNIVERSITAS PAMULANG

Section

Machine Learning

Categories

License

Copyright (c) 2025 Nanang Susanto

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).

Jurnal Informatika Universitas Pamulang have CC-BY-NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work.

In developing strategy and setting priorities, Jurnal Informatika Universitas Pamulang recognize that free access is better than priced access, libre access is better than free access, and libre under CC-BY-NC or the equivalent is better than libre under more restrictive open licenses. We should achieve what we can when we can. We should not delay achieving free in order to achieve libre, and we should not stop with free when we can achieve libre.

Jurnal Informatika Universitas Pamulang is licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)

YOU ARE FREE TO:

  • Adapt : remix, transform, and build upon the material for any purpose, even commercially.
  • The licensor cannot revoke these freedoms as long as you follow the license terms