Implementasi Pipeline ETL Otomatis Berbasis Container untuk Pengelolaan Data Komentar YouTube Kasus Gagal Ginjal di Indonesia
DOI:
https://doi.org/10.32493/jtsi.v9i2.59043Keywords:
ETL, Apache NiFi, YouTube API, container, gagal ginjalAbstract
Data dari media sosial seperti YouTube memiliki potensi untuk mendukung analisis isu kesehatan, termasuk gagal ginjal, namun umumnya data masih tidak terstruktur dan memerlukan proses pengolahan. Penelitian ini bertujuan membangun pipeline Extract, Transform, Load (ETL) otomatis berbasis container menggunakan Apache NiFi untuk mengelola data komentar YouTube terkait isu gagal ginjal. Pipeline terdiri dari Apache NiFi sebagai pengelola aliran data, Python_processor untuk transformasi, MySQL sebagai basis data, dan phpMyAdmin sebagai antarmuka pengelolaan. Proses ETL meliputi pengambilan data melalui YouTube API, pembersihan dan normalisasi teks, serta penyimpanan ke dalam database terstruktur. Hasil implementasi menunjukkan bahwa pipeline mampu memproses data dengan waktu kurang dari satu detik dan throughput sebesar 0,1972 MB/s. Evaluasi penggunaan sumber daya menunjukkan bahwa Apache NiFi menggunakan CPU sebesar 38,27% dan memori 1,03 GB, sedangkan container lain menggunakan sumber daya lebih rendah. Meskipun masih terdapat keterbatasan pada normalisasi teks di tahap transformasi, pipeline ETL yang dibangun mampu menghasilkan data yang lebih rapi dan terstruktur untuk analisis lanjutan.
References
Afrizal, H., & Prihanto, A. (2022). Analisis Kebutuhan Resource Dan Independensi Antara Teknologi Single Server, Virtualisasi Dan Container. Journal of Informatics and Computer Science, 4(1). https://doi.org/10.26740/jinacs.v4n01.p26-33
Bono, C. A., Cappiello, C., Pernici, B., Ramalli, E., & Vitali, M. (2023). Pipeline Design for Data Preparation for Social Media Analysis. Journal of Data and Information Quality, 15(4). https://doi.org/10.1145/3597305
Cahyani, P. I., & Wijayanto, D. (2025). Implementation of a Web-Based BPJS Bridging API Using the Waterfall Method. Jurnal Sistem Informasi Dan Bisnis Cerdas, 18(1). https://doi.org/10.33005/sibc.v18i1.426
Ghani, R. A., & Kurniawan, R. (2024). Implementasi Extract, Transform, Load Process pada Perancangan Data Warehouse Terkait Kualitas Pendidikan di Kabupaten Serang. Jurnal Mahasiswa Teknik Informatika, 8(2). https://doi.org/10.36040/jati.v8i2.9081
Hutabalian, P. (2025). Implementasi Pipeline ETL/ELT dan Model Dimensional untuk Analisis Penjualan Shopee Menggunakan PostgreSQL, Docker, dan Apache Superset. Jurnal Informatika Dan Teknik Elektro Terapan, 13(3S1). https://doi.org/10.23960/jitet.v13i3S1.8093
Khoirunnisa, S., Winangsih, R., & Sagita, D. (2025). Analisis Big Data Konsumsi Informasi Kesehatan Masyarakat Banten Pasca Turunnya Kasus Covid-19 Pada Media Sosial YouTube. Jurnal Riset Komunikasi, 16(1). https://doi.org/10.62870/jrk.v1i1.32945
Liu, P., & Guitart, J. (2022). Performance characterization of containerization for HPC workloads on InfiniBand clusters: an empirical study. Cluster Computing, 25(2), 847–868. https://doi.org/10.1007/s10586-021-03460-8
Marella, V. (2024). Comparative Analysis of Container Orchestration Platforms: Kubernetes vs. Docker Swarm. International Journal of Scientific Research in Science and Technology, 11(5), 526–543. https://doi.org/10.32628/ijsrst24105254
Mishra, A. K., Pilli, E. S., & Govil, M. C. (2022). CONTAIN4n6: a systematic evaluation of container artifacts. Journal of Cloud Computing, 11(1). https://doi.org/10.1186/s13677-022-00303-8
Mnsen, H. K. I., Purnomosidi, B., Kartadie, R., & Kurnaedi, R. (2024). Data Pipeline Architecture for Academic Information System at Akademi Teknik Biak. Journal of Intelligent Software Systems, 3(1), 1. https://doi.org/10.26798/jiss.v3i1.1335
Mondal, S. K., Zheng, Z., & Cheng, Y. (2024). On the Optimization of Kubernetes toward the Enhancement of Cloud Computing. Mathematics, 12(16). https://doi.org/10.3390/math12162476
Nasution, M. Z., Sikumbang, E. S., & Gurning, F. P. (2025). Analisis Tren Penyakit Gagal Ginjal Kronik Peserta BPJS dan Dampaknya pada Pembiayaan Kesehatan Indonesia. Jurnal Kolaboratif Sains, 8(7), 4308–4317. https://doi.org/10.22146/jkki.107401
Nur, Z., Sulaiman, U., & Rahman, U. (2024). Metodologi Penelitian: Analisis Konseptual untuk Memahami Hakikat, Tujuan, Prosedur, dan Klasifikasi Penelitian. PEDAGOGIC: Indonesian Journal of Science Education and Technology, 4(1), 34–45. https://doi.org/10.54373/ijset.v4i1.1395
Perkasa, L., & Hardiani, T. (2026). Penerapan Arsitektur Kappa dengan Kafka dan Spark untuk Pemrosesan Data Hipertensi di Media Sosial X. Jurnal Teknologi Sistem Informasi Dan Aplikasi, 9(1), 13–22. https://doi.org/10.32493/jtsi.v9i1.57819
Sandiya, I. W., Sudiarsa, I. W., Putra, I. G. A. N. P. M., Arta, I. W. W., & Prayogi, K. D. (2026). Implementasi Pipeline Etl Dan Algoritma K-Means Untuk Segmentasi Geografis Penjualan E-Commerce. https://doi.org/10.65094/jcs.v1i1.115
Saputra, A. K., Laksitowening, K. A., & Herdiani, A. (2025). Performance Analysis of Extract, Transform, and Load (ETL) Methods for Business Intelligence in E-Learning Systems Using Pentaho Data Integration. Jurnal Teknik Informatika (Jutif), 6(1), 75–86. https://doi.org/10.52436/1.jutif.2025.6.1.4173
Setyaji, D. R., & Wijayanto, D. (2025). Perancangan Arsitektur Sistem Antrian Online Terintegrasi BPJS di RSU Queen Latifa Berbasis Docker. Jurnal Teknik Mesin, Industri, Elektro Dan Informatika, 4(2), 32–40. https://doi.org/10.55606/jtmei.v4i2.4890
Sholihah, I., & Darujati, C. (2022). Sistem Replikasi Basis Data berdasarkan MySQL menggunakan Container Docker. Majalah Ilmiah Teknologi Elektro, 21(2), 209. https://doi.org/10.24843/MITE.2022.v21i02.P08
Singu, S. K. (2022). ETL Process Automation: Tools and Techniques. ESP Journal of Engineering & Technology Advancements, 2(1 February 2022), 74–85. https://doi.org/10.56472/25832646/ESP-V2I1P110
Wakchaure, S. L. (2023). Overview of Apache NiFi. International Journal of Advanced Research in Science, Communication and Technology, 523–530. https://doi.org/10.48175/ijarsct-14362
Walha, A., Ghozzi, F., & Gargouri, F. (2024). Extract-Transform-Load Process for Recognizing Sentiment from User-Generated Text on Social Media. International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE - Proceedings, 641–648. https://doi.org/10.5220/0012706100003687
Wijayanto, D., & Firdonsyah, A. (2023). Implementation of Continous Delivery using Jenkins And Kubernetes with Docker Local Images. Sinkron, 8(4), 2226–2235. https://doi.org/10.33395/sinkron.v8i4.12624
Wnęk, K., & Boryło, P. (2023). A Data Processing and Distribution System Based on Apache Nifi. Photonics, 10(2). https://doi.org/10.3390/photonics10020210
Yepuri, V. K., Polamarasetty, V. K., Donthi, S., & Gondi, A. K. R. (2023). Containerization of a polyglot microservice application using Docker and Kubernetes. https://doi.org/10.48550/arXiv.2305.00600
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2026 rafita kusuma, Tikaridha Hardiani

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Jurnal Teknologi Sistem Informasi dan Aplikasi have CC BY-NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work.
In developing strategy and setting priorities, Jurnal Teknologi Sistem Informasi dan Aplikasi recognize that free access is better than priced access, libre access is better than free access, and libre under CC BY-NC or the equivalent is better than libre under more restrictive open licenses. We should achieve what we can when we can. We should not delay achieving free in order to achieve libre, and we should not stop with free when we can achieve libre.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) License
YOU ARE FREE TO:
- Share - copy and redistribute the material in any medium or format
- Adapt - remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms









