Design and Implementation of an Automatic Door Security System Based on Image and Sound Processing
DOI:
https://doi.org/10.32493/jiup.v11i2.56983Keywords:
Automatic door security, ESP32-CAM, face recognition, voice recognition, Bluetooth ControlAbstract
Conventional home security systems relying on mechanical keys are increasingly inadequate and highly vulnerable to unauthorized access. To address these limitations, this study presents the design and implementation of an automated smart door security system that integrates image and voice processing to optimize both security and user convenience. The proposed architecture employs a dual-authentication mechanism: facial recognition via an ESP32-CAM module serves as the primary tier, while voice recognition, facilitated by an Arduino Bluetooth interface and an HC-05 module, functions as the secondary tier. The prototype was empirically evaluated for its accuracy and responsiveness under various environmental conditions. Experimental results indicate that the real-time facial recognition module operates with high precision under standard indoor lighting. While voice authentication exhibited peak accuracy in low-noise environments, its reliability degraded significantly amidst elevated ambient noise. Overall, the integrated electromechanical system demonstrated robust performance in executing automated access protocols. These findings offer a scalable and efficient solution for modern smart home infrastructure, establishing a foundational framework for future advancements in multimodal biometric security systems.
References
[1] J. Jhonatan and K. Sekarsari, “Sistem Keamanan Dua Lapis Dengan RFID dan Pendeteksi Objek Dengan Machine Learning,” Building of Informatics, Technology and Science (BITS), vol. 6, no. 2, pp. 1059–1070, Sep. 2024, doi: https://doi.org/10.47065/bits.v6i2.5747.
[2] A. Dwi Wibowo and S. Susanto, “Perancangan Purwarupa Smart Door Lock berbasis Internet of Things,” Jurnal Elektro & Informatika Swadharma (JEIS), vol. 04, no. 02, pp. 1–8, 2024.
[3] Mutiara Syafrizal, Vidya Ikawati, Agus Siswanto, and N. Lestari, “Sistem Keamanan Door Lock berbasis Voice Recognition dengan Natural Language Processing,” Infotronik : Jurnal Teknologi Informasi dan Elektronika, vol. 9, no. 1, pp. 1–11, Jun. 2024, doi: https://doi.org/10.32897/infotronik.2024.9.1.3611.
[4] Wisnu Wiraditama, Dedi Candra, Ami Prasena Nugraha, and Sulartopo Sulartopo, “Sistem Keamanan Rumah Menggunakan Sensor Passive Infrared,” Seminar Nasional Teknologi dan Multidisiplin Ilmu (SEMNASTEKMU), vol. 3, no. 1, pp. 200–210, Oct. 2023, doi: https://doi.org/10.51903/semnastekmu.v3i1.215.
[5] I. Supriadi, A. Mauluddin, and H. R. Warits, “Pengembangan Aplikasi Manajemen Keamanan Lingkungan RW 11 Kelurahan Sekejati Kota Bandung Berbasis Android,” Jurnal Tekno Insentif, vol. 19, no. 1, pp. 107–121, Jul. 2025, doi: https://doi.org/10.36787/jti.v19i1.1943.
[6] Y. Risyani, S. Japit, C. Bombongan, T. Selamat, and Y. Yuliana, “Sistem Keamanan Siber Adaptif Berbasis AI: Analisis Kinerja, Arsitektur, dan Penerapannya pada Organisasi Modern,” Jurnal Minfo Polgan, vol. 14, no. 2, pp. 2999–3006, Nov. 2025, doi: https://doi.org/10.33395/jmp.v14i2.15630.
[7] Supiyandi Supiyandi, Tegar Ardiansyah, Sri Putri Balqis, Jundi Haqqoni, and Salsa Nabila Iskandar, “Deteksi Wajah dalam Foto Menggunakan Teknologi Visi Komputer,” Mars : Jurnal Teknik Mesin, Industri, Elektro Dan Ilmu Komputer, vol. 2, no. 6, pp. 32–39, Nov. 2024, doi: https://doi.org/10.61132/mars.v2i6.490.
[8] K. Suy, Sufajar Butsianto, and Supriyanto, “Sistem Informasi Keamanan Kunci Pintu Pintar Berbasis Internet of Things Notifikasi Real-Time Berbasis WhatsApp,” Bulletin of Computer Science Research, vol. 5, no. 5, pp. 886–897, Aug. 2025, doi: https://doi.org/10.47065/bulletincsr.v5i5.720.
[9] Y. Yao, “Research on facial recognition system based on deep learning,” in Applied and Computational Engineering, EWA Publishing, Feb. 2024, pp. 232–236. doi: https://doi.org/10.54254/2755-2721/34/20230332.
[10] S. Setiyo Prihatmoko, Sumaryanto, and Jarot Dian Susatyono, “Konsep Desain Multimedia Sinestetik sebagai Pendekatan Baru dalam Penciptaan Pengalaman Visual–Audio Imersif,” Jurnal Publikasi Ilmu Komputer dan Multimedia, vol. 5, no. 1, pp. 197–213, Jan. 2026, doi: https://doi.org/10.55606/jupikom.v5i1.6135.
[11] K. Aizat, O. Mohamed, M. Orken, A. Ainur, and B. Zhumazhanov, “Identification and authentication of user voice using DNN features and i-vector,” Cogent Eng., vol. 7, no. 1, pp. 1–21, Jan. 2020, doi: https://doi.org/10.1080/23311916.2020.1751557.
[12] A. Labinjan, S. Baressi Šegota, I. Lorencin, and N. Tanković, “Face Recognition System Using CLIP and FAISS for Scalable and Real-Time Identification,” Mathematical and Computational Applications, vol. 31, no. 36, pp. 1–24, Mar. 2026, doi: https://doi.org/10.3390/mca31020036.
[13] S. Uppuluri and G. Lakshmeeswari, “Secure user authentication and key agreement scheme for IoT device access control based smart home communications,” Wireless Networks, vol. 29, no. 3, pp. 1333–1354, Apr. 2023, doi: https://doi.org/10.1007/s11276-022-03197-1.
[14] I. Fitri, C. Dewi, and J. A. Munif, “Otomatisasi Pintu Dengan Menggunakan ESP32-CAM Berbasis Telegram,” in Seminar Nasional Teknologi Informasi dan Bisnis (SENATIB) 2025, 2005, pp. 823–834.
[15] E. Boru Zega, W. Ginting, and R. Damanik, “Sistem Keamanan Login menggunakan Metode Autentikasi Dua Faktor dengan Verifikasi Gambar,” International Multidiciplinary Jpurnal , vol. 1, no. 02, pp. 25–35, 2025.
[16] K. Z. Yonatan, H. S. Utama, and Y. Calvinus, “Aplikasi Kendali ESP32 Menggunakan Sensor Sidik Jari pada Ponsel sebagai Lapisan Keamanan,” Aviation Electronics, Information Technology, Telecommunications, Electricals, Controls (AVITEC), vol. 6, no. 1, pp. 71–78, Feb. 2024, doi: https://doi.org/10.28989/avitec.v6i1.2049.
[17] Ardiansyah. M, Aldi Febryan, Adriani, and Rahmania, “Rancang Bangun Sistem Keamanan Rumah berbasis Telegram menggunakan ESP 32 Cam,” VERTEX ELEKTO: Jurnal Teknik Elektro UNISMUH, vol. 15, no. 1, pp. 64–71, 2023.
[18] H. Hardi, “Perancangan Prototype Mobil Remote Control dengan Smartphone Android menggunakan Bluetooth HC-05 berbasiskan Arduino Uno,” Jurnal Pengelolaan Laboratorium Sains dan Teknologi, vol. 2, no. 1, pp. 13–22, 2022, doi: https://doi.org/10.33369/labsaintek.v2i1.22003.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2026 Najma Hervina Pulungan, Ojak Abdul Rozak, Heri Kusnadi, Barru Arrosyid
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Jurnal Informatika Universitas Pamulang have CC-BY-NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work.
In developing strategy and setting priorities, Jurnal Informatika Universitas Pamulang recognize that free access is better than priced access, libre access is better than free access, and libre under CC-BY-NC or the equivalent is better than libre under more restrictive open licenses. We should achieve what we can when we can. We should not delay achieving free in order to achieve libre, and we should not stop with free when we can achieve libre.
Jurnal Informatika Universitas Pamulang is licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)
YOU ARE FREE TO:
- Share : copy and redistribute the material in any medium or format
- Adapt : remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms
This work is licensed under a 