Unreal Engine Based MCS Program Using Microcontroller Wemos D1 Mini, MPU-9250 Sensor and UDP Protocol
DOI:
https://doi.org/10.32493/pjte.v8i1.40210Keywords:
Motion Capture System, Unreal Engine, MPU-9250 Sensor, Wemos, UDP ProtocolAbstract
The Motion Capture System (MCS) is a series of steps involving the capture, processing, and mapping of human, animal, or object movements into virtual characters. This process includes motion recording, data processing with computers, and mapping the results into digital models. This article discusses the use of MCS for realistically reconstructing and simulating behavior, which is valuable in various applications such as entertainment, animation, computer games, sports, and rehabilitation. MCS faces challenges in accurately capturing the diversity and complexity of body movements, requiring advanced hardware and software. Unreal Engine, a development platform known for its ability to produce high-quality graphics and realistic physics systems, is often used to integrate MCS. The MPU9250 sensor, a 9-axis inertial sensor combining an accelerometer, gyroscope, and magnetometer, is used in this project to detect linear motion, rotation, and orientation with high accuracy. This research aims to develop an MCS program based on Unreal Engine using the MPU9250 sensor and the UDP protocol, with the Wemos D1 Mini as the client module to process and transmit sensor data via Wi-Fi. This process involves collecting sensor data, transmitting data via UDP, and processing the data in Unreal Engine to control the movement of objects or characters. Sensor calibration is performed to obtain accurate reference values, and the collected data is used to calculate pitch, roll, and yaw values. This data is then sent to Unreal Engine to display animations corresponding to human movements. Testing shows that the generated movements align with those demonstrated, although there are minor acceptable errors. This research highlights the importance of combining sensor technology and software to produce an accurate and responsive motion control system, providing an interactive and realistic user experience.
References
[1] A. S. Reuter and M. Schindler, “Motion Capture Systems and Their Use in Educational Research: Insights from a Systematic Literature Review,” Educ. Sci., vol. 13, no. 2, 2023, doi: 10.3390/educsci13020167.
[2] S. Salisu, N. I. R. Ruhaiyem, T. A. E. Eisa, M. Nasser, F. Saeed, and H. A. Younis, “Motion Capture Technologies for Ergonomics: A Systematic Literature Review,” Diagnostics, vol. 13, no. 15, pp. 1–16, 2023, doi: 10.3390/diagnostics13152593.
[3] M. Menolotto, D. S. Komaris, S. Tedesco, B. O’flynn, and M. Walsh, “Motion capture technology in industrial applications: A systematic review,” Sensors (Switzerland), vol. 20, no. 19, pp. 1–25, 2020, doi: 10.3390/s20195687.
[4] F. Gifari, A. Siswo, R. Ansori, and F. C. Hasibuan, “Pengembangan Motion Capture Lima Jari Dengan Algoritma Complementary Filter Development Of Five Finger Motion Capture With Complementary Filter Algorithm,” Bandung Univ. Telkom, vol. 8, no. 6, pp. 12039–12047, 2021.
[5] R. Haratian, “Motion Capture Sensing Technologies and Techniques: A Sensor Agnostic Approach to Address Wearability Challenges,” Sens. Imaging, vol. 23, no. 1, pp. 1–21, 2022, doi: 10.1007/s11220-022-00394-2.
[6] A. Vershinina, “Applications of Game Engine technologies : Unreal Engine 5,” no. March, 2023, doi: 10.2139/ssrn.300333022.
[7] R. Ramdan, L. Lasmadi, and P. Setiawan, “Sistem Pengendali On-Off Lampu dan Motor Servo sebagai Penggerak Gerendel Pintu Berbasis Internet Of Things (IoT),” Avitec, vol. 4, no. 2, p. 211, 2022, doi: 10.28989/avitec.v4i2.1317.
[8] W. Aditya and S. Subektiningsih, “Schedule Cat Feeder Berbasis Internet of Things Menggunakan Wemos D1 Mini dan Telegram,” J. Teknol. Inf. dan Ilmu Komput., vol. 11, no. 1, pp. 183–190, 2024, doi: 10.25126/jtiik.20241117847.
[9] W. Suryono, A. Setiyo Prabowo, Suhanto, and A. Mu’Ti Sazali, “Monitoring and controlling electricity consumption using Wemos D1 Mini and smartphone,” IOP Conf. Ser. Mater. Sci. Eng., vol. 909, no. 1, 2020, doi: 10.1088/1757-899X/909/1/012014.
[10] M. A. Nursyeha, R. H. Saputra, H. Aprillia, and F. R. Irwansyah, “Implementasi Sensor Inertial Measurement Unit untuk Sistem Odometri Kendaraan Otonom,” SPECTA J. Technol., vol. 7, no. 2, pp. 556–565, 2023, doi: 10.35718/specta.v7i2.784.
[11] B. Darmawan, D. Syauqy, M. Hannats, and H. Ichsan, “Rancang Bangun View controller Menggunakan Sensor Akselerometer Pada Game Bus Simulator Sebagai Sarana User Experience ( UX ) Berbasis Sistem Embedded,” Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 3, no. 2, pp. 1883–1891, 2019.
[12] A. D. Fakhrudin, N. Fahmi, A. Hakim, A. Heri, and S. Budi, “Implementasi Protokol TCP dan UDP pada Sistem Monitoring dan Otomasi Rumah Jamur Berorientasi WSN Implementation of TCP and UDP Protocols on WSN-Oriented Mushroom House Monitoring and Automation System,” Telka, vol. 9, no. 2, pp. 130–144, 2023.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Frengki Simatupang, Istas Pratomo Manalu
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
