Optimasi Random Forest dan Support Vector Machine untuk Prediksi Kelulusan Seleksi Mahasiswa Baru

Authors

  • Mohammad Romdhoni Teknik Informatika S-2, Program Pascasarjana, Universitas Pamulang, Kota Tangerang Selatan, Banten
  • Ahmad Musyafa Teknik Informatika S-2, Program Pascasarjana, Universitas Pamulang, Kota Tangerang Selatan, Banten
  • Sudarno Wiharjo Teknik Informatika S-2, Program Pascasarjana, Universitas Pamulang, Kota Tangerang Selatan, Banten

Keywords:

admission prediction, Grid Search, Random Forest, Support Vector Machine (SVM), student selection

Abstract

New student admission requires a reliable analytical mechanism because the characteristics of applicants and selection indicators differ across admission tracks. This study compares Random Forest and Support Vector Machine and evaluates Grid Search hyperparameter optimization for predicting admission outcomes at Politeknik STMI Jakarta. The dataset contains 6,338 applicant records from 2022–2025, divided into Achievement, Test, Joint, and UTBK tracks. Data were cleaned, transformed, normalized with MinMaxScaler, split using a stratified 80:20 scheme, and tuned through five-fold cross-validation. Performance was measured using accuracy, precision, recall, F1-score, and confusion matrix. Random Forest delivered the most consistent results, with accuracies of 92.75%, 93.04%, 80.56%, and 90.39% across the four tracks. Grid Search improved Random Forest accuracy by 1.27 percentage points on the Test track and 3.71 points on the Joint track, while no improvement occurred on the Achievement and UTBK tracks. The findings support track-specific model selection and position Random Forest as a decision-support tool, while class imbalance and label quality remain important implementation constraints.

Keywords: admission prediction; Grid Search; Random Forest; Support Vector Machine; student selection

 

References

[1] G. M. Agung, R. A. Zuama, and E. S. Budi, “Analysis of Student Academic Performance Using Random Forest and Support Vector Machines,” Computer Science (CO-SCIENCE), vol. 6, no. 1, pp. 57–65, 2026, doi: 10.31294/co-science.v6i1.10123.

[2] B. B. Alkan, S. Kuzucuk, N. Alkan, et al., “Using Machine Learning to Predict Student Outcomes for Early Intervention and Formative Assessment,” Scientific Reports, vol. 15, art. no. 39797, 2025, doi: 10.1038/s41598-025-23409-w.

[3] J. Bergstra and Y. Bengio, “Random Search for Hyper-Parameter Optimization,” Journal of Machine Learning Research, vol. 13, pp. 281–305, 2012.

[4] L. Breiman, “Random Forests,” Machine Learning, vol. 45, pp. 5–32, 2001, doi: 10.1023/A:1010933404324.

[5] M. Chen and Z. Liu, “Predicting Performance of Students by Optimizing Tree Components of Random Forest Using Genetic Algorithm,” Heliyon, vol. 10, no. 12, art. no. e32570, 2024, doi: 10.1016/j.heliyon.2024.e32570.

[6] C. Cortes and V. Vapnik, “Support-Vector Networks,” Machine Learning, vol. 20, pp. 273–297, 1995, doi: 10.1007/BF00994018.

[7] A. K. Darmawan, I. Yudhisari, A. Anwari, and M. Makruf, “Pola Prediksi Kelulusan Siswa Madrasah Aliyah Swasta dengan Support Vector Machine dan Random Forest,” Jurnal Minfo Polgan, vol. 12, no. 1, pp. 387–400, 2023, doi: 10.33395/jmp.v12i1.12388.

[8] S. Diantika, H. Nalatissifa, N. Maulidah, R. Supriyadi, and A. Fauzi, “Penerapan Teknik Random Oversampling untuk Memprediksi Ketepatan Waktu Lulus Menggunakan Algoritma Random Forest,” Computer Science (CO-SCIENCE), vol. 4, no. 1, pp. 11–18, 2024, doi: 10.31294/coscience.v4i1.1996.

[9] D. Hermanto, D. I. Ricoida, D. Pibriana, and M. R. Pribadi, “Analysis of Student Graduation Prediction Using Machine Learning Techniques on an Imbalanced Dataset: An Approach to Address Class Imbalance,” Scientific Journal of Informatics, vol. 11, no. 3, pp. 559–568, 2024, doi: 10.15294/sji.v11i3.5528.

[10] S. Hussain and M. Q. Khan, “Student-Performulator: Predicting Students’ Academic Performance at Secondary and Intermediate Level Using Machine Learning,” Annals of Data Science, vol. 10, no. 3, pp. 637–655, 2023, doi: 10.1007/s40745-021-00341-0.

[11] M. Imani, A. Beikmohammadi, and H. R. Arabnia, “Comprehensive Analysis of Random Forest and XGBoost Performance with SMOTE, ADASYN, and GNUS Under Varying Imbalance Levels,” Technologies, vol. 13, no. 3, art. no. 88, 2025, doi: 10.3390/technologies13030088.

[12] P. Jayadi, W. Bhagawan, and J. Aldida, “Class Balancing and Parameter Tuning of Machine Learning Models for Enhancing Aphrodisiac Herbal Plant Classification,” INISTA, vol. 7, no. 2, pp. 183–192, 2025, doi: 10.20895/inista.v7i2.1832.

[13] T. J. Law, C. Y. Ting, H. Ng, H. N. Goh, and Q. Albert, “A Review of Graduate on Time Prediction,” International Journal on Advanced Science, Engineering and Information Technology, vol. 14, no. 6, pp. 1957–1966, 2024, doi: 10.18517/ijaseit.14.6.17475.

[14] M. Nachouki, E. A. Mohamed, R. Mehdi, and M. Abou Naaj, “Student Course Grade Prediction Using the Random Forest Algorithm: Analysis of Predictors’ Importance,” Trends in Neuroscience and Education, vol. 33, art. no. 100214, 2023, doi: 10.1016/j.tine.2023.100214.

[15] N. S. Ngaeni, “Comparative Analysis of Random Forest and Support Vector Classifier for Predicting Students’ On-Time Graduation,” Jurnal Pilar Nusa Mandiri, vol. 21, no. 2, pp. 247–255, 2025, doi: 10.33480/pilar.v21i2.7048.

[16] F. Pedregosa et al., “Scikit-learn: Machine Learning in Python,” Journal of Machine Learning Research, vol. 12, pp. 2825–2830, 2011.

[17] L. S. Rodrigues, M. dos Santos, I. Costa, and M. A. L. Moreira, “Student Performance Prediction on Primary and Secondary Schools—A Systematic Literature Review,” Procedia Computer Science, vol. 214, pp. 680–687, 2022, doi: 10.1016/j.procs.2022.11.229.

[18] S. Junaidi, R. V. Anggela, and D. Kariman, “Klasifikasi Metode Data Mining untuk Prediksi Kelulusan Tepat Waktu Mahasiswa dengan Algoritma Naïve Bayes, Random Forest, Support Vector Machine dan Artificial Neural Network,” Journal of Applied Computer Science and Technology, vol. 5, no. 1, pp. 109–119, 2024, doi: 10.52158/jacost.v5i1.489.

[19] M. Yağcı, “Educational Data Mining: Prediction of Students’ Academic Performance Using Machine Learning Algorithms,” Smart Learning Environments, vol. 9, art. no. 11, 2022, doi: 10.1186/s40561-022-00192-z.

Downloads

Published

2026-07-31