Benchmarking Classical Machine Learning Models for College Student Mental Health Screening Using Passive Sensing Data

Authors

  • Prajoko Universitas Muhammadiyah Sukabumi
  • Didik Indrayana Universitas Muhammadiyah Sukabumi
  • Agung Pambudi

Keywords:

college student mental health, machine learning, passive sensing, screening

Abstract

Mental health risk screening among college students can be supported by passive smartphone sensing, but model selection remains difficult because these data are heterogeneous, incomplete, and strongly imbalanced. This study establishes a reproducible benchmark of five classical single-model machine learning algorithms—Logistic Regression, Support Vector Machine, k-Nearest Neighbors, Naive Bayes, and Decision Tree—using the publicly available StudentLife dataset. The final analysis included 45 participants and five daily behavioral features, with depression risk defined as PHQ-9 ≥ 10. A uniform preprocessing pipeline was applied within training folds, and 5-fold GroupKFold cross-validation was used to prevent cross-subject information leakage. Performance was measured using AUROC, AUPRC, F1-score, precision, and recall, with AUPRC and recall emphasized because the positive-risk class represented approximately 11.1% of participants. Robustness was additionally examined by simulating 10% and 30% missing feature values. Decision Tree achieved the highest AUROC (0.564 ± 0.144), F1-score (0.210 ± 0.087), and recall (0.480 ± 0.179), while Decision Tree and SVM obtained the same mean AUPRC (0.164). The overlapping variability and modest absolute performance indicate that these results should be interpreted as preliminary benchmark evidence rather than definitive model superiority. The benchmark provides a transparent baseline for future work on temporal modeling, explainability, and privacy-aware student mental health screening.

Author Biographies

Didik Indrayana, Universitas Muhammadiyah Sukabumi

Department of informatics Engoneering

Agung Pambudi

Department Of Informatics Engineering

References

1] M. M. Qirtas, E. Zafeiridi, E. B. White, and D. Pesch, “The relationship between loneliness and depression among college students: Mining data derived from passive sensing,” Digit. Health, vol. 9, Jan. 2023, doi: 10.1177/20552076231211104.

[2] W. Wang et al., “First-Gen Lens: Assessing mental health of first-generation students across their first year at college using mobile sensing,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 6, no. 2, Jul. 2022, doi: 10.1145/3543194.

[3] N. N. I. Moubarak, N. M. M. Omar, and V. N. Youssef, “Smartphone-sensor-based human activities classification for forensics: a machine learning approach,” Journal of Electrical Systems and Information Technology, vol. 11, no. 1, p. 33, Aug. 2024, doi: 10.1186/s43067-024-00157-x.

[4] M. Ehsan, “Comparison of the Predictive Models of Human Activity Recognition (HAR) in Smartphones,” UMT Artificial Intelligence Review, vol. 1, no. 2, pp. 27–35, Dec. 2021, doi: 10.32350/AIR.0102.03.

[5] R. Wang et al., “StudentLife: Assessing mental health, academic performance and behavioral trends of college students using smartphones,” in UbiComp 2014 - Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Association for Computing Machinery, Inc., 2014, pp. 3–14, doi: 10.1145/2632048.2632054.

[6] S. Akbarova et al., “Improving Depression Severity Prediction from Passive Sensing: Symptom-Profiling Approach,” Sensors (Basel), vol. 23, no. 21, Oct. 2023, doi: 10.3390/s23218866.

[7] L. MacLeod et al., “A mobile sensing app to monitor youth mental health: Observational pilot study,” JMIR Mhealth Uhealth, vol. 9, no. 10, Oct. 2021, doi: 10.2196/20638.

[8] Y. Terhorst, E. M. Messner, K. O. Asare, C. Montag, C. Kannen, and H. Baumeister, “Investigating Smartphone-Based Sensing Features for Depression Severity Prediction: Observation Study,” J. Med. Internet Res., vol. 27, 2025, doi: 10.2196/55308.

[9] Y. Zhang et al., “Large-scale digital phenotyping: Identifying depression and anxiety indicators in a general UK population with over 10,000 participants,” J. Affect. Disord., vol. 375, pp. 412–422, Apr. 2025, doi: 10.1016/j.jad.2025.01.124.

[10] E. Kerz, S. Zanwar, Y. Qiao, and D. Wiechmann, “Toward explainable AI (XAI) for mental health detection based on language behavior,” Front Psychiatry, vol. 14, Dec. 2023, doi: 10.3389/fpsyt.2023.1219479.

[11] V. Quang Tran and H. Byeon, “Explainable hybrid tabular Variational Autoencoder and feature Tokenizer Transformer for depression prediction,” Expert Syst. Appl., vol. 265, Mar. 2025, doi: 10.1016/j.eswa.2024.126084.

[12] B. Zou et al., “Sequence Modeling of Passive Sensing Data for Treatment Response Prediction in Major Depressive Disorder,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 1786–1795, 2023, doi: 10.1109/TNSRE.2023.3260301.

[13] A. Perez-Lebel, G. Varoquaux, M. Le Morvan, J. Josse, and J.-B. Poline, “Benchmarking missing-values approaches for predictive models on health databases,” Feb. 2022. [Online]. Available: http://arxiv.org/abs/2202.10580.

[14] S. U. Rehman, A. Ali, A. M. Khan, and C. Okpala, “Human Activity Recognition: A Comparative Study of Validation Methods and Impact of Feature Extraction in Wearable Sensors,” Algorithms, vol. 17, no. 12, Dec. 2024, doi: 10.3390/a17120556.

[15] M. F. Tørring, A. Logacjov, S. M. Brændvik, A. Ustad, K. Roeleveld, and E. M. Bardal, “Validation of two novel human activity recognition models for typically developing children and children with Cerebral Palsy,” PLoS One, vol. 19, no. 9, Sep. 2024, doi: 10.1371/journal.pone.0308853.

[16] F. M. Calatrava-Nicolás, S. Miyauchi, V. F. Rey, P. Lukowicz, T. Stoyanov, and O. M. Mozos, “Embedded Inter-Subject Variability in Adversarial Learning for Inertial Sensor-Based Human Activity Recognition,” in IEEE International Workshop on Machine Learning for Signal Processing (MLSP), IEEE Computer Society, 2025, doi: 10.1109/MLSP62443.2025.11204225.

[17] S. R. Pfohl, A. Foryciarz, and N. H. Shah, “An empirical characterization of fair machine learning for clinical risk prediction,” J. Biomed. Inform., vol. 113, Jan. 2021, doi: 10.1016/j.jbi.2020.103621.

[18] B. Lamichhane, N. Moukaddam, and A. Sabharwal, “Mobile sensing-based depression severity assessment in participants with heterogeneous mental health conditions,” Sci. Rep., vol. 14, no. 1, p. 18808, Aug. 2024, doi: 10.1038/s41598-024-69739-z.

[19] S. Rajaraman, P. Ganesan, and S. Antani, “Deep learning model calibration for improving performance in class-imbalanced medical image classification tasks,” PLoS One, vol. 17, no. 1, Jan. 2022, doi: 10.1371/journal.pone.0262838.

[20] W. R. Ringwald, G. King, C. E. Vize, and A. G. C. Wright, “Passive Smartphone Sensors for Detecting Psychopathology,” JAMA Netw. Open, vol. 8, no. 7, Jul. 2025, doi: 10.1001/jamanetworkopen.2025.19047.

Published

2026-09-30