Benchmarking Classical Machine Learning Models for College Student Mental Health Screening Using Passive Sensing Data
Keywords:
college student mental health, machine learning, passive sensing, screeningAbstract
Mental health risk screening among college students can be supported by passive smartphone sensing, but model selection remains difficult because these data are heterogeneous, incomplete, and strongly imbalanced. This study establishes a reproducible benchmark of five classical single-model machine learning algorithms—Logistic Regression, Support Vector Machine, k-Nearest Neighbors, Naive Bayes, and Decision Tree—using the publicly available StudentLife dataset. The final analysis included 45 participants and five daily behavioral features, with depression risk defined as PHQ-9 ≥ 10. A uniform preprocessing pipeline was applied within training folds, and 5-fold GroupKFold cross-validation was used to prevent cross-subject information leakage. Performance was measured using AUROC, AUPRC, F1-score, precision, and recall, with AUPRC and recall emphasized because the positive-risk class represented approximately 11.1% of participants. Robustness was additionally examined by simulating 10% and 30% missing feature values. Decision Tree achieved the highest AUROC (0.564 ± 0.144), F1-score (0.210 ± 0.087), and recall (0.480 ± 0.179), while Decision Tree and SVM obtained the same mean AUPRC (0.164). The overlapping variability and modest absolute performance indicate that these results should be interpreted as preliminary benchmark evidence rather than definitive model superiority. The benchmark provides a transparent baseline for future work on temporal modeling, explainability, and privacy-aware student mental health screening.
References
1] M. M. Qirtas, E. Zafeiridi, E. B. White, and D. Pesch, “The relationship between loneliness and depression among college students: Mining data derived from passive sensing,” Digit. Health, vol. 9, Jan. 2023, doi: 10.1177/20552076231211104.
[2] W. Wang et al., “First-Gen Lens: Assessing mental health of first-generation students across their first year at college using mobile sensing,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 6, no. 2, Jul. 2022, doi: 10.1145/3543194.
[3] N. N. I. Moubarak, N. M. M. Omar, and V. N. Youssef, “Smartphone-sensor-based human activities classification for forensics: a machine learning approach,” Journal of Electrical Systems and Information Technology, vol. 11, no. 1, p. 33, Aug. 2024, doi: 10.1186/s43067-024-00157-x.
[4] M. Ehsan, “Comparison of the Predictive Models of Human Activity Recognition (HAR) in Smartphones,” UMT Artificial Intelligence Review, vol. 1, no. 2, pp. 27–35, Dec. 2021, doi: 10.32350/AIR.0102.03.
[5] R. Wang et al., “StudentLife: Assessing mental health, academic performance and behavioral trends of college students using smartphones,” in UbiComp 2014 - Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Association for Computing Machinery, Inc., 2014, pp. 3–14, doi: 10.1145/2632048.2632054.
[6] S. Akbarova et al., “Improving Depression Severity Prediction from Passive Sensing: Symptom-Profiling Approach,” Sensors (Basel), vol. 23, no. 21, Oct. 2023, doi: 10.3390/s23218866.
[7] L. MacLeod et al., “A mobile sensing app to monitor youth mental health: Observational pilot study,” JMIR Mhealth Uhealth, vol. 9, no. 10, Oct. 2021, doi: 10.2196/20638.
[8] Y. Terhorst, E. M. Messner, K. O. Asare, C. Montag, C. Kannen, and H. Baumeister, “Investigating Smartphone-Based Sensing Features for Depression Severity Prediction: Observation Study,” J. Med. Internet Res., vol. 27, 2025, doi: 10.2196/55308.
[9] Y. Zhang et al., “Large-scale digital phenotyping: Identifying depression and anxiety indicators in a general UK population with over 10,000 participants,” J. Affect. Disord., vol. 375, pp. 412–422, Apr. 2025, doi: 10.1016/j.jad.2025.01.124.
[10] E. Kerz, S. Zanwar, Y. Qiao, and D. Wiechmann, “Toward explainable AI (XAI) for mental health detection based on language behavior,” Front Psychiatry, vol. 14, Dec. 2023, doi: 10.3389/fpsyt.2023.1219479.
[11] V. Quang Tran and H. Byeon, “Explainable hybrid tabular Variational Autoencoder and feature Tokenizer Transformer for depression prediction,” Expert Syst. Appl., vol. 265, Mar. 2025, doi: 10.1016/j.eswa.2024.126084.
[12] B. Zou et al., “Sequence Modeling of Passive Sensing Data for Treatment Response Prediction in Major Depressive Disorder,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 1786–1795, 2023, doi: 10.1109/TNSRE.2023.3260301.
[13] A. Perez-Lebel, G. Varoquaux, M. Le Morvan, J. Josse, and J.-B. Poline, “Benchmarking missing-values approaches for predictive models on health databases,” Feb. 2022. [Online]. Available: http://arxiv.org/abs/2202.10580.
[14] S. U. Rehman, A. Ali, A. M. Khan, and C. Okpala, “Human Activity Recognition: A Comparative Study of Validation Methods and Impact of Feature Extraction in Wearable Sensors,” Algorithms, vol. 17, no. 12, Dec. 2024, doi: 10.3390/a17120556.
[15] M. F. Tørring, A. Logacjov, S. M. Brændvik, A. Ustad, K. Roeleveld, and E. M. Bardal, “Validation of two novel human activity recognition models for typically developing children and children with Cerebral Palsy,” PLoS One, vol. 19, no. 9, Sep. 2024, doi: 10.1371/journal.pone.0308853.
[16] F. M. Calatrava-Nicolás, S. Miyauchi, V. F. Rey, P. Lukowicz, T. Stoyanov, and O. M. Mozos, “Embedded Inter-Subject Variability in Adversarial Learning for Inertial Sensor-Based Human Activity Recognition,” in IEEE International Workshop on Machine Learning for Signal Processing (MLSP), IEEE Computer Society, 2025, doi: 10.1109/MLSP62443.2025.11204225.
[17] S. R. Pfohl, A. Foryciarz, and N. H. Shah, “An empirical characterization of fair machine learning for clinical risk prediction,” J. Biomed. Inform., vol. 113, Jan. 2021, doi: 10.1016/j.jbi.2020.103621.
[18] B. Lamichhane, N. Moukaddam, and A. Sabharwal, “Mobile sensing-based depression severity assessment in participants with heterogeneous mental health conditions,” Sci. Rep., vol. 14, no. 1, p. 18808, Aug. 2024, doi: 10.1038/s41598-024-69739-z.
[19] S. Rajaraman, P. Ganesan, and S. Antani, “Deep learning model calibration for improving performance in class-imbalanced medical image classification tasks,” PLoS One, vol. 17, no. 1, Jan. 2022, doi: 10.1371/journal.pone.0262838.
[20] W. R. Ringwald, G. King, C. E. Vize, and A. G. C. Wright, “Passive Smartphone Sensors for Detecting Psychopathology,” JAMA Netw. Open, vol. 8, no. 7, Jul. 2025, doi: 10.1001/jamanetworkopen.2025.19047.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2026 Prajoko, Didik Indrayana, Agung Pambudi

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Jurnal Informatika Universitas Pamulang have CC-BY-NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work.
In developing strategy and setting priorities, Jurnal Informatika Universitas Pamulang recognize that free access is better than priced access, libre access is better than free access, and libre under CC-BY-NC or the equivalent is better than libre under more restrictive open licenses. We should achieve what we can when we can. We should not delay achieving free in order to achieve libre, and we should not stop with free when we can achieve libre.
Jurnal Informatika Universitas Pamulang is licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)
YOU ARE FREE TO:
- Share : copy and redistribute the material in any medium or format
- Adapt : remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms

