Federated learning for privacy-preserving depression detection with multilingual language models in social media posts
Keywords:
Social media, Suicidal ideation, Computer science, Depression (economics), Machine learning, Artificial intelligence, Internet privacy, Mental healthAbstract
The incidences of mental health illnesses, such as suicidal ideation and depression, are increasing, which highlights the urgent need for early detection methods. There is a growing interest in using natural language processing (NLP) models to analyze textual data from patients, but accessing patients' data for research purposes can be challenging due to privacy concerns. Federated learning (FL) is a promising approach that can balance the need for centralized learning with data ownership sensitivity. In this study, we examine the effectiveness of FL models in detecting depression by using a simulated multilingual dataset. We analyzed social media posts in five different languages with varying sample sizes. Our findings indicate that FL achieves strong performance in most cases while maintaining clients' privacy for both independent and non-independent client partitioning.
Source and licence. Open-access article originally published as “Federated learning for privacy-preserving depression detection with multilingual language models in social media posts” in Patterns, 2024. DOI: 10.1016/j.patter.2024.100990. © Samar Samir Khalil, Noha S. Tawfik, Marco Spruit. Reproduced unchanged under the Creative Commons Attribution 4.0 licence.
References
Kingma, D., Ba, J. (2014). Adam: A Method for Stochastic Optimization. UvA-DARE (University of Amsterdam). https://doi.org/10.48550/arxiv.1412.6980
Rieke, N., Hancox, J., Li, W. et al. (2020). The future of digital health with federated learning. npj Digital Medicine. https://doi.org/10.1038/s41746-020-00323-1
Yu, B., Kumbier, K. (2018). Artificial intelligence and statistics. Frontiers of Information Technology & Electronic Engineering. https://doi.org/10.1631/fitee.1700813
Evans‐Lacko, S., Aguilar‐Gaxiola, S., Al-Hamzawi, A. et al. (2017). Socio-economic variations in the mental health treatment gap for people with anxiety, mood, and substance use disorders: results from the WHO World Mental Health (WMH) surveys. Psychological Medicine. https://doi.org/10.1017/s0033291717003336
Twenge, J. (2019). Why increases in adolescent depression may be linked to the technological environment. Current Opinion in Psychology. https://doi.org/10.1016/j.copsyc.2019.06.036
Ng, K., Tian, G., Tang, M. (2011). Dirichlet and Related Distributions: Theory, Methods and Applications.
Leis, Á., Ronzano, F., Mayer, M. et al. (2019). Detecting Signs of Depression in Tweets in Spanish: Behavioral and Linguistic Analysis. Journal of Medical Internet Research. https://doi.org/10.2196/14199
Омаров, Б. (2019). Dataset of depressive and suicidal posts. Data Archiving and Networked Services (DANS). https://doi.org/10.17632/838dbcjpxb.1
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Samar Samir Khalil, Noha S. Tawfik, Marco Spruit

This work is licensed under a Creative Commons Attribution 4.0 International License.
Articles are published under the Creative Commons Attribution 4.0 International licence (CC BY 4.0).