Federated learning for privacy-preserving depression detection with multilingual language models in social media posts

Authors

Keywords:

Social media, Suicidal ideation, Computer science, Depression (economics), Machine learning, Artificial intelligence, Internet privacy, Mental health

Abstract

The incidences of mental health illnesses, such as suicidal ideation and depression, are increasing, which highlights the urgent need for early detection methods. There is a growing interest in using natural language processing (NLP) models to analyze textual data from patients, but accessing patients' data for research purposes can be challenging due to privacy concerns. Federated learning (FL) is a promising approach that can balance the need for centralized learning with data ownership sensitivity. In this study, we examine the effectiveness of FL models in detecting depression by using a simulated multilingual dataset. We analyzed social media posts in five different languages with varying sample sizes. Our findings indicate that FL achieves strong performance in most cases while maintaining clients' privacy for both independent and non-independent client partitioning.

Source and licence. Open-access article originally published as “Federated learning for privacy-preserving depression detection with multilingual language models in social media posts” in Patterns, 2024. DOI: 10.1016/j.patter.2024.100990. © Samar Samir Khalil, Noha S. Tawfik, Marco Spruit. Reproduced unchanged under the Creative Commons Attribution 4.0 licence.

References

Kingma, D., Ba, J. (2014). Adam: A Method for Stochastic Optimization. UvA-DARE (University of Amsterdam). https://doi.org/10.48550/arxiv.1412.6980

Rieke, N., Hancox, J., Li, W. et al. (2020). The future of digital health with federated learning. npj Digital Medicine. https://doi.org/10.1038/s41746-020-00323-1

Yu, B., Kumbier, K. (2018). Artificial intelligence and statistics. Frontiers of Information Technology & Electronic Engineering. https://doi.org/10.1631/fitee.1700813

Evans‐Lacko, S., Aguilar‐Gaxiola, S., Al-Hamzawi, A. et al. (2017). Socio-economic variations in the mental health treatment gap for people with anxiety, mood, and substance use disorders: results from the WHO World Mental Health (WMH) surveys. Psychological Medicine. https://doi.org/10.1017/s0033291717003336

Twenge, J. (2019). Why increases in adolescent depression may be linked to the technological environment. Current Opinion in Psychology. https://doi.org/10.1016/j.copsyc.2019.06.036

Ng, K., Tian, G., Tang, M. (2011). Dirichlet and Related Distributions: Theory, Methods and Applications.

Leis, Á., Ronzano, F., Mayer, M. et al. (2019). Detecting Signs of Depression in Tweets in Spanish: Behavioral and Linguistic Analysis. Journal of Medical Internet Research. https://doi.org/10.2196/14199

Омаров, Б. (2019). Dataset of depressive and suicidal posts. Data Archiving and Networked Services (DANS). https://doi.org/10.17632/838dbcjpxb.1

Downloads

Published

2026-08-22

How to Cite

Federated learning for privacy-preserving depression detection with multilingual language models in social media posts. (2026). QAIRU Journal, 1(2). https://ojs.bbx.kz/journal/article/view/6