Services on Demand
Journal
Article
Indicators
Cited by SciELO
Access statistics
Related links
Similars in SciELO
Share
Computación y Sistemas
On-line version ISSN 2007-9737Print version ISSN 1405-5546
Abstract
ADEBANJI, Olaronke O. et al. Adaptation of Transformer-Based Models for Depression Detection. Comp. y Sist. [online]. 2024, vol.28, n.1, pp.151-165. Epub June 10, 2024. ISSN 2007-9737. https://doi.org/10.13053/cys-28-1-4691.
Pre-trained language models are able to capture a broad range of knowledge and language patterns in text and can be fine-tuned for specific tasks. In this paper, we focus on evaluating the effectiveness of various traditional machine learning and pre-trained language models in identifying depression through the analysis of text from social media. We examined different feature representations with the traditional machine learning models and explored the impact of pre-training on the transformer models and compared their performance. Using BoW, Word2Vec, and GloVe representations, the machine learning models with which we experimented achieved impressive accuracies in the task of detecting depression. However, pre-trained language models exhibited outstanding performance, consistently achieving high accuracy, precision, recall, and F1 scores of approximately 0.98 or higher.
Keywords : Depression; bag-of-words; word2vec; GloVe; machine learning; deep learning; transformers; sentiment analysis.
![](/img/en/iconPDFDocument.gif)