Resumo

JIMENEZ, Diana et al. PoSLemma: How Traditional Machine Learning and Linguistics Preprocessing Aid in Machine Generated Text Detection. Comp. y Sist. [online]. 2023, vol.27, n.4, pp.921-928.  Epub 17-Maio-2024. ISSN 2007-9737.  https://doi.org/10.13053/cys-27-4-4778.

With the release of several Large Language Models (LLMs) to the public, concerns have emerged regarding their ethical implications and potential misuse. This paper proposes an approach to address the need for technologies that can distinguish between text sequences generated by humans and those produced by LLMs. The proposed method leverages traditional Natural Language Processing (NLP) feature extraction techniques focusing on linguistic properties, and traditional Machine Learning (ML) methods like Logistic Regression and Support Vector Machines (SVMs). We also compare this approach with an ensemble of Long-Short Term Memory (LSTM) networks, each analyzing different paradigms of Part of Speech (PoS) taggings. Our traditional ML models achieved F1 scores of 0.80 and 0.72 in the respective analyzed tasks.

Palavras-chave : Generative text detection; text generation; AuTexTification; logistic regression; support vector machine (SVM); classification.