Topic Model Validation Methods and their Impact on Model Selection and Evaluation | Amsterdam University Press Journals Online
2004
Volume 5, Issue 1
  • E-ISSN: 2665-9085

Abstract

Topic Modeling is currently one of the most widely employed unsupervised text-as-data techniques in the field of communication science. While researchers increasingly recognize the importance of validating topic models and given the prevalence of discussions of inadequate validation practices in the literature, there is limited understanding of the consequences of employing different validation strategies when evaluating topic models. This study applies two different methods for topic modeling to the same text corpus. It uses four validation strategies to assess how the choice of validation method affects the final model selection and evaluation. Our findings indicate that different approaches and methods lead to different model choices and evaluations, which is problematic. This might lead to unwanted results in case the choice of model has a decisive impact on findings and, consequently, on theory development and practical implications.

Loading

Article metrics loading...

/content/journals/10.5117/CCR2023.1.13.BERN
2023-01-01
2024-05-27
Loading full text...

Full text loading...

http://instance.metastore.ingenta.com/content/journals/10.5117/CCR2023.1.13.BERN
Loading
  • Article Type: Research Article
Keyword(s): computational communication methods; evaluation; topic model; validation
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error