Why have qualitative researchers historically been hesitant to adopt computational methods like NLP, and how have LLMs changed this?
Historically, qualitative researchers hesitated to adopt NLP because computational methods were seen as incompatible with interpretive analysis, and early NLP models lacked the ability to understand context and nuance. These limitations meant NLP was useful mainly for preprocessing large datasets, not for the close, context-sensitive reading qualitative scholars value. LLMs changed this because they can capture semantic meaning, subtle nuance, and context from vast unstructured texts, making them more compatible with inductive and interpretive qualitative approaches and shifting researcher acceptance.
Qualitative researchers traditionally prioritize close contact with data, attending to nuance, subtleties, and context. Computational methods were therefore perceived as incompatible with this interpretative orientation. Early NLP models, which operated on statistics, syntax, grammar rules, and dictionaries, could only identify general themes or predefined categories. As a result, qualitative researchers viewed them mainly as preprocessing tools for thematic analysis of large datasets, not as tools that could meaningfully support interpretive analysis. The limited capacity of these early models to grasp context and nuance reinforced the reluctance to adopt them. With recent advances in large language models, however, LLMs can capture semantic meaning, subtle nuance, and context across large unstructured text corpora. This overcomes the key limitation of earlier NLP models, allowing qualitative researchers to move beyond traditional automatic thematic analysis and explore new inductive and mixed-method approaches. Consequently, acceptance of these technologies has shifted, and some qualitative scholars now advocate for LLMs as rigorous methodological complements rather than replacements for interpretative work.
Key points
- Qualitative researchers historically saw computational methods as incompatible with interpretive analysis.
- Early NLP models were limited because they relied on statistics, syntax, grammar rules, and dictionaries, missing context and nuance.
- These early tools were typically used only for preprocessing and broad thematic analysis of large datasets.
- LLMs can now capture semantic meaning, subtle nuance, and context, addressing prior limitations.
- This capability has shifted researcher acceptance and opened new possibilities for inductive qualitative research.
Related questions
- According to the chapter, what are the main limitations of using ChatGPT for qualitative data analysis as identified in the studies by Hamilton et al. (2023) and Morgan (2023)?
- According to the chapter, what are the main capabilities of large language models (LLMs) that make them useful for inductive qualitative analysis?
AI for Qualitative Research: A Hands-On Guide for Management Scholars
Diana Garcia Quevedo
Palgrave Macmillan