LG AI Research 提出 Segment-based Topic Allocation：ACL 2026 论文重构主题建模

Hoonsang Yoon

2026.08.14

Image 1. Topic modeling learns two probability distributions—the topic-to-word distribution (φ) and the document-to-topic distribution (θ). However, estimating topic prevalence at the corpus level typically requires assigning each document to a single representative topic. As a result, a document such as "Tasty food, slow service, a bit pricey.", which naturally contains multiple topics, may be assigned only to FOOD, causing topic contamination by incorrectly attributing service- and price-related content to the FOOD topic. [1]

Image 2. Document-based Topic Allocation (DBTA, left) retrieves entire documents when identifying a topic such as PRICE, even if only a small portion of the document is actually related to pricing. In contrast, Segment-based Topic Allocation (SBTA, right) extracts and groups only the text segments that are semantically relevant to the target topic, resulting in more precise topic assignment, higher semantic purity, and greater interpretability. [1]

Image 3. Performance comparison on the SemEval-STM benchmark (Laptop domain; scores normalized across evaluation metrics). LLM-based topic modeling with Segment-based Topic Allocation (SBTA)—including LLaMA and DeepSeek— consistently outperforms traditional topic modeling methods such as LDA and BERTopic across all evaluation metrics, including F1, Purity, Adjusted Rand Index (ARI), Normalized Mutual Information (NMI), and the Calinski–Harabasz (CH) Index. [1]

Number of intruders: one or two intruder segments; Difficulty level: easy or hard. In the hard setting, the intruder is sampled from a different topic within the same domain, making it substantially more difficult to distinguish from the target topic than an intruder drawn from another domain

Image 4. Segment Intrusion extends the classic Word Intrusion task from individual words to semantically coherent text segments. In the traditional Word Intrusion setting (①), evaluators identify an out-of-place word (e.g., "pizza") that does not belong to the topic. In Segment Intrusion (②), evaluators instead identify an intruder segment within a group of segments assigned to the same topic. For example, among segments labeled PRICE, the sentence "The battery lasts all day." — which discusses DESIGN rather than pricing—is correctly identified as the intruder. By operating on complete semantic units rather than isolated words, Segment Intrusion provides a more intuitive and reliable way to evaluate topic coherence. [1]

Image 5. F1 scores on the Segment Intrusion benchmark. As the task becomes more challenging—from SI-E (Segment Intrusion–Easy) to DI-H (Domain Intrusion–Hard)—performance consistently declines for both human evaluators and all evaluated LLMs. While current frontier models demonstrate strong capabilities, most still fall short of human-level performance, particularly under the most difficult evaluation settings. These results highlight the increasing difficulty of distinguishing semantically similar topics and demonstrate that Segment Intrusion provides a challenging and discriminative benchmark for evaluating topic coherence. [1]

[1] Hoonsang Yoon, Takyoung Kim, Wonkee Lee, Ilmin Cho, Dilek Hakkani-Tur, Stanley Jungkyu Choi. “From Documents to Segments: A Contextual Reformulation for Topic Assignment.” Findings of ACL 2026. (Dataset: https://huggingface.co/datasets/LG-AI-Research/SemEval-STM)

[2] David M. Blei, Andrew Y. Ng, Michael I. Jordan. “Latent Dirichlet Allocation.” JMLR, 2003.

[3] Maarten Grootendorst. “BERTopic: Neural topic modeling with a class-based TF-IDF procedure.” 2022.

[4] Chau Minh Pham et al. “TopicGPT: A Prompt-based Topic Modeling Framework.” NAACL, 2024.

[5] Jonathan Chang et al. “Reading Tea Leaves: How Humans Interpret Topic Models.” NeurIPS, 2009.

[6] Maria Pontiki et al. “SemEval-2016 Task 5: Aspect Based Sentiment Analysis.” SemEval, 2016.