Collaboration of Large and Small Models for Event Type Discovery in Completely Open Domains

Abstract

Event type discovery in open domains aims to automate the induction of event types from completely unlabeled text data. Conventionally, small models utilize clustering techniques to address this task. Nonetheless, the fully unsupervised nature of these methods results in suboptimal performance by small models in this context. Recently, large language models (LLMs) have demonstrated excellent capabilities in contextual understanding, providing additional relevant information for specific task scenarios, albeit with challenges in precision and cost effectiveness. In this paper, we use LLM to guide the clustering of event texts and distill this process into a fine-tuning task for training smaller pre-trained language models. This approach enables effective event type discovery even in scenarios lacking annotated data. The study unfolds in three stages: in action acquisition, leveraging LLMs to extract type-relevant information from each event text, ensuring that the event representations are particular to task-specific details; in clustering refinement and dual-fine-tune, LLMs refine results from both task-agnostic and task-specific perspectives, with the refinement process designed as fine-tuning tasks under different viewpoints to adjust encoders; and in type generation, post-clustering, LLMs generate meaningful event type labels for each cluster. Experiments show that our method outperforms current state-of-the-art approaches and excels in event type discovery tasks even in completely open-domain with no labeled data.

Keywords

• event type discovery
• open domains
• large language model
• text clustering