Narrative understanding for Cinema domain large language model

Siqi Shen, Amanmeet Garg

Keywords: narrative understanding, domain adapation, LLM, instruction finetuning

TL;DR: We introduce narrative understanding tasks for adapting LLMs to the cinematic domain by constructs a dataset and evaluating various domain adaptation strategies.

Abstract:

Large language models (LLMs) have been deployed in a wide spectrum of domains and applications due to their strong language understanding capabilities obtained through pretraining. However, their performance on specific domain is usually suboptimal due to limited exposure to domain-specific tasks. Adapting LLM to the cinematic domain post unique challenges as it consists of complicated stories with limited textual information accessible from the subtitle or script alone.

In this paper, we decompose the movie understanding capability into a suite of narrative understanding tasks based on narrative theory. We construct a dataset for these tasks based on resources in the movie domain, and use it to examine the effect of different domain adaptation strategies. Both the dataset and the models are made publicly available.
Our experiment results show the effectiveness of our approach in improving the narrative understanding of LLMs and highlight the trade-offs between domain-specific and general instruction capabilities.

Submission Number: 110