Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry WritingDownload PDF

21 Nov 2022, 19:10 (modified: 14 Jan 2023, 18:03)creativeAIReaders: Everyone
Keywords: text generation, poetry writing, human AI collaboration, instruction tuning
TL;DR: In this paper, we aim to understand the collaboration capabilities of instruction tuned LLMs through a case study of collaborative poetry writing.
Abstract: Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted creativity, we aim to study if LLMs can improve the quality of user-generated content through collaboration. We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about `love' or Write a sentence ending in `fly'. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive with publicly available LLMs trained on instructions (InstructGPT), but is also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from \textit{Monarchy} to \textit{Climate change}. Further, the collaboratively written poems are preferred by third-party evaluators over those written without the system.
0 Replies

Loading