Coded Prompts for Large Language Models

Ziqian Lin, Yicong Chen, Yuchen Zeng, Kangwook Lee

Keywords: Coded Prompts, Prompt Engineering

TL;DR: We propose coded prompts for inference LLMs with multiple inputs, providing a new angle to boost the performance and efficiency of LLMs.

Abstract: While Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks and various prompting techniques have been proposed, there remains room for performance enhancement. In this work, we introduce a novel dimension to prompt design -- *coded prompts* for LLM inference. Drawing inspiration from coding theory, where coded symbols communicate or store functions of multiple information symbols, we design coded prompts to process multiple inputs simultaneously. We validate this approach through experiments on two distinct tasks: identifying the maximum prime number within a range and sentence toxicity prediction. Our results indicate that coded prompts can indeed improve task performance. We believe that coded prompts will pave a new way for innovative strategies to enhance the efficiency and effectiveness of LLMs.

Submission Number: 93