Collaborative Robotic Painting and Paint Mixing Demonstration

Jiaying Wei, Peter Schaldenbrand, Joong Ho Choi, Eunsu Kang, Jean Oh

Abstract: We are proposing to demonstrate a new approach for pigment auto-mixing in a robotic painting system designed to support human creativity through visual art. The novelty of the proposed approach comes from the seamless integration of physical pigments into the painting planning process, achieving adaptive paint mixing during the painting process. Our approach does not require specialized equipment beyond a robot arm and a camera, providing broad opportunities for public and educational usage. This demo aims to upgrade the virtual, pixel-based experience of AI-supported art to a real-world tangible, creative experience. Participants engage in the process both by providing input for the robot such as images, text prompts, or audio, and also by providing physical selections of pigment for the robot. We hope that this demo motivates attendees to work on more systems that can support and augment human creativity.