MMHOI: Modeling Complex 3D Multi-Human Multi-Object Interactions

Kaen Kogashi, Anoop Cherian

Keywords: Multi-Human-Object 3D dataset

Abstract: Real‑world scenes often feature multiple humans interacting with multiple objects in ways that are causal, goal‑oriented, or cooperative. Yet existing 3D human-object interaction (HOI) benchmarks consider only a fraction of these complex interactions. To close this gap, we present MMHOI -- a large-scale, Multi-human Multi-object Interaction dataset consisting of images from 12 everyday scenarios. MMHOI offers complete 3D shape and pose annotations for every person and object, along with labels for 78 action categories and 14 interaction‑specific body parts, providing a comprehensive testbed for next-generation HOI research. We evaluate MMHOI against state-of-the-art methods for multi-human reconstruction and single human–object interaction prediction, clearly highlighting the performance gap that our dataset introduces. The MMHOI dataset is made publicly available.

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Number: 12