Physics-aware 3d mesh synthesis

Yihui He

Abstract: This paper proposes a new task which emphasizes the importance of past-designs in 3D mesh synthesis. Instead of synthesizing novel meshes from scratch, we introduce a physics-aware 3D mesh synthesis algorithm, which consists of two modules: a 3D mesh synthesis module where we use a VAEGAN to encode 3D meshes into a latent variable and use the decoder to generate 3D meshes from the encoded representations; a scientific decision making module using reinforcement learning which alters the latent representation supervised by a provided physical constraint. The results show that our approach can modify a given mesh so that it satisfies external physical property constraints while maintaining high appearance similarity. More importantly, our method outperforms all baseline methods by a large margin.