Point-Focused Attention Meets Context-Scan State Space: Robust Biological Visual Perception for Point Cloud Representation

ICLR 2026 Conference Submission21998 Authors

Keywords: Point cloud learning, Attention mechanism, State space model, Biomimetic vision

TL;DR: A point cloud representation learning network inspired by biological vision mechanisms.

Abstract: Synergistically capturing intricate local structures and global contextual dependencies has become a critical challenge in point cloud representation learning. To address this, we introduce PointLearner, a point cloud representation learning network that closely aligns with biological vision which employs an active, foveation-inspired processing strategy, thus enabling local geometric modeling and long-range dependency interactions simultaneously. Specifically, we first design a point-focused attention, which simulates foveal vision at the visual focus through a competitive normalized attention mechanism between local neighbors and spatially downsampled features. The spatially downsampled features are extracted by a pooling method based on learnable inducing points, which can flexibly adapt to the non-uniform distribution of point clouds as the number of inducing points is controlled and they interact directly with point clouds. Second, we propose a context-scan state space that mimics eye's saccade inference, which infers the overall semantic structure and spatial content in the scene through a scan path guided by the Hilbert curve for the bidirectional S6. With this focus-then-context biomimetic modules, PointLearner demonstrates remarkable robustness and achieves state-of-the-art performance across multiple point cloud tasks.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 21998