Simultaneous alignment and surface regression using hybrid 2D-3D networks for 3D coherent layer segmentation of retinal OCT images with full and sparse annotations

Hong Liu, Dong Wei, Donghuan Lu, Xiaoying Tang, Liansheng Wang, Yefeng Zheng

Abstract: Highlights•Simultaneous B-scan alignment and 3D layer segmentation of retinal OCT images.•Hybrid 2D–3D architecture accommodating highly anisotropic OCT data.•Spatial transformer module coupling B-scan motion correction with layer segmentation.•Global coherence loss encouraging coherent layer surfaces in 3D.•Effective fully and semi-supervised learning with a single unified framework.