FERN: A Fetal Echocardiography Registration Network for 2D-to-3D Alignment

Paula Ramirez Gilliland, David F A Lloyd, Jacqueline Matthew, Reza Razavi, Milou PM Van Poppel, Andrew P. King, Maria Deprez

Keywords: Fetal echocardiography, 3D Fetal ultrasound, STIC, Congenital Heart Disease, 3D plane localisation, Fetal cardiology, Fetal cardiac imaging

TL;DR: This study uses a Slice-to-Volume Transformer to map 2D standard fetal echocardiography views into a 3D space for antenatal Congenital Heart Disease evaluation.

Abstract: 2D Freehand echocardiography remains the primary imaging modality for routine fetal cardiac care, essential in the antenatal detection of Congenital Heart Disease (CHD). However, there is a lack of spatial context which requires 3D imaging. Current 3D methods, such as Spatio-Temporal Image Correlation (STIC), face limitations in success rate, image quality, and ease of use, and come at the cost of lower spatial and temporal resolution compared to 2D acquisitions. This work studies the feasibility of aligning real high spatial and temporal resolution 2D fetal echocardiography into a reference 3D space defined by lower resolution 3D STIC. FERN, a $\textbf{F}$etal $\textbf{E}$chocardiography $\textbf{R}$egistration $\textbf{N}$etwork, employs transformers for standard fetal echocardiography view alignment. The network is trained on simulated 2D slices derived from 3D volumes at end-diastole, and validated on real 2D acquisitions from fetuses with Coarctation of the Aorta and Right Aortic Arch diagnoses, achieving a mean Euclidean distance of 2.98 $\pm$ 1.27 mm on cardiac region-of-interest points between predicted and manually selected planes. Compared to manually aligned planes, improved image similarity to an average atlas is achieved, confirmed by blinded best plane selection. This work demonstrates that high spatial and temporal resolution 2D fetal echocardiography can be integrated into a 3D context provided by lower-resolution 3D acquisitions or fetal cardiac atlases, potentially resulting in a new 3D visualization tool for enhanced CHD diagnosis.

Primary Subject Area: Image Registration

Secondary Subject Area: Application: Cardiology

Paper Type: Validation or Application

Registration Requirement: Yes

Submission Number: 97