A Deep Learning Approach for Motion Forecasting Using 4D OCT Data Download PDF

25 Jan 2020, 12:35 (edited 25 Jun 2020)MIDL 2020 Conference Blind SubmissionReaders: Everyone
  • Abstract: Forecasting motion of a specific target object is a common problem for surgical interventions, e.g. for localization of a target region, guidance for surgical interventions, or motion compensation. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution. Recently, deep learning methods have shown promising performance for OCT-based motion estimation based on two volumetric images. We extend this approach and investigate whether using a time series of volumes enables motion forecasting. We propose 4D spatio-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. We design and evaluate five different 3D and 4D deep learning methods using a tissue data set. Our best performing 4D method achieves motion forecasting with an overall average correlation coefficient of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.
  • Paper Type: methodological development
  • Track: short paper
  • Keywords: 4D Deep Learning, Optical Coherence Tomography, Motion Estimation, Motion Forecasting
  • TL;DR: We propose 4D deep learning for motion forecasting using 4D OCT data
  • Presentation Upload: zip
  • Presentation Upload Agreement: I agree that my presentation material (videos and slides) will be made public.
6 Replies