Adaptive Gradient Triplet Loss with Automatic Margin Learning for Forensic Medical Image MatchingDownload PDF

21 Apr 2022, 10:47 (edited 04 Jun 2022)MIDL 2022 Short PapersReaders: Everyone
  • Keywords: Deep Learning, Content-based Image Retrieval, Forensic Matching
  • TL;DR: We present an extended version of triplet loss that is robust to visual changes due to aging and disease progression for forensic medical image matching.
  • Abstract: This paper tackles the challenge of forensic medical image matching (FMIM) using deep neural networks (DNNs). We investigate Triplet loss (TL), which is probably the most well-known loss for this problem. TL aims to enforce closeness between similar and enlarge the distance between dissimilar data points in the image representation space extracted by a DNN. Although TL has been shown to perform well, it still has limitations, which we identify and analyze in this work. Specifically, we first introduce AdaTriplet -- an extension of TL that aims to adapt loss gradients according to the levels of difficulty of negative samples. Second, we also introduce AutoMargin -- a technique to adjust hyperparameters of margin-based losses such as TL and AdaTriplet dynamically during training. The performance of our loss is evaluated on a new large-scale benchmark for FMIM, which we have constructed from the Osteoarthritis Initiative cohort. The codes allowing replication of our results have been made publicly available at \url{}.
  • Registration: I acknowledge that acceptance of this work at MIDL requires at least one of the authors to register and present the work during the conference.
  • Authorship: I confirm that I am the author of this work and that it has not been submitted to another publication before.
  • Paper Type: recently published or submitted journal contributions
  • Primary Subject Area: Unsupervised Learning and Representation Learning
  • Secondary Subject Area: Application: Radiology
  • Confidentiality And Author Instructions: I read the call for papers and author instructions. I acknowledge that exceeding the page limit and/or altering the latex template can result in desk rejection.
1 Reply