Speed-FairMOT: multi-class multi-object tracking for real-time manipulation

Download PDF
Open Webpage

Cheng Ju, Ziran Li, Koki Terakado, Akio Namiki

Published: 01 Jan 2025, Last Modified: 06 Nov 2025Signal Image Video Process. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: In order to achieve complex tasks at high speed in robot manipulation, the ability to perform multi-object tracking (MOT), which recognizes the many objects in the surrounding area using camera-based real-time image data processing, is essential. To overcome traditional MOT methods slow tracking speeds challenges, we propose Speed-FairMOT, a deep-learning based real-time multi-class MOT method. We evaluate the Speed-FairMOT on MOT17 dataset and our custom synthetic dataset, achieving over \(41\%\) improvement in speed and slightly decrease of \(5.9\%\) in tracking performance as trade-off compared to the original FairMOT. We verified proposed Speed-FairMOT using a camera mounted on a robot manipulator as a hand-eye system. As the result, we were able to achieve MOT at an maximum speed over 58 fps in real-time. This real-time speed is sufficient for feedback control in robotic manipulation system.