Towards accurate unsupervised video captioning with implicit visual feature injection and explicit

Yunjie Zhang, Tianyang Xu, Xiaoning Song, Xuefeng Zhu, Zhen-Hua Feng, Xiaojun Wu

Abstract: Highlights•Contrast learning is used to minimise the disparities between pseudo-text labels and video features.•Visual clues are aligned with the text generator for consistent semantic enhancement.•Leveraging the Found within the sentences for semantic preservation.•Outperforming existing unsupervised video captioning approaches.