FPAN: Fine-grained and progressive attention localization network for data retrieval

Sijia Chen, Bin Song, Jie Guo, Yanling Zhang, Xiaojiang Du, Mohsen Guizani

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

The localization of the target object for data retrieval is a key issue in the Intelligent and Connected Transportation Systems (ICTS). However, due to the lack of intelligence in the traditional transportation system, it takes a lot of resources to manually retrieve and locate the queried objects from a large number of images. In order to solve this issue, we propose an effective method for query-based object localization, which uses artificial intelligence techniques to automatically locate the queried object in complex backgrounds. The proposed method is termed as Fine-grained and Progressive Attention Localization Network (FPAN), which uses an image and a queried object as input to accurately locate the target object in the image. Specifically, the fine-grained attention module is naturally embedded into each layer of a convolution neural network (CNN), thereby gradually suppressing the regions that are irrelevant to the queried object and eventually focusing attention on the target area. We further employ top-down attentions fusion algorithm operated by a learnable cascade up-sampling structure to establish the connection between the attention map and the exact location of the queried object in the original image. Furthermore, the FPAN is trained by multi-task learning with box segmentation loss and cosine loss. At last, we conduct comprehensive experiments on both queried-based digit localization and object tracking with synthetic and benchmark datasets. The experimental results show that our algorithm is far superior than other algorithms on the synthesis datasets and outperforms most existing trackers on the OTB and VOT datasets.

Original languageEnglish
Pages (from-to)98-111
Number of pages14
JournalComputer Networks
Volume143
DOIs
StatePublished - 9 Oct 2018

Keywords

  • Fine-grained attention
  • Fully convolution localization network
  • Progressive attention
  • Query-based object localization
  • Unified framework

Fingerprint

Dive into the research topics of 'FPAN: Fine-grained and progressive attention localization network for data retrieval'. Together they form a unique fingerprint.

Cite this