Open Access iconOpen Access

ARTICLE

crossmark

Pre-Locator Incorporating Swin-Transformer Refined Classifier for Traffic Sign Recognition

Qiang Luo1, Wenbin Zheng1,2,*

1 School of Software Engineering, Chengdu University of Information Technology, Chengdu, 610225, China
2 V.C. & V.R. Key Lab of Sichuan Province, Sichuan Normal University, Chengdu, 610068, China

* Corresponding Author: Wenbin Zheng. Email: email

(This article belongs to this Special Issue: Computer Vision and Machine Learning for Real-Time Applications)

Intelligent Automation & Soft Computing 2023, 37(2), 2227-2246. https://doi.org/10.32604/iasc.2023.040195

Abstract

In the field of traffic sign recognition, traffic signs usually occupy very small areas in the input image. Most object detection algorithms directly reduce the original image to a specific size for the input model during the detection process, which leads to the loss of small object information. Additionally, classification tasks are more sensitive to information loss than localization tasks. This paper proposes a novel traffic sign recognition approach, in which a lightweight pre-locator network and a refined classification network are incorporated. The pre-locator network locates the sub-regions of the traffic signs from the original image, and the refined classification network performs the refinement recognition task in the sub-regions. Moreover, an innovative module (named SPP-ST) is proposed, which combines the Spatial Pyramid Pool module (SPP) and the Swin-Transformer module as a new feature extractor to learn the special spatial information of traffic sign effectively. Experimental results show that the proposed method is superior to the state-of-the-art methods (82.1 mAP achieved on 218 categories in the TT100k dataset, an improvement of 19.7 percentage points compared to the previous method). Moreover, both the result analysis and the output visualizations further demonstrate the effectiveness of our proposed method. The source code and datasets of this work are available at .

Keywords


Cite This Article

Q. Luo and W. Zheng, "Pre-locator incorporating swin-transformer refined classifier for traffic sign recognition," Intelligent Automation & Soft Computing, vol. 37, no.2, pp. 2227–2246, 2023.



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 406

    View

  • 250

    Download

  • 0

    Like

Share Link