Diverse features discovery transformer for pedestrian attribute recognition
Zheng, Aihua; Wang, Huimin; Wang, Jiaxiang; Huang, Huaibo; He, Ran; Hussain, Amir
Prof Amir Hussain A.Hussain@napier.ac.uk
Recently, Swin Transformer has been widely explored as a general backbone for computer vision, which helps to improve the performance of vision tasks due to the ability to establish associations for long-range dependencies of different spatial locations. By implementing the pedestrian attribute recognition with Swin Transformer, we observe that Swin Transformer tends to focus on a relatively small number of local regions within which attributes may be correlated with other attributes, which leads Swin Transformer to predict attributes in those neglected regions based on such correlation. In fact, discriminative information may exist within these neglected regions, which is crucial for attribute identification. To address this problem, we propose a novel diverse features discovery transformer (DFDT) which can find more attribute relationship regions for robust pedestrian attribute recognition. First, Swin Transformer is used as a feature extraction network to acquire attribute features with the long-distance association, which predicts the corresponding attribute information. Second, we propose a diverse features suppression module (DFSM) to obtain semantic features directly associated with attributes by suppressing the peak locations of the most discriminative features and randomly selected feature regions to spread the feature regions that Swin Transformer is interested in. Third, we plug the diverse features suppression module into different stages of Swin Transformer to learn detailed texture features to help recognition. In addition, we have divided the attribute features into multiple vertical feature regions to improve the focus on local attribute features. Experiments on three benchmark datasets validate the effectiveness of the proposed algorithm.
Zheng, A., Wang, H., Wang, J., Huang, H., He, R., & Hussain, A. (2023). Diverse features discovery transformer for pedestrian attribute recognition. Engineering Applications of Artificial Intelligence, 119, Article 105708. https://doi.org/10.1016/j.engappai.2022.105708
|Journal Article Type||Article|
|Acceptance Date||Dec 1, 2022|
|Online Publication Date||Dec 26, 2022|
|Deposit Date||Feb 15, 2023|
|Publicly Available Date||Dec 27, 2023|
|Journal||Engineering Applications of Artificial Intelligence|
|Peer Reviewed||Peer Reviewed|
|Keywords||Pedestrian attribute recognition, Vision transformer, Features suppression|
This file is under embargo until Dec 27, 2023 due to copyright reasons.
Contact email@example.com to request a copy for personal use.
You might also like
WikiDes: A Wikipedia-based dataset for generating short descriptions from paragraphs
DPb-MOPSO: A Dynamic Pareto bi-level Multi-objective Particle Swarm Optimization Algorithm