基于颜色随机化和全相关注意力的跨模态行人重识别
DOI:
CSTR:
作者:
作者单位:

1.上海电力大学;2.上海电力大学电子与信息工程学院

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家自然科学基金(61802250)


Cross-modal pedestrian re-recognition based on color randomization and full related attention
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对跨模态行人重识别过程中,模态差异导致难以提取充分的辨别性身份特征的问题,本文提出一种颜色随机化数据增强算法,并设计了基于全相关注意力的双流多分支网络模型。模型以ResNet-50为骨干网络,首先,对输入样本进行颜色随机化处理,提高模型的颜色风格鲁棒性;采用双流网络,在网络浅层设置权重参数非共享模式,分别用于处理可见光图像和红外图像;其次,提出全相关注意力,从空间和通道维度获得不同像素的关联程度,提高模型对于结构信息的提取能力;最后,采用多分支结构提取多尺度全局特征和局部特征增强提取特征的判别性。通过对比试验证明:基于颜色随机化和全相关注意力的跨模态行人重识别方法在SYSU-MM01和RegDB数据集上的实验结果都具有优越性。

    Abstract:

    To address the problem that modal differences between different modal images in the process of cross-modal pedestrian re-recognition make it difficult to extract sufficient discriminative features, this paper proposes a color randomization data pre-processing method and designs a dual-stream multi-branch network model based on full relevant attention. The model uses ResNet-50 as the backbone network. Firstly, the input image is pre-processed with color randomization to improve the color style robustness of the model; a dual-stream network with non-shared modes of weight parameters is set in the shallow layer of the network for processing visible and infrared images respectively; secondly, full related attention is proposed to obtain the degree of association of different pixels from the spatial and channel dimensions to improve the model's ability to Finally, the multi-branch structure is used to extract multi-scale global features and local features to enhance the discriminative power of the extracted features. The experimental results of the cross-modal pedestrian re-identification method based on color randomization and full relevant attention on both the SYSU-MM01 and RegDB datasets are proved to be superior through comparative experiments.

    参考文献
    相似文献
    引证文献
引用本文
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-03-28
  • 最后修改日期:2023-05-09
  • 录用日期:2023-05-10
  • 在线发布日期:
  • 出版日期:
文章二维码