朱宽堂, 张建勋, 谭暑秋. 基于全局特征和多种局部特征的行人重识别[J]. 微电子学与计算机, 2022, 39(2): 43-50. DOI: 10.19304/J.ISSN1000-7180.2021.0837
引用本文: 朱宽堂, 张建勋, 谭暑秋. 基于全局特征和多种局部特征的行人重识别[J]. 微电子学与计算机, 2022, 39(2): 43-50. DOI: 10.19304/J.ISSN1000-7180.2021.0837
ZHU Kuantang, ZHANG jianxun, TAN Shuqiu. Person re-identification based on global features and multiple local features[J]. Microelectronics & Computer, 2022, 39(2): 43-50. DOI: 10.19304/J.ISSN1000-7180.2021.0837
Citation: ZHU Kuantang, ZHANG jianxun, TAN Shuqiu. Person re-identification based on global features and multiple local features[J]. Microelectronics & Computer, 2022, 39(2): 43-50. DOI: 10.19304/J.ISSN1000-7180.2021.0837

基于全局特征和多种局部特征的行人重识别

Person re-identification based on global features and multiple local features

  • 摘要: 能否提取具有区别度的行人特征是行人重识别问题的关键所在.该文在ResNet-50的基础上,提出一种使用多种方法提取特征的多分支网络结构(MMNet).该网络将多种方法以一种巧妙的方式组合起来,从而解决行人姿态变化、部分遮挡等引起的行人判别特征信息缺失问题.在第一个分支中提取行人的全局特征,在第二个分支中使用通道注意力模块提取想要关注的局部特征,在第三个分支中将骨干网络提取的特征水平均匀的分割成不同的块,从而提取出不同粒度的局部特征,接着使用批量难样本三元组损失函数和softmax损失函数联合训练模型.最终使用不同分支提取的特征串联在一起作为最终特征.通过行人的全局特征和多种局部特征相互补充,从而提取出更有区别度的行人特征.算法在Market-1501和DukeMTMC-reID数据集上的平均精度均值和首位命中率分别达到87.7%和95.9%、79.9%和89.2%.试验结果表明,使用多分支网络提取的特征具有互补性,且平均精度均值和首位命中率比大多数行人重识别算法高.

     

    Abstract: The key of person re-identification is to extract distinctive pedestrian features. Based on ResNet-50, this paper proposes a multi-branch network structure (MMNet) which uses multiple methods to extract features. By combining various methods in a clever way, the problem of lack of pedestrian discrimination feature information caused by pedestrian posture change and partial occlusion can be solved. In the first branch, the global features of pedestrians are extracted. In the second branch, the local features that person re-identification want to pay attention to are extracted by the channel attention module. In the third branch, the features extracted from backbone are evenly divided into different blocks, so as to extract the local features with different granularity. Then the model is trained by using the bath hard triple loss function and softmax loss function. Finally, the features extracted from different branches are concatenated as the final features. By complementing the global features and various local features of pedestrians, distinctive pedestrian feature is extracted. The map and rank 1 of the algorithm on Market-1501 and DukeMTMC-reID datasets are 87.7% and 95.9%, 79.9% and 89.2% respectively. The experimental results show that the features extracted by the multi-branch network are complementary, and map and rank1 are higher than that of most person re-identification algorithms.

     

/

返回文章
返回