胡晟, 田生伟, 禹龙. TUnet: 基于U型结构深度学习模型皮肤病图像分割研究[J]. 微电子学与计算机, 2022, 39(10): 71-79. DOI: 10.19304/J.ISSN1000-7180.2021.1324
引用本文: 胡晟, 田生伟, 禹龙. TUnet: 基于U型结构深度学习模型皮肤病图像分割研究[J]. 微电子学与计算机, 2022, 39(10): 71-79. DOI: 10.19304/J.ISSN1000-7180.2021.1324
HU Sheng, TIAN Shengwei, YU Long. TUnet: a research on image segmentation of dermatology based on U-shaped structure deep learning model[J]. Microelectronics & Computer, 2022, 39(10): 71-79. DOI: 10.19304/J.ISSN1000-7180.2021.1324
Citation: HU Sheng, TIAN Shengwei, YU Long. TUnet: a research on image segmentation of dermatology based on U-shaped structure deep learning model[J]. Microelectronics & Computer, 2022, 39(10): 71-79. DOI: 10.19304/J.ISSN1000-7180.2021.1324

TUnet: 基于U型结构深度学习模型皮肤病图像分割研究

TUnet: a research on image segmentation of dermatology based on U-shaped structure deep learning model

  • 摘要: 针对UNet结构中卷积运算对全局特征信息不敏感且无法获取图像中的长距离依赖关系的问题,本文提出了一种基于U型结构的医学图像分割模型,该方法采用变形模块(Transformer Block)和跳连接的方法,既能提取图像中的全局特征信息和局部特征信息又能获取图像中的长距离依赖关系.通过上下采样的方式对空间特征图的分辨率进行改变和恢复.跳连接对多尺度特征信息进行融合进一步整合数据中的信息.本文在ISIC2017数据集上的实验证明了本文提出的TUnet模型的雅卡尔系数相较于现有的一些先进医学图像分割模型均有提升,达到了0.755 8.验证了模型中变形模块的添加使得图像中长距离依赖关系得到了提取,模型存在较好的应用前景.

     

    Abstract: Aiming at the problem that convolutional operations in UNet structures are insensitive to global feature information and cannot get long-distance dependencies in images, this paper proposes a medical image segmentation model based on U-shaped structures, which adopts the method of transformer block and skip connection, that can extract global feature information and local feature information in the image and obtain long-distance dependencies in the image. The resolution of the spatial feature map is changed and restored by sampling up and down. Skip connection fuse multi-scale feature information to further integrate information in the data. The experiments on the ISIC2017 dataset demonstrate that the Jaccard similarity coefficient of this paper proposed TUnet model is improved by 0.755 8 compared to some existing advanced medical image segmentation models. It is verified that the addition of the transformer module in the model makes the long-distance dependencies in the image extracted, and the model has a good application prospect.

     

/

返回文章
返回