Open Access iconOpen Access

ARTICLE

crossmark

A Hand Features Based Fusion Recognition Network with Enhancing Multi-Modal Correlation

Wei Wu*, Yuan Zhang, Yunpeng Li, Chuanyang Li, Yan Hao

School of Information Engineering, Shenyang University, Shenyang, 110044, China

* Corresponding Author: Wei Wu. Email: email

(This article belongs to the Special Issue: Artificial Intelligence Emerging Trends and Sustainable Applications in Image Processing and Computer Vision)

Computer Modeling in Engineering & Sciences 2024, 140(1), 537-555. https://doi.org/10.32604/cmes.2024.049174

Abstract

Fusing hand-based features in multi-modal biometric recognition enhances anti-spoofing capabilities. Additionally, it leverages inter-modal correlation to enhance recognition performance. Concurrently, the robustness and recognition performance of the system can be enhanced through judiciously leveraging the correlation among multimodal features. Nevertheless, two issues persist in multi-modal feature fusion recognition: Firstly, the enhancement of recognition performance in fusion recognition has not comprehensively considered the inter-modality correlations among distinct modalities. Secondly, during modal fusion, improper weight selection diminishes the salience of crucial modal features, thereby diminishing the overall recognition performance. To address these two issues, we introduce an enhanced DenseNet multimodal recognition network founded on feature-level fusion. The information from the three modalities is fused akin to RGB, and the input network augments the correlation between modes through channel correlation. Within the enhanced DenseNet network, the Efficient Channel Attention Network (ECA-Net) dynamically adjusts the weight of each channel to amplify the salience of crucial information in each modal feature. Depthwise separable convolution markedly reduces the training parameters and further enhances the feature correlation. Experimental evaluations were conducted on four multimodal databases, comprising six unimodal databases, including multispectral palmprint and palm vein databases from the Chinese Academy of Sciences. The Equal Error Rates (EER) values were 0.0149%, 0.0150%, 0.0099%, and 0.0050%, correspondingly. In comparison to other network methods for palmprint, palm vein, and finger vein fusion recognition, this approach substantially enhances recognition performance, rendering it suitable for high-security environments with practical applicability. The experiments in this article utilized a modest sample database comprising 200 individuals. The subsequent phase involves preparing for the extension of the method to larger databases.

Graphical Abstract

A Hand Features Based Fusion Recognition Network with Enhancing Multi-Modal Correlation

Keywords


Cite This Article

APA Style
Wu, W., Zhang, Y., Li, Y., Li, C., Hao, Y. (2024). A hand features based fusion recognition network with enhancing multi-modal correlation. Computer Modeling in Engineering & Sciences, 140(1), 537-555. https://doi.org/10.32604/cmes.2024.049174
Vancouver Style
Wu W, Zhang Y, Li Y, Li C, Hao Y. A hand features based fusion recognition network with enhancing multi-modal correlation. Comput Model Eng Sci. 2024;140(1):537-555 https://doi.org/10.32604/cmes.2024.049174
IEEE Style
W. Wu, Y. Zhang, Y. Li, C. Li, and Y. Hao "A Hand Features Based Fusion Recognition Network with Enhancing Multi-Modal Correlation," Comput. Model. Eng. Sci., vol. 140, no. 1, pp. 537-555. 2024. https://doi.org/10.32604/cmes.2024.049174



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 312

    View

  • 186

    Download

  • 0

    Like

Share Link