Open Access iconOpen Access

ARTICLE

crossmark

Multimodal Fused Deep Learning Networks for Domain Specific Image Similarity Search

Umer Waqas, Jesse Wiebe Visser, Hana Choe, Donghun Lee*

Research and Development, AItheNutrigene, Seoul, 06132, Korea

* Corresponding Author: Donghun Lee. Email: email

Computers, Materials & Continua 2023, 75(1), 243-258. https://doi.org/10.32604/cmc.2023.035716

Abstract

The exponential increase in data over the past few years, particularly in images, has led to more complex content since visual representation became the new norm. E-commerce and similar platforms maintain large image catalogues of their products. In image databases, searching and retrieving similar images is still a challenge, even though several image retrieval techniques have been proposed over the decade. Most of these techniques work well when querying general image databases. However, they often fail in domain-specific image databases, especially for datasets with low intraclass variance. This paper proposes a domain-specific image similarity search engine based on a fused deep learning network. The network is comprised of an improved object localization module, a classification module to narrow down search options and finally a feature extraction and similarity calculation module. The network features both an offline stage for indexing the dataset and an online stage for querying. The dataset used to evaluate the performance of the proposed network is a custom domain-specific dataset related to cosmetics packaging gathered from various online platforms. The proposed method addresses the intraclass variance problem with more precise object localization and the introduction of top result reranking based on object contours. Finally, quantitative and qualitative experiment results are presented, showing improved image similarity search performance.

Keywords


Cite This Article

APA Style
Waqas, U., Visser, J.W., Choe, H., Lee, D. (2023). Multimodal fused deep learning networks for domain specific image similarity search. Computers, Materials & Continua, 75(1), 243-258. https://doi.org/10.32604/cmc.2023.035716
Vancouver Style
Waqas U, Visser JW, Choe H, Lee D. Multimodal fused deep learning networks for domain specific image similarity search. Comput Mater Contin. 2023;75(1):243-258 https://doi.org/10.32604/cmc.2023.035716
IEEE Style
U. Waqas, J.W. Visser, H. Choe, and D. Lee "Multimodal Fused Deep Learning Networks for Domain Specific Image Similarity Search," Comput. Mater. Contin., vol. 75, no. 1, pp. 243-258. 2023. https://doi.org/10.32604/cmc.2023.035716



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1167

    View

  • 530

    Download

  • 0

    Like

Share Link