TY  - EJOU
AU  - Zhang, Menghan 
AU  - Shan, Fangfang 
AU  - Liu, Mengyao 
AU  - Wang, Zhenyu 

TI  - Research on Fine-Grained Recognition Method for Sensitive Information in Social Networks Based on CLIP
T2  - Computers, Materials \& Continua

PY  - 2024
VL  - 81
IS  - 1
SN  - 1546-2226

AB  - With the emergence and development of social networks, people can stay in touch with friends, family, and colleagues more quickly and conveniently, regardless of their location. This ubiquitous digital internet environment has also led to large-scale disclosure of personal privacy. Due to the complexity and subtlety of sensitive information, traditional sensitive information identification technologies cannot thoroughly address the characteristics of each piece of data, thus weakening the deep connections between text and images. In this context, this paper adopts the CLIP model as a modality discriminator. By using comparative learning between sensitive image descriptions and images, the similarity between the images and the sensitive descriptions is obtained to determine whether the images contain sensitive information. This provides the basis for identifying sensitive information using different modalities. Specifically, if the original data does not contain sensitive information, only single-modality text-sensitive information identification is performed; if the original data contains sensitive information, multi-modality sensitive information identification is conducted. This approach allows for differentiated processing of each piece of data, thereby achieving more accurate sensitive information identification. The aforementioned modality discriminator can address the limitations of existing sensitive information identification technologies, making the identification of sensitive information from the original data more appropriate and precise.
KW  - Deep learning; social networks; sensitive information recognition; multi-modal fusion

DO  - 10.32604/cmc.2024.056008