TY  - EJOU
AU  - You, Chuiju 
AU  - Zhu, Dongjie 
AU  - Sun, Yundong 
AU  - Ye, Anshan 
AU  - Wu, Gangshan 
AU  - Cao, Ning 
AU  - Qiu, Jinming 
AU  - Zhou, Helen Min 

TI  - SNES: Social-Network-Oriented Public Opinion Monitoring Platform Based on ElasticSearch
T2  - Computers, Materials \& Continua

PY  - 2019
VL  - 61
IS  - 3
SN  - 1546-2226

AB  - With the rapid development of social network, public opinion monitoring based on social networks is becoming more and more important. Many platforms have achieved some success in public opinion monitoring. However, these platforms cannot perform well in scalability, fault tolerance, and real-time performance. In this paper, we propose a novel social-network-oriented public opinion monitoring platform based on ElasticSearch (SNES). Firstly, SNES integrates the module of distributed crawler cluster, which provides real-time social media data access. Secondly, SNES integrates ElasticSearch which can store and retrieve massive unstructured data in near real time. Finally, we design subscription module based on Apache Kafka to connect the modules of the platform together in the form of message push and consumption, improving message throughput and the ability of dynamic horizontal scaling. A great number of empirical experiments prove that the platform can adapt well to the social network with highly real-time data and has good performance in public opinion monitoring.
KW  - Social network
KW  -  public opinion monitoring
KW  -  elasticsearch
KW  -  scrapy-redis

DO  - 10.32604/cmc.2019.06133