DOI:10.32604/cmc.2021.014398
| Computers, Materials & Continua DOI:10.32604/cmc.2021.014398 | |
| Article |
Analyzing COVID-2019 Impact on Mental Health Through Social Media Forum
1Department of Computer Science, COMSATS University, Islamabad, 45550, Pakistan
2Department of Management Sciences, Bahria Business School, Bahria University, Islamabad, 44000, Pakistan
3Department of Computer Science & IT, The Islamia University of Bahawalpur, Bahawalpur. 63100, Pakistan
4Department of Computer Science, Bahauddin Zakariya University, Multan, 60800, Pakistan
5Department of Computer Science, COMSATS University Islamabad, Vehari Campus, 61100, Pakistan
6Department of Computer and Information Science, University of Oregon, Eugene, 97401, Oregon, USA
*Corresponding Author: Shahid Hussain. Email: shussain@uoregon.edu
Received: 18 September 2020; Accepted: 05 December 2020
Abstract: This study aims to identify the potential association of mental health and social media forum during the outbreak of COVID-19 pandemic. COVID-19 brings a lot of challenges to government globally. Among the different strategies the most extensively adopted ones were lockdown, social distancing, and isolation among others. Most people with no mental illness history have been found with high risk of distress and psychological discomfort due to anxiety of being infected with the virus. Panic among people due to COVID-19 spread faster than the disease itself. The misinformation and excessive usage of social media in this pandemic era have adversely affected mental health across the world. Due to limited historical data, psychiatrists are finding it difficult to cure the mental illness of people resulting from the pandemic repercussion, fueled by social media forum. In this study the methodology used for data extraction is by considering the implications of social network platforms (such as Reddit) and levering the capabilities of a semi-supervised co-training technique-based use of Naïve Bayes (NB), Random Forest (RF), and Support Vector Machine (SVM) classifiers. The experimental results shows the efficacy of the proposed methodology to identify the mental illness level (such as anxiety, bipolar disorder, depression, PTSD, schizophrenia, and OCD) of those who are in anxious of being infected with this virus. We observed 1 to 5% improvement in the classification decision through the proposed method as compared to state-of-the-art classifiers.
Keywords: SARS-CoV-2; mental health; social media; Reddit; machine learning
Severe Acute Respiratory Syndrome Coronavirus (SARS-CoV) was firstly reported in 2003 during epidemic in China and soon it spread in 26 countries. SARS-CoV was supposed to be an animal virus probably spread from bats to other animals Subsequently, itinfect those human being who were living in the Guangdong province of China [1]. As soon the virus spread in the Wuhan, its news are spread around the world due to lethal nature of the virus. The virus on one side killed the people and on the other side it affected the financial state of the city distressing the economy of the country. ICTV (International Committee on Taxonomy of Viruses) disseminated the name of the new virus “Severe Acute Respiratory Syndrome Coronavirus-2 (SARS-CoV-2).” Subsequently, the WHO (World Health Organization) entitled it as “Coronavirus disease 2019 (COVID-19).” The name was chosen based on the fact that the virus is genetically resemble the coronavirus, which was responsible for the spread of SARS in 2003 [2]. The progress of COVID-19 is shown in Fig. 1.
Figure 1: Growth of COVID-19 (Source ICTV)
With in few months, the disease outbreak into 213 countries and territories like a storm. On 12th of March 2020, the World Health Organization (WHO) declared COVID-19 as an epidemic [3]. Scientists/pharmacists have either failed or trying to develop a vaccine to cure the virus victims. After few hit and trail, the most effective precaution adopted worldwide was lockdown as a safety measure. China also imposed a strict lockdown in Wuhan for 76 days in response of this pandemic. However, lockdown staretegy could not break the chain and affected the billion peoples around the globe. Therefore, to avoid the spread of virus, government of each country banned on the international travel to impose a strict lockdown. However the duration of the lockdown vary from country to county and ranging from few weeks to months. There are fewcountries which are still under the lockdown. The anxiety and fear of infected peoples has has been spread and become a vital source to compel the people in keeping social distancing and following lockdown procedure. However, no one anticipated that the lockdown and social distancing will overcome for such a long time, hence leading to several challenges for humans such as, financial loss, isolation, and concern for the health of loved ones.
Severe depression, anxiety and insomnia had been reported in the health care workers of China, during the early days of the pandemic. A bit notch of anxiety lead to the implementation of SOPs for prevention of COVID-19 spread like washing hands oftenly and working on the hygiene. However redundant anxiety leads to severe health issues including weak immune system and brain damage. Consequently, the COVID-19 has not only affected the physical health or economy but have adversely affected the mental health of the human beings. Psycholgist believed that the pandemic not only hit the world but also affect the mental health and routine of people. Moreover, it is believed by few researchers and doctors that COVID-19 vaccination would be only used to control the transmission and not the disease itself. As it is still too early to say that how long the virus will persist, therefore it is permissible to say that only social distancing is effective to interrupt the spread of virus. The only mode to interact with others is social media. So, people are now spending more time on the social media for their communication which could be propitious for healthcare stakeholders to identify the impact of prevailing situation on the mental illness. However, due to high volume of data, it is difficult for a healthcare stakeholder to extract meaningful information manually about the mental illness of a patient through their communication on social media platforms. Machine Learning (ML) has played better role in several domains such as text classification, software development, opinion mining, healthcare system, and sentiment analysis. Consequently, the implications of ML could be realized to identify the mental illness of COVID-19 affected people through their communication on social media platforms such as Reddit. Such information could be more beneficial for healthcare stakeholders to manage the effective treatment of COVID-19 affected humans. In this study, we target the issue and propose a methodology by leveraging the capabilities of semi-supervised co-training learning method in which ensemble algorithm (such as NB, RF, and SVM) is trained with a large number of unlabeled data and a small number of labeled data due to lack of domain experts in terms of assigning labels. Firstly, we target the Reddit social media platform for extracting (using PRAW, a Python API for Reddit) the post and comments which are published in the context of mental health issues such as; anxiety, bipolar disorder, depression, PTSD, schizophrenia, and Reddit’s OCD subreddits,and COVID-19 pandemic. Secondly, we applied a set of preprocessing activities to construct a Vector Space Model (VSM) for the training purposes of classifiers. Third, a label is assigned to some instances through the expert opinion to start the classifier’s initial learning and getting label of each new instance which later become the part of the classifier’s training.
The rest of the paper is organized into seven sections. Section 2 represents the overview of the work which is performed in the context of social media approaches for mental issues during COVID-19. Section 3 represents the brief overview of a semi-supervised co-training technique. Section 4 represents the proposed methodology. Section 5 represent the results. Section 6 presents the threats to validity. Finally, Section 7 describes the conclusion.
In their study, Manguri et al. [4] performed sentiment analysis from social media application twitter by utilizing the TextBlob library of python. They extracted tweets by utilizing python library tweepy, with the hashtag of #coronavirus and #COVID-19. The time span was considered from one high peak week of the COVID-19 pandemic. The results show the people’s reactions towards coronavirus vary day by day. Similarly, Chen et al. [5] revealed the difference in the utilization of neutral and controversial terms (such as “Chinese virus” and “COVID-19”) on twitter for coronavirus by doing sentiment analysis and topic modeling. The author concluded that the “Chinese virus” term is frequently used either as a neutral or a racist.
In their study, Kleinberg et al. [6] performed topic modeling by accumulating Real World Worry data from participants during COVID-19. By using the predictive modeling approach, the authors successfully predicted the emotional response of participants within 14% of their actual value.
In study [7], the author proposed the automatic detection of COVID-19 positive reports from social media by using machine learning and linguistic tools. The goal of the proposed work was to better understand the outbreak in China. The preliminary result of this work was to detect the positive reports by using machine learning state-of-the-artmodels. Similarly, in study [8], the author compared the higher education student’s reaction and sentiment analysis towards COVID-19 by the general public. The aim of study was to discover the social issues of the general public and students during COVID-19 with the help of social media data. The author claimed the novel attempt in the proposed study that signified the difference between student’s sentiments compared to general people’s sentiment towards any major crises.
In their study, Li et al. [9] gathered situational informational data from Weibo and used natural language processing techniques to classify the COVID-19 related information by dividing the situational information into seven types. The author found certain feature in reposting the amount of each type of situational information. Subsequently, in consecutive studies [10,11], the authors predicted the future posts of an individual by using a clustering technique on the Reddit platform. They extracted posts from clinical subreddits and classify them to their resultant mental illness. The authors concluded that Reddit posts could be used to identify mental illness appear in the near future of an individual.
In study [12], the author has introduced an EAR technology which captured the ongoing behavioral data without relying on the self-reports. The provided data from the participants could be beneficial for researchers to improve their study related to human behavior and other psychological aspects. In study [13], Home Health Care (HHC) planning problem was introduced to integrate the patients and group-based care services assignment aspects and resource dimensioning issues. Author employed fuzzy c-means and performed sensitivity analysis. The results showed the effectiveness of the proposed method with respect to cost. In study [14], the author proposed a methodology by leveraging the supervised learner to rank the patients with respect to their data relevancy. Author concluded that LambdaMart perform well in terms of Normalized Discounted Cumulative Gain than Adaboost And Coordinate Ascent. Moreover, Mean Average Precision (MAP) was used to predict patients with chronic disease.
Finally, in study [15] the author extracted the data from Reddit and classified the data of chronic mental disease patients by adopting the C-training algorithm. The experimental results exhibited the performance of Co-training technique as compared to the state-of-the-arttechnique with a margin of 3%. From this discussion, we concluded that Reddit data is a better choice to train the classifiers in the context of mental illness diseases.
3 Semi-Supervised Co-Training Technique
We concluded from the research community that the number of structured labeled data is much lower than the number of unstructured labeled data especially in the context of social network computing.
In 1998, Blum and Mitchell [16] proposed a new learning technique that uses a smaller number of labeled data for first training by using a weak classifier. The working procedure of the co-training algorithm is shown in Fig. 2. Subsequently, the classifier label the new instances which could be considered as unlabeled data. After that, we can get samples of high confidence from weak classifiers. As a result, we placed these samples in a dataset and labeled dataset to train the weak classifiers with the newly labeled data to increase the re-accuracy. Similarly, by taking advantage of co-training training algorithms [16,17], we construct a model with base level classifiers. Subsequently, we compared base level models with the constructed model. The features from different subreddit posts are sufficient for better classification accuracy.
Figure 2: Co-training algorithm [16]
We scrapped posts and top comments from the subreddit of Reddit. We choose posts which [18] were mentioned in the proposed work with the addition of OCD post.
From the studies [19–21], we concluded that NB, RF, and SVM are the best choice for text classification and multi-class classification. Their accuracy can be maintained through feature selection and extraction techniques. Therefore, we are building NB, RF, and SVM models for our problem domain [22,23]. We split the dataset in 50–30–20 ratio for the train, cross-validate, and test the classifiers. The training data summarized by the never seen data. Fig. 3 gives an overview of the proposed methodology which consists of several sections as follow.
Figure 3: Overview of proposed methodology
Figure 4: Preprocessed data
The first phase of the proposed methodology is data acquisition. Reddit has limitation of extracting only 1000 posts from subreddits of Reddit. We used PRAW (Python API for Reddit) to extract 1000 top posts from the subreddit r/Anxiety, r/Depression, r/Bipolar, r/PTSD, r/Schizophrenia, and r/OCD. Few posts were deleted by the user from the subreddit therefore the total post count is 5887. Moreover, we extracted top comments from each of the subreddits which are used as unlabeled data.
The domain experts have used several keywords to identify the mental illness that could be considered as independent variables of the dataset such as “sars,” “immune,” “coronavirus,” “vaccine,” ”lockdown,” ”COVID-19,” ”chinaflu,” ”quarantine,” ”influenza,” and so on. Moreover, two labels {yes/No} are considered for a dependent variable of the dataset for each instance. The existence of the majority of these keywords in the posts and comments could lead to the detection of mental illness due to COVID-19 victims.
4.2 Phase 2: Data Preprocessing
The second phase of the proposed methodology is data preprocessing. Data is standardized in this phase in appropriate form which could be easily use for creation of a model. The following steps need to be taken in this phase.
i) Blank spaces were removed from the text documents.
ii) Text data converted into a lowercase letter.
iii) Tokenization activity was performed that broken the all the sentences of a dataset into words.
iv) All the words carrying no relevant information were removed.
v) Stemming or Lemmatization was performed to reduce the number of words.
vi) All the non-alphanumeric characters were removed from the text.
After performing above said activities, word cloud is obtained which is shown in Fig. 3. The aim of this figure is to describe the intensity of words which are used in the corpus of posts and relevant comments.
4.3 Phase 3: Feature Extraction and Selection
The third phase of the proposed methodology is feature extraction and selection. It consists of three steps as follow.
• Feature extraction
• Feature selection
• Splitting the data for training and testing
For feature extraction, though several weighting could be performed such as Entropy, Term Frequency (TF), Binary and Length Term Collection (LTC). However, we applied the widely used Term Frequency-Inverse Document Frequency (TF-IDF) weighting method to preprocessed the data. TFIDF is processed into two parts. Firstly, the number of times a term used in the document is calculated (i.e., calculating Term Frequency). While the second part is calculating the inverse of TF which is known as IDF. The term IDF reduces the word weight that is frequently occurred. If we did not apply IDF after TF, then these most frequently occurred words will affect the accuracy of the classifier. From the given output, we select the features and split our data set into a 50–30–20 ratio. For training, cross-validation, and testing we used 50%, 30%, and 20% data respectively.
The fourth and the last phase of our proposed methodology is entitled as classification, which is accomplished by leveraging the capabilities of machine learning algorithms. Firstly, we look at the pre-built model NB, RF, and SVM by tuning their parameters and classifing the data. Subsequently, we leverage the capabilities of semi-supervised co-training techniques and construct NB, RF, and SVM that are based on the Co-training technique. For the semi-supervised Co-training technique, we need two views of a dataset. In this regard,we merged our feature set into labeled and unlabeled data from the dataset. Label data refer to the post of subreddits while unlabeled data refer to the comments from each post. Hence two models of NB, RF, and SVM were created and trained on the label data (i.e., post) for both views. Moreover, since unlabeled data is greater than label data so we consider them as weak classifiers. After training of weak classifier, we used some unlabeled data for prediction. We used those instances of each class in which these weak classifiers were most confident. Similarly, these most confident weak classifiers examples are added to labeled data. Subsequently, we trained these weak classifiers again on this new merged data that is labeled dataset. This process is recurring k epochs. For comparison, we took prediction after each iteration of the classifier.
To evaluate the effectiveness of our proposed methodology, we performed several experiments by applying k-fold cross-validation. We employed the performance measures which are widely used in classification such as Precision (P), Recall (R), and F-measure. We need to construct a confusion matrix to derive the values of these metrics. The positive case (i.e., Yes for mental illness due to communication on COVID-19) of our model is the detection of mental illness of a patient through its communication as a COVID-19. While the negative case (i.e., No for a mental illness through communication on COVID-19) leads to a lack of mental illness. The same case is applied for each mental illness which is considered in the proposed study. The class-wise performance of classifiers when ensemble with the proposed co-training technique is shown in Tab. 2. The second column of Tab. 2 indicates the existence of a mental illness which is identified through the communication about COVID-19 on the social media platform. The last three columns indicate the value of the proposed measure used to assess the effectiveness of the proposed method. The average performance of co-training-based classifiers for the identification of all mental illness is shown in Tab. 3. The main consequences of the experimental results of Tabs. 2 and 3 are as follow.
• Since the positive case of our proposed model is the identification of mental illness, so in this case we perceived the highest F-measure value (Tab. 2) of SVM (
), RF (
), and NB(
). The highest value of the F-measure for each classifier indicates the performance of the proposed method for the identification of mental illness of patients through their communication in terms of their posts and comments.
• We observed RF (
in Tab. 3) as an outperformed co-training-based classifier as compared to SVM and NB, which indicate its capability to assign labels effectively.
• Though the performance of NB (
in Tab. 3) is good to identify the mental illness when ensemble with co-training but it is not better than the rest of the classifiers.
• Though we observed good precision of all co-training-based classifiers but their recall values were not so good (Tab. 2) that could be considered as a threat to our co-training-based models.
Table 1: Selected subreddit and post
Table 2: Class wise effectiveness of co-training based SVM, RF, NB for all mental illness classification
Table 3: Average effectiveness of co-training based SVM, RF, NB for all mental illness classification
Moreover, to benchmark the effectiveness of our proposed approach i.e., Co-training with base classifiers, we evaluate the performance of state-of-the-artbase level classifiers with Co-training models. The results of Tab. 4 exhibits the performance assessment of our Co-training models (SVM, NB, RF) in terms of F-measure. We observe the significant persistence in the effectiveness of the classification of mental illness. The main consequences of Tab. 4 results are:
• We observe that co-training-based classifier outperformed the state-of-the-art classifiers especially co-training based NB well performed as compared to its individual use.
• We observe a 1 to 5% improvement in the classification decision of classifiers when they are incorporated with co-training based proposed method.
• We could not observe better improvement in the classification decision of RF (1%) as compared to other classifiers.
We observed better improvement in the classification decision of NB (5%) as compared to the rest of the classifiers.
Table 4: Comparison of classifier performance with and without co-training
We observe some threats in our work. The first threat is related to the generalization of the result. We used a limited data set and few number of classifiers to present the efficacy of the proposed method. The result can be modified by changing the number of data sets and classifiers. The second threat is the use of classifiers with preset parameters. The efficacy of our proposed method may be altered by tuning the default parameters.
From the experimental results, we conclude the performance of the co-training based proposed methodology for the classification as compared to the state-of-the-art classifiers. The proposed co-training-based classifiers are evaluated in the context of COVID-19 by considering posts and comments of human mental illness on the Reddit social media platform. We used PRAW (Python API for Reddit) for the extraction of the top 1000 posts and first comments from each post. We have performed several experiments to classify the top post from subreddit Anxiety, Depression, Bipolar, PTSD, Schizophrenia and OCD by using Naïve Bayes (NB), Support Vector Machine (SVM), and Random Forest (RF) classifiers. The main consequences are; (1) We observed the effectiveness of the proposed method for classifying the human mental illness on the basis of their posts and comments in terms of accuracy, recall, and F-measure. Such as, we observed the performance of co-training based RF as the 
, (2) We observed the improvement in the classification decision through co-training based classifiers as compared to their state-of-the-art usage, as the performance of NB significantly improved (5%) when it works through the proposed method, (3) We observed a 1% to 5% improvement in the mental illness classification that may varied in the proposed study when other classifications are considered. In future, we are planing to consider more human posts and comments using several social media platforms.
Funding Statement: The authors received no specific funding for this study.
Conflicts of Interest: The authors declares that they have no conflicts of interest to report regarding the present study.
 | This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |