Sentiment Analysis by Hierarchical Deep Neural Networks for Audience Opinion Mining

Hilda Hashemi *

Department of Computer Science, University of Texas at Austin, Texas, US.

Hooman Hashemi *

Department of Computer Science, University of Texas at Austin, Texas, US.

*Author to whom correspondence should be addressed.


Abstract

The prominent applications of sentiment analysis encompass various fields, including marketing, customer service, and communication. The conventional bag-of-words approach for measuring sentiment only counts term frequencies, while neglecting the position of the terms within the discourse. As a remedy, this research aims to build a discourse-aware approach upon the discourse structure of documents. For this purpose, rhetorical structure theory (RST) is utilized to label (sub-) clauses according to their hierarchical relationships, and then polarity scores are assigned to individual leaves. To learn from the resulting rhetorical structure, a hierarchical category structure-based deep recurrent neural network is proposed to infer underlying tensors of salient passages of narrative materials to process the complete discourse tree. The significance of this study lies in enhancing the structure of exploding and vanishing gradients in deep recurrent neural networks and also improving evaluation criteria in text analysis using the structure of opinion mining. The proposed approach is RST-HRNN. Exploding gradients is a process in the backpropagation stage aimed at continuously sampling the gradient of the model parameter in the opposite direction based on the weight (w), which is continuously updated until reaching the minimum global function.

Keywords: Sentiment analysis, hierarchical deep learning neural network, rhetorical structure theory, audience opinion mining


How to Cite

Hashemi, H., & Hashemi, H. (2024). Sentiment Analysis by Hierarchical Deep Neural Networks for Audience Opinion Mining. Asian Journal of Research in Computer Science, 17(6), 202–217. https://doi.org/10.9734/ajrcos/2024/v17i6468

Downloads

Download data is not yet available.

References

Yu LC, Wu JL, Pei-Chann C, Hsuan- Shou C. Using a contextual entropy model to expand emotion words and their intensity for the sentiment classification of stock market news, Knowl.-Based Syst. 2013; 41:89–97.

Hagenau M, Liebmann M, Neumann D. Automated news reading: Stock price prediction based on financial news using context-capturing features, Decis. Support Syst. 2013;55:685–697.

Xu T, Qinke P, Yinzhao C. Identifying the semantic orientation of terms using S-HAL for sentiment analysis, Knowl.-Based Syst. 2012;35:279–289.

Basant Agarwal, Namita Mittal, Pooja Bansal, Sonal Garg. Sentiment analysis using common-sense and context information. Computational Intelligence and Neuroscience; 2015.

Article ID 715730

Agarwal B, Mittal N. Optimal feature selection for sentiment analysis. In Proceedings of the 14th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing '13). 2013;7817:13–24.

Hu M, Liu B. In: Mining and summarizing customer reviews, Paper Presented at the Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2004.

Walaa Medhat, Ahmed Hassan, Hoda Korashy. Sentiment analysis algorithms and applications: A survey. Ain Shams Engineering Journal. 2014;5(4):1093-1113.

Agarwal B, Mittal N. Enhancing performance of sentiment analysis by semantic clustering of features. IETE Journal of Research. 2014;60(6):414– 422.

Medhat W, Hassan A, Korashy H. Sentiment analysis algorithms and applications: A survey, Ain Shams Eng. J. 2014;5:1093–1113.

Mikalai T, Themis P. Survey on mining subjective data on the web, Data Min. Knowl. Discov. 2012;24:478–514.

Isa M, Piek V. A lexicon model for deep sentiment analysis and opinion mining applications, Decis. Support Syst. 2012; 53:680–688.

Hordri NF, Samar A, Yuhaniz SS, Shamsuddin SM. A systematic literature review on features of deep learning in big data analytics, Int. J. Adv. Soft Comput. Appl. 2017;9(1):2074-8523.

Koyel Chakraborty, Siddhartha Bhattacharyya, Rajib Bag, Aboul Alla Hassanien. Chapter 7 - Sentiment Analysis on a Set of Movie Reviews Using Deep Learning Techniques. Social Network Analytics, Computational Research Methods and Techniques. 2019;127-147.

Prakash M. Nadkarni, Lucila Ohno-Machado, Wendy W. Chapman. Natural language processing: an introduction. J. Am. Med. Inform. Assoc. 2011;18(5):544–551.

Esuli A, Sebastiani F. Senti WordNet: A publicly available lexical resource for opinion mining. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC '06). 2006;417–422.

Stone PJ, Hunt EB. A computer approach to content analysis: Studies using the general inquirer system. In Proceedings of the AFIPS. 1963;241–256.

Cambria E, Havasi C, Hussain A. SenticNet 2: A semantic and affective resource for opinion mining and sentiment analysis. In Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference (FLAIRS '12). 2012;202–207.

Shaveta Dargon, Munish Kumar, Maruthi Rohit Ayyagari, Gulshan Kumar. A survey of deep learning and its applications: A new paradigm to machine learning. Archives of Computational Methods in Engineering. 2020;27:1071–1092.

Available:https://www.cybiant.com/resources/what-is-deep-learning/

Agarwal B, Mittal N. Prominent feature extraction for review analysis: An empirical study. Journal of Experimental and Theoretical Artificial Intelligence; 2014.

Mathias Kraus, Stefan Feuerriegel. Sentiment analysis based on rhetorical structure theory: Learning deep neural networks from discourse trees. Expert Systems with Applications. 2019;118:65–79.

Taboada M, Voll K, Brooke J. Extracting sentiment as a function of dis- course structure and topicality; 2008.

Hogenboom A, Frasincar F, De Jong F, Kaymak U. Using rhetorical structure in sentiment analysis. Communications of the ACM. 2015;58(7):69-77.

Zirn C, Niepert M, Stuckenschmidt H, Strube M. Fine-grained sentiment analysis with structural features. In Proceedings of the 5th international joint con- ference on natural language processing. 2011;11:336–344.

Bhatia P, Ji Y, Eisenstein J. Better document-level sentiment analysis from RST discourse parsing. In Proceedings of the conference on empirical methods in natural language processing. 2015;15: 2212–2218.

Fu X, Liu W, Xu Y, Yu C, Wang T. Long short-term memory network over rhetorical structure theory for sentence-level sentiment analysis. Proceedings of Machine Learning Research. 2016;63:17–32.

Hogenboom A, Frasincar F, De Jong F, Kaymak U. Polarity classification using structure-based vector representations of text. Decision Support Systems. 2015;74: 46–56.

Xiaomei Zou, Jing Yang, Hongyu Han. Collaborative community-specific microblog sentiment analysis via multi-task learning. Expert Systems with Applications Available online 18 November, In Press, Corrected Proof. 2020;114322.

Baris Ozyurt, Ali Akcayol M. A new topic modeling based approach for aspect extraction in aspect based sentiment analysis: SS-LDA. Expert Systems with Applications Available online 16 November In Press, Corrected Proof. 2020;114231.

Yazhou Zhang, Prayag Tiwari, Dawei Song, Xiaoliu Mao, Panpan Wang, Xiang Li, Hari Mohan Pandey. Learning interaction dynamics with an interactive LSTM for conversational sentiment analysis. Neural Networks. 2021;133:40-56.

Wei Song, Zijian Wen, Zhiyong Xiao, Soon Cheol Park. Semantics perception and refinement network for aspect-based sentiment analysis. Knowledge-Based Systems Available online. In Press, Journal Pre-proof. 2021;106755.

Prayag Tiwari, Brojo Kishore Mishra, Sachin Kumar, Vivek Kumar. Implementation of n-gram Methodology for Rotten Tomatoes Review Dataset Sentiment Analysis. International Journal of Knowledge Discovery in Bioinformatics (IJKDB), IGI Global. 2017;7(1):30-41.

Ceci F, Gonçalves AL, Weber R. A model for sentiment analysis based on ontology and cases. IEEE Latin America Transactions. 2016;14(11).

Zabit Hameed, Begonya Garcia-Zapirain. Sentiment Classification Using a Single-Layered BiLSTM Model. IEEE Access. 2020;8:73992-74001.

Vijay B, Raut, Londhe DD. Opinion mining and summarization of hotel reviews. IEEE 2014 International Conference on Computational Intelligence and Communication Networks, Bhopal, India; 2014.

Eivind Bjørkelund, Thomas H, Burnett, Kjetil Nørvåg. A Study of Opinion Mining and Visualization of Hotel Reviews. IIWAS, '12: Proceedings of the 14th International Conference on Information Integration and Web-based Applications and Services. 2012;229-238.

Shelly Gupta, Shubhangi Jain, Shivani Gupta. Opinion mining for hotel rating through reviews using decision tree classification method. International Journal of Advanced Research in Computer Science. 2018;9(2):180-184.

Kavita Lal, Nidhi Mishra. An insight of opinion mining on hotel reviews. Proceedings of International Conference on Advancements in Computing and Management (ICACM). 2019, 10 Pages Posted: 3; 2019.

Isidoros Perikos, Konstantinos Kovas, Foteini Grivokostopoulou, Ioannis Hatzilygeroudis. A System for Aspect-based Opinion Mining of Hotel Reviews. SCITEPRESS – Science and Technology Publications. 2017;388-394.

Nadeem Akhtar, Nashez Zubair, Abhishek Kumar, Tameem Ahmad. Aspect based Sentiment Oriented Summarization of Hotel Reviews. Procedia Computer Science. 2017;115:563-571.

Juan Sixto, Aitor Almeida, Diego López-de-Ipiña. Analysing Customers Sentiments: An Approach to Opinion Mining and Classification of Online Hotel Reviews. International Conference on Application of Natural Language to Information Systems, Natural Language Processing and Information Systems (NLDB). 2013;359-362.

Yetian Chen, Lin Xiao, Chuanmin Mi. Opinion Mining from Online Reviews: Consumer Satisfaction Analysis with B&B Hotels. PACIS Proceedings; 2017

Ya-Han Hu, Yen-Liang Chen, Hui-Ling Chou. Opinion mining from online hotel reviews – A text summarization approach. Information Processing and Management. 2017;53:436–449.

Xun Xua, Yibai Liba. The antecedents of customer satisfaction and dissatisfaction toward various types of hotels a text mining approach. International Journal of Hospitality Management. 2016;55:57– 69.

Arindam Chaudhuri, Soumya K. Ghosh. Sentiment analysis of customer reviews using robust hierarchical bidirectional recurrent neural network. Artificial Intelligence Perspectives in Intelligent Systems. 2016;249-261.

Märkle-Huß J, Feuerriegel S, Prendinger H. Improving sentiment analysis with document-level semantic relationships from rhetoric discourse structures. In Proceedings of the 50th hawaii International Conference on System Sciences; 2017.