Dual-Channel Attention Model for Text Sentiment Analysis

doi:10.23940/ijpe.19.03.p12.834841

Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (3): 834-841.doi: 10.23940/ijpe.19.03.p12.834841

Previous Articles Next Articles

Dual-Channel Attention Model for Text Sentiment Analysis

Hui Li, Yuanyuan Zheng^*, and Pengju Ren

School of Physics and Electronic Information, Henan Polytechnic University, Jiaozuo, 454000, China

Submitted on ; Revised on ;
Contact: 13273919602@163.com
About author:Hui Li received his doctorate degree in information and communication engineering in 2008 from Nanjing University of Science and Technology. He is currently working as a teacher at Henan Polytechnic University. His research interests are chaotic communications.Yuanyuan Zheng is a graduate student in the School of Physics and Electronic Information at Henan Polytechnic University. Her research interests are natural language processing and deep learning.Pengju Ren is an undergraduate student in the School of Physics and Electronic Information at Henan Polytechnic University. His research interests are image processing and data mining.

Abstract

Abstract: Focused on the issue that text information cannot be fully extracted by the single-channel neural network model, the Dual-Channel Attention Model (DCAM) is proposed for text sentiment analysis. Firstly, text is represented in the form of a matrix using a word vector trained by Word2Vec. Secondly, the matrix is used as input data and sent to Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) networks for feature extraction. Thirdly, an attention model is introduced to extract important feature information. Finally, the text features are merged, and the classification layer is used to classify the sentiment. The model is evaluated on a Chinese corpus. According to the experimental results, the accuracy of the proposed model can reach 92.7%, which is obviously superior to other single-channel neural network models.

Key words: convolutional neural network, long short-term memory, attention model, sentiment analysis, dual-channel

Hui Li, Yuanyuan Zheng, and Pengju Ren. Dual-Channel Attention Model for Text Sentiment Analysis [J]. Int J Performability Eng, 2019, 15(3): 834-841.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

1. F. T. I. I. Retrieval, “Opinion Mining and Sentiment Analysis,” Foundations & Trends in Information Retrieval , Vol. 2, pp. 1-135, 2008
2. M. Taboada, J. Brooke, M. Tofiloski, K. Voll,M. Stede, “Lexicon-based Methods for Sentiment Analysis,”Computational Linguistics, Vol. 37, pp. 267-307, 2011
3. S. Liu and W. Deng, “Very Deep Convolutional Neural Network based Image Classification using Small Training Sample Size,” inProceedings of the 3^rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 730-734, 2016
4. A. Graves, A. R. Mohamed,G. Hinton, “Speech Recognition with Deep Recurrent Neural Networks,” in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 38, pp. 6645-6649, 2013
5. R. Yin, P. Li,B. Wang, “Sentiment Lexical-Augmented Convolutional Neural Networks for Sentiment Analysis,” inProceedings of IEEE Second International Conference on Data Science in Cyberspace, pp. 630-635, 2017
6. Y. Zhang, S. Roller,B. Wallace, “MGNC-CNN: A Simple Approach to Exploiting Multiple Word Embeddings for Sentence Classification,” inProceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016
7. N. Kalchbrenner, E. Grefenstette,P. Blunsom, “A Convolutional Neural Network for Modelling Sentences,”Eprint Arxiv, Vol. 1, 2014
8. Y. Zhang, Y. Jiang,Y. Tong, “Study of Sentiment Classification for Chinese Microblog based on Recurrent Neural Network,”Chinese Journal of Electronics, Vol. 25, pp. 601-607, 2016
9. A. Hassan and A. Mahmood, “Efficient Deep Learning Model for Text Classification based on Recurrent and Convolutional Layers,” inProceedings of IEEE International Conference on Machine Learning and Applications, 2018
10. A. Hassan and A. Mahmood, “Convolutional Recurrent Deep Learning Model for Sentence Classification,”IEEE Access, Vol. 6, pp. 13949-13957, 2018
11. K. Xu, J. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhutdinov, et al., “Show, Attend and Tell: Neural Image Caption Generation with Visual Attention,”Computer Science, pp. 2048-2057, 2015
12. D. Bahdanau, K. Cho,Y. Bengio, “Neural Machine Translation by Jointly Learning to Align and Translate,”Computer Science, 2014
13. W. Yin, H. Schütze, B. Xiang,B. Zhou, “ABCNN: Attention-based Convolutional Neural Network for Modeling Sentence Pairs,”Computer Science, 2015
14. Q. H. Vo, H. T. Nguyen, B. Le,M. L. Nguyen, “Multi-Channel LSTM-CNN Model for Vietnamese Sentiment Analysis,” inProceedings of International Conference on Knowledge and Systems Engineering, pp. 24-29, 2017
15. M. T. Luong, H. Pham,C. D. Manning, “Effective Approaches to Attention-based Neural Machine Translation,”Computer Science, pp. 1412-1421, 2015
16. Y. Bengio and O. Delalleau, “On the Expressive Power of Deep Architectures,” inProceedings of International Conference on Algorithmic Learning Theory, pp. 18-36, 2011
17. T. Mikolov, K. Chen, G. Corrado,J. Dean, “Efficient Estimation of Word Representations in Vector Space,”Computer Science, 2013

[1]	C. Rohith Bhat and Madhusundar Nelson. Artificial Intelligence Based Credit Card Fraud Detection for Online Transactions Optimized with Sparrow Search Algorithm [J]. Int J Performability Eng, 2023, 19(9): 624-632.
[2]	Neha Kohli and Tapas Kumar. Envisaging Alzheimer’s Disease Stage through Fuzzy Rank-Based Ensemble of Transfer Learning Models [J]. Int J Performability Eng, 2023, 19(6): 397-406.
[3]	Manvi Khatri and Ajay Sharma. Deep Learning Approach based on Iris, Face, and Palmprint Fusion for Multimodal Biometric Recognition System [J]. Int J Performability Eng, 2023, 19(6): 407-416.
[4]	Pavneet Singh, Jigyasa Chopra, Amandeep Singh, Nikita Nijhawan, and Kritika. Deep Learning Innovations for Enhanced Drusen Detection in Retinal Images [J]. Int J Performability Eng, 2023, 19(12): 779-787.
[5]	Saumya Kumar, Puneet Goswami, and Shivani Batra. Enriched Diagnosis of Osteoporosis using Deep Learning Models [J]. Int J Performability Eng, 2023, 19(12): 824-833.
[6]	Sonika Jindal, Monika Sachdeva, and Alok Kumar Singh Kushwaha. Human Activity Recognition using Ensemble Convolutional Neural Networks and Long Short-Term Memory [J]. Int J Performability Eng, 2022, 18(9): 660-667.
[7]	Roop Preet Kaur, Anshu Sharma, Inderpal Singh, and Rahul Malhotra. Deep Learning-Based Pneumonia Recognition from Chest X-Ray Images [J]. Int J Performability Eng, 2022, 18(5): 380-386.
[8]	Guilan Dai, Jie Zhang, and Xu Han. A Novel Attention-Based BiLSTM-CNN Model in Valence-Arousal Space [J]. Int J Performability Eng, 2022, 18(12): 833-843.
[9]	Sakshi Arora, Sapna Sinha, and Himanshu Monga. Argument that Hits the Gong using Sentiment Mantra: An Empirical Study [J]. Int J Performability Eng, 2022, 18(12): 874-884.
[10]	Revati M. Wahul, Archana P. Kale, and Abhishek D. Patange. Health Monitoring of Turning Tool through Vibration Signals Processed using Convolutional Neural Network Architecture [J]. Int J Performability Eng, 2022, 18(10): 730-740.
[11]	Angel Arul Jothi J and Razia Sulthana A. A Review on the Literature of Fashion Recommender System using Deep Learning [J]. Int J Performability Eng, 2021, 17(8): 695-702.
[12]	Chhabra Megha, Shukla Manoj Kumar, and Ravulakolluc Kiran Kumar. Intelligent Optimization of Latent Fingerprint Image Segmentation using Stacked Convolutional Autoencoder [J]. Int J Performability Eng, 2021, 17(4): 379-393.
[13]	Razia Sulthana A., Arokiaraj Jovith, and Jaithunbi A. K.. LSTM and RNN to Predict COVID Cases: Lethality’s and Tests in GCC Nations and India [J]. Int J Performability Eng, 2021, 17(3): 299-306.
[14]	Abdul Ghafoor Etemad, Ali Imam Abidi, and Megha Chhabra. Fine-Tuned T5 for Abstractive Summarization [J]. Int J Performability Eng, 2021, 17(10): 900-906.
[15]	Chuan Zhao, Yan Song, Min Zuo, and Hongji Yang. Performance Analysis for Green Food in Dual-Channel Supply Chain Considering Fairness Concern [J]. Int J Performability Eng, 2021, 17(1): 155-166.

Dual-Channel Attention Model for Text Sentiment Analysis

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended 0