Please use this identifier to cite or link to this item:
Appears in Collections:Computing Science and Mathematics Journal Articles
Peer Review Status: Refereed
Title: Fusing audio, visual and textual clues for sentiment analysis from multimodal content
Authors: Poria, Soujanya
Cambria, Erik
Howard, Newton
Huang, Guang-Bin
Hussain, Amir
Contact Email:
Keywords: Multimodal fusion
Big social data analysis
Opinion mining
Multimodal sentiment analysis
Sentic computing
Issue Date: 22-Jan-2016
Publisher: Elsevier
Citation: Poria S, Cambria E, Howard N, Huang G & Hussain A (2016) Fusing audio, visual and textual clues for sentiment analysis from multimodal content, Neurocomputing, 174 (A), pp. 50-59.
Abstract: A huge number of videos are posted every day on social media platforms such as Facebook and YouTube. This makes the Internet an unlimited source of information. In the coming decades, coping with such information and mining useful knowledge from it will be an increasingly difficult task. In this paper, we propose a novel methodology for multimodal sentiment analysis, which consists in harvesting sentiments from Web videos by demonstrating a model that uses audio, visual and textual modalities as sources of information. We used both feature- and decision-level fusion methods to merge affective information extracted from multiple modalities. A thorough comparison with existing works in this area is carried out throughout the paper, which demonstrates the novelty of our approach. Preliminary comparative experiments with the YouTube dataset show that the proposed multimodal system achieves an accuracy of nearly 80%, outperforming all state-of-the-art systems by more than 20%.
Type: Journal Article
DOI Link:
Rights: The publisher does not allow this work to be made publicly available in this Repository. Please use the Request a Copy feature at the foot of the Repository record to request a copy directly from the author. You can only request a copy if you wish to use this work for your own research or private study.
Affiliation: University of Stirling
Nanyang Technological University
Massachusetts Institute of Technology
Nanyang Technological University
Computing Science - CSM Dept

Files in This Item:
File Description SizeFormat 
Neurocomputing-multimodal-sentiment-analysis-2016.pdf564.22 kBAdobe PDFUnder Embargo until 31/12/2999     Request a copy

Note: If any of the files in this item are currently embargoed, you can request a copy directly from the author by clicking the padlock icon above. However, this facility is dependant on the depositor still being contactable at their original email address.

This item is protected by original copyright

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact providing details and we will remove the Work from public display in STORRE and investigate your claim.