Advanced search ?

Object

Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic, Journal of Telecommunications and Information Technology, 2022, nr 3
Download

Title: Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic, Journal of Telecommunications and Information Technology, 2022, nr 3

Creator:

Khairnar, Vaishali ; Bavkar, Dnyaneshwar Madhukar ; Kashyap, Ramgopal

Date:

2022, nr 3

Resource Type:

artykuł

Description:

This work aims to provide a novel multimodal sarcasm detection model that includes four stages: pre-processing, feature extraction, feature level fusion, and classification. The pre-processing uses multimodal data that includes text, video, and audio. Here, text is pre-processed using tokenization and stemming, video is pre-processed during the face detection phase, and audio is pre-processed using the filtering technique. During the feature extraction stage, such text features as TF-IDF, improved bag of visual words, n-gram, and emojis as well on the video features using improved SLBT, and constraint local model (CLM) are extraction. Similarly the audio features like MFCC, chroma, spectral features, and jitter are extracted. Then, the extracted features are transferred to the feature level fusion stage, wherein an improved multilevel canonical correlation analysis (CCA) fusion technique is performed. The classification is performer using a hybrid classifier (HC), e.g. bidirectional gated recurrent unit (Bi-GRU) and LSTM. The outcomes of Bi-GRU and LSTM are averaged to obtain an effective output. To make the detection results more accurate, the weight of LSTM will be optimally tuned by the proposed opposition learning-based aquila optimization (OLAO) model. The MUStARD dataset is a multimodal video corpus used for automated sarcasm Discovery studies. Finally, the effectiveness of the proposed approach is proved based on various metrics.

Publisher:

Instytut Łączności - Państwowy Instytut Badawczy

Format:

application/pdf

Resource Identifier:

ISSN 1509-4553, on-line: ISSN 1899-8852 ; oai:bc.itl.waw.pl:2242

Source:

Journal of Telecommunications and Information Technology

Language:

ang

Rights Management:

Biblioteka Naukowa Instytutu Łączności

Subject and keywords:

LSTM networks Bi-GRU improved CCA multimodal sarcasm detection

Object collections:

Last modified:

Mar 13, 2024

In our library since:

Feb 7, 2023

Number of object content hits:

13

All available object's versions:

https://bc.itl.waw.pl/publication/2551

Show description in RDF format:

RDF

Show description in OAI-PMH format:

OAI-PMH

Edition name Date
Bavkar, Dnyaneshwar Madhukar, 2022, nr 3, Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic, Journal of Telecommunications and Information Technology, 2022, nr 3 Mar 13, 2024

Objects Similar
Application of Recurrent Neural Networks for User Verification based on Keystroke Dynamics, Journal of Telecommunications and Information Technology, 2016, nr 3

Kobojek, Paweł Saeed, Khalid

2016, nr 3
artykuł
More
×

Citation

Citation style:

Contact details

Address

Instytut Łączności – Państwowy Instytut Badawczy ul. Szachowa 1 04-894 Warszawa

Phone

(+48) 5128 696

E-Mail

biblioteka@il-pib.pl

Visit us!

This page uses 'cookies'. More information