Title:

Enhancing Biometric Security with Bimodal Deep Learning and Feature-Level Fusion of Facial and Voice Data, Journal of Telecommunications and Information Technology, 2024, nr 4

Group publication title:

2024, nr 4, JTIT-artykuły

Creator:

Merit, Khaled ; Beladgham, Mohammed

Subject and Keywords:

biometric recognition ; deep learning ; multimodal systems ; SincNet ; voice modality

Abstrakt:

Recent research in biometric technologies underscores the benefits of multimodal systems that use multiple traits to enhance security by complicating the replication of samples from genuine users. To address this, we present a bimodal deep learning network (BDLN or BNet) that integrates facial and voice modalities. Voice features are extracted using the SincNet architecture, and facial image features are obtained from convolutional layers. Proposed network fuses these feature vectors using either averaging or concatenation methods. A dense connected layer then processes the combined vector to produce a dual-modal vector that encapsulates distinctive user features. This dual-modal vector, processed through a softmax activation function and another dense connected layer, is used for identification. The presented system achieved an identification accuracy of 99% and a low equal error rate (EER) of 0.13% for verification. These results, derived from the VidTimit and BIOMEX-DB datasets, highlight the effectiveness of the proposed bimodal approach in improving biometric security.

Number:

4

Publisher:

National Institute of Telecommunications

Date:

2024

Resource Type:

artykuł

Resource Identifier:

ISSN 1509-4553, on-line: ISSN 1899-8852

DOI:

10.26636/jtit.2024.4.1754

ISSN:

1509-4553

eISSN:

1899-8852

Source:

Journal of Telecommunications and Information Technology

Language:

ang

License:

CC BY 4.0

rights owner:

Instytut Łączności - Państwowy Instytut Badawczy