Tytuł:

Enhancing Biometric Security with Bimodal Deep Learning and Feature-Level Fusion of Facial and Voice Data, Journal of Telecommunications and Information Technology, 2024, nr 4

Tytuł publikacji grupowej:

2024, nr 4, JTIT-artykuły

Autor:

Merit, Khaled ; Beladgham, Mohammed

Temat i słowa kluczowe:

biometric recognition ; deep learning ; multimodal systems ; SincNet ; voice modality

Abstrakt:

Recent research in biometric technologies underscores the benefits of multimodal systems that use multiple traits to enhance security by complicating the replication of samples from genuine users. To address this, we present a bimodal deep learning network (BDLN or BNet) that integrates facial and voice modalities. Voice features are extracted using the SincNet architecture, and facial image features are obtained from convolutional layers. Proposed network fuses these feature vectors using either averaging or concatenation methods. A dense connected layer then processes the combined vector to produce a dual-modal vector that encapsulates distinctive user features. This dual-modal vector, processed through a softmax activation function and another dense connected layer, is used for identification. The presented system achieved an identification accuracy of 99% and a low equal error rate (EER) of 0.13% for verification. These results, derived from the VidTimit and BIOMEX-DB datasets, highlight the effectiveness of the proposed bimodal approach in improving biometric security.

Numer:

4

Wydawca:

National Institute of Telecommunications

Data wydania:

2024, nr 4

Typ zasobu:

artykuł

Identyfikator zasobu:

ISSN 1509-4553, on-line: ISSN 1899-8852

DOI:

10.26636/jtit.2024.4.1754

ISSN:

1509-4553

eISSN:

1899-8852

Źródło:

Journal of Telecommunications and Information Technology

Język:

ang

Licencja:

CC BY 4.0

Właściciel praw:

Instytut Łączności - Państwowy Instytut Badawczy