CORTEXA
← Browse
openalexZenodo (CERN European Organization for Nuclear Research)2026-07-25Cited by 0

Multi-Modal Deepfake Detection System Using Hybrid Deep Learning on Visual and Audio Features

Nandana K Gowda, P Hemavathi

Abstract: Deepfake technology, driven by generative models such as GANs and diffusion architectures, has enabled the creation of highly realistic manipulated media capable of deceiving both visual and auditory perception. Such forgeries pose significant risks to identity verification, digital forensics, and public trust. Existing detection methods are often restricted to single modalities or handcrafted features, limiting their robustness against high-quality cross-modal deepfakes. This work presents a multi-modal deepfake detection framework that integrates visual and audio analysis. The system employs a ResNet-based backbone for spatial feature extraction, Bi-LSTM encoders for temporal modeling in videos, and a 2D CNN with Random Forest classification for speech-based anomaly detection. An attention-based late-fusion strategy combines outputs to generate reliable predictions with calibrated confidence scores. Experimental results demonstrate high performance, with training accuracy reaching 98% and validation accuracy of 92% on benchmark datasets. The system is deployed as a Flask-based web application, enabling real-time detection and interpretable outputs.

View free PDFSource page

Related papers

openalexZenodo (CERN European Organization for Nuclear Research)

M3SpaDE: A Multi-Modal Deep Learning Framework for Predicting Spatially Resolved Drug Responses

Zihao Zhang, Xinyu Cui, Zhengke Lian, Xiufeng Pang, Ye, Youqiong, Jiang, Cizhong

M3SpaDE (Multi-Modal Model for predicting Spatial Drug Efficacy) is a versatile computational framework designed for predicting drug sensitivity in spatial transcriptomics data. It is resolution-agnostic, capable of processing data ranging from single-cell to spot-level resolutio…

Also available via: European Organization for Nuclear Research

View free PDFSource page
openalexZenodo (CERN European Organization for Nuclear Research)

Data used in "Multi-omics integration and batch correction using a modality-agnostic deep learning framework"

Jose Ignacio Alvira Larizgoitia, Gabriele Partel, Jelle Jacobs, Alejandro Sifrim

These are multimodal dataset objects and trained model parameters used in the study. The files are organized in pairs, where each multimodal dataset (.h5mu file) corresponds to a trained model parameter file (.pt) generated using the MIMA (Multimodal Integration with Modality-agn…

Also available via: European Organization for Nuclear Research

View free PDFSource page
openalexZenodo (CERN European Organization for Nuclear Research)2026-07-26

Automated Detection of Self-Harm Wounds Using Deep Learning and Image Processing in Forensic Medicine

A Mohammadi, Mahdi Mehrabi, Seyed Mohammad Saadatneshan, Kamroz Amini, Mahdi Gheysari

Background and Objective: Self-harm is a psychologically damaging behavior, and its accurate differentiation from other wounds (violence, accidents, burns, diabetic ulcers) is critically important in forensic medicine. However, this differentiation often falls into a diagnostic "…

View free PDFSource page
openalexZenodo (CERN European Organization for Nuclear Research)2026-07-26

Supplementary Materials for "Beyond grades: multi-target deep learning for early academic risk detection"

Miguel Angel Rodríguez Ortiz, Luis Anido-Rifón, Pedro C. Santana-Mancilla

This repository contains the supplementary materials associated with the article: “Beyond Grades: Multi-Target Deep Learning for Early Academic Risk Detection” The materials support the transparency, reproducibility, interpretability, and pedagogical analysis of the leakage-free…

View free PDFSource page
openalexZenodo (CERN European Organization for Nuclear Research)2026-07-23

Sensor Validator v3.5: Adaptive Multi-Modal Sensor Validation and Threat Detection Framework

Niall Devlin

Sensor Validator v3.5 is a Python-based framework for adaptive validation of environmental and chemical sensor systems. The platform combines multi-modal feature extraction, anomaly detection, machine-learning classification, drift monitoring, automatic recalibration, hardware ab…

View free PDFSource page
openalexZenodo (CERN European Organization for Nuclear Research)2026-07-26

ML Precipitation Prediction: Hybrid Deep Learning for Spatiotemporal Forecasting in Mountainous Areas

Manuel Ricardo Perez Reyes

A hybrid deep learning framework for monthly precipitation prediction in mountainous areas of Boyacá, Colombia. Combines Graph Neural Networks (GNN) with temporal attention mechanisms and ConvLSTM architectures for accurate spatiotemporal forecasting. This implementation includes…

View free PDFSource page