Universidade Federal do Ceará
Programa de Pós-Graduação em Engenharia de Teleinformática

Defesa de Tese de Doutorado – Lucas de Paula Damasceno

Título: From Blind Source Separation to Misinformation Detection: Independent Vector Analysis With Flexible Statistical Modeling for Multimodal Data Fusion

Data: 24/11/2025
Horário: 14:00
Local: Google Meet – meet.google.com/pgd-ipvu-zgm

Banca Examinadora:
Charles Casimiro Cavalcante (UFC, Orientador)
Guilherme de Alencar Barreto (UFC)
Michela Mulas (UFC)
Anderson de Rezende Rocha (UNICAMP)
Leonardo Tomazeli Duarte (UNICAMP)
Zois Boukouvalas (American University)

Resumo:
The widespread dissemination of digital information through various communication channels has significantly altered the way societies generate, consume, and interpret knowledge. However, this shift has also accentuated the spread of misinformation. The intricate nature of this phenomenon lies in its inherently multimodal aspect, in which altered images, misleading texts, and synthetic media intertwine, forming false narratives that defy both human and machine comprehension. This thesis investigates the urgent issue of automated identification of multimodal misinformation based on a theoretical framework grounded in Independent Vector Analysis (IVA) and statistical signal analysis.

First, we review the theoretical foundation of IVA, understood as an extension of Independent Component Analysis (ICA), which expands its ability to model, in an integrated manner, multiple data sets by investigating the interdependencies between modalities. Based on this foundation, we propose a multivariate density estimation methodology based on the Maximum Entropy Principle (MEP), which combines global and local constraints through the Multivariate Entropy Maximization with Kernels (M-EMK) estimator. This estimator offers adaptive and expressive probability density functions, ensuring computational efficiency through Quasi-Monte Carlo integration, resulting in the development of the IVA-M-EMK algorithm. The proposed algorithm significantly improves performance in blind source separation by accurately identifying complex latent structures that are non-Gaussian and present multiple modalities.

Besides source differentiation, this thesis applies the proposed approach to identifying multimodal misinformation, in which various data types, including text, images, and semantic embeddings, are analyzed together to highlight underlying consistencies and contradictions. Recognizing that misleading signals often exhibit sparse and organized characteristics, IVA-SPICE is employed, which integrates structured sparsity through inverse covariance estimation, enabling the efficient processing of high-dimensional multimodal spaces. This methodical approach enables the model to recognize the most significant intermodal relationships while maintaining interpretability and robustness.

Experimental investigations reveal that the proposed framework, based on IVA, outperforms traditional unimodal and simplified fusion methodologies across multiple datasets, achieving greater accuracy, generalizability, and explainability. The results highlight the relevance of flexible density estimation and structured sparsity in modeling real-world multimodal data, given the constraints imposed by stringent assumptions and unclear fusion techniques.

In summary, this thesis establishes Independent Vector Analysis, combined with adaptive density modeling and structured sparsity, as a solid, scalable, and interpretable foundation for multimodal data integration. The research effectively establishes a link between statistical signal processing and reliable artificial intelligence, providing theoretical innovations and practical directions for improving adaptive and transparent systems for detecting disinformation.

Palavras-chave: Independent vector analysis; blind source separation; multimodal data fusion; misinformation detection; statistical modeling.