| A. Krouska, C. Troussas, C. Sgouropoulou, Ph. Mylonas, I. Voyiatzis, A. Sotiropoulou, Y. Voutos, N. Marava, N. Vordonis |
| Multimodal Misinformation Detection on Social Media Using Graph-Enhanced Cross-Modal Fusion and Temporal Attention |
| 11th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM 2026), Thessaloniki, Greece, September 18-20, 2026 |
|
ABSTRACT
|
| Misinformation spread rapidly over social networks constitutes a severe challenge to public discourse, democracy, and public health. Current methods for detection either utilize single modality learning or naive fusion mechanisms which cannot model the interplay between text claim, visual proof, and propagation patterns. We propose MMGF (Multimodal Graph-enhanced Fusion) which provides a novel multimodal approach by fusing text, visual, and social context information respectively by RoBERTa, Vision Transformer, and Graph Attention Networks, a cross-modality attention mechanism captures fine-grained inter-modal dependencies, while temporal attention can well reflect the changing patterns of information spread. Extensive experiments on 5 benchmark datasets with two different languages and types of contents show that MMGF can achieve state-of-the-art performance with average F1-score of 0.929, surpassing the unimodal baseline with average 5.0 percentage points, and previous multimodal work with average 2.1 percentage points. With the earliest detection task, MMGF achieves 0.904 F1-score just within 4 hours since publication which helps take prompt measure against malicious information, and ablation study validates the benefit from each modality and fusion element.
|
| 18 September, 2026 |
| A. Krouska, C. Troussas, C. Sgouropoulou, Ph. Mylonas, I. Voyiatzis, A. Sotiropoulou, Y. Voutos, N. Marava, N. Vordonis, "Multimodal Misinformation Detection on Social Media Using Graph-Enhanced Cross-Modal Fusion and Temporal Attention", 11th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM 2026), Thessaloniki, Greece, September 18-20, 2026 |
[
BibTex] [
Print] [
 Back] |
