Model and Algorithms for Classifying Anomalous Phenomena based on the Convergence of Acoustic-Visual Signals

Ravshanov, N., Boborakhimov, B.I., Berdiev, M.I., Равшанов, Н., Боборахимов, Б.И., Бердиев, М.И.

Ҳисоблаш ва амалий математика муаммолари · 2026-yil

Annotatsiya

This paper proposes a Context-adaptive Audio-Visual Neural Network (CAVN) model for anomaly detection in public safety systems. Existing approaches primarily rely on visual data and employ simple fusion strategies for combining modalities, which leads to limitations in capturing complex semantic relationships. The proposed model consists of four main components: a visual feature extraction module based on SlowFast architecture, an audio feature extraction module based on Audio Spectrogram Transformer (AST), a fusion module based on bidirectional cross-attention mechanism, and a temporal context aggregation module based on Transformer encoder. The main scientific novelty of the model lies in the adaptive modality balancing mechanism, which dynamically adjusts the relative importance of modalities under different conditions (dark/bright, noisy/quiet). Experimental results demonstrate that the proposed CAVN model outperforms existing methods by in overall accuracy and by in dark conditions. Ablation studies confirmed the contribution of each module to the overall performance.

Maqola ma’lumotlari
MualliflarRavshanov, N., Boborakhimov, B.I., Berdiev, M.I., Равшанов, Н., Боборахимов, Б.И., Бердиев, М.И.
JurnalҲисоблаш ва амалий математика муаммолари
Nashr sanasi2026-01-11
Son6
Betlar88-102
TilIngliz
DOI10.71310/pcam.6_70.2025.07

Kalit so‘zlar

dynamic weighting, spatiotemporal representation learning, attention-based alignment, robust anomaly recognition, real-world surveillance, динамическое взвешивание модальностей, пространственно-временное представление, выравнивание на основе внимания, устойчивое распознавание аномалий, видеонаблюдение в реальных условиях

Ilmiy soha

Ҳисоблаш ва амалий математика муаммолари jurnalidan boshqa maqolalar

Ҳисоблаш ва амалий математика муаммолари — barcha maqolalar