Contributions in Audio Modeling and Multimodal Data Analysis via Machine Learning - TEL - Thèses en ligne Accéder directement au contenu
Hdr Année : 2020

Contributions in Audio Modeling and Multimodal Data Analysis via Machine Learning

Ngoc Q. K. Duong
  • Fonction : Auteur
  • PersonId : 1078982

Résumé

This HDR manuscript summarizes our work concerning the applications of machine learning techniques to solve various problems in audio and multimodal data. First, we will present nonnegative matrix factorization (NMF) modeling of audio spectrograms to address audio source separation problem, both in single-channel and multichannel settings. Second, we will focus on the multiple instance learning (MIL)-based audio-visual representation learning approach, which allows to tackle several tasks such as event/object classification, audio event detection, and visual object localization. Third, we will present contributions in the multimodal multimedia interestingness and memorability, including novel dataset constructions, analysis, and computational models. This summary is based on major contributions published in three journal papers in the IEEE/ACM Transactions on Audio, Speech, and Language Processing, and a paper presented at the International Conference on Computer Vision (ICCV). Finally, we will briefly mention our other works in different applications concerning audio synchronization, audio zoom, audio classification, audio style transfer, speech inpainting, and image inpainting.
Fichier principal
Vignette du fichier
HDRthesis.pdf (16.77 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

tel-02963685 , version 1 (11-10-2020)

Identifiants

  • HAL Id : tel-02963685 , version 1

Citer

Ngoc Q. K. Duong. Contributions in Audio Modeling and Multimodal Data Analysis via Machine Learning. Machine Learning [stat.ML]. Université de Rennes 1, 2020. ⟨tel-02963685⟩
149 Consultations
42 Téléchargements

Partager

Gmail Facebook X LinkedIn More