Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints - Department of Natural Language Processing & Knowledge Discovery Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints

Résumé

Audio source separation is often achieved by estimating the magnitude spectrogram of each source, and then applying a phase recovery (or spectrogram inversion) algorithm to retrieve time-domain signals. Typically, spectrogram inversion is treated as an optimization problem involving one or several terms in order to promote estimates that comply with a consistency property, a mixing constraint, and/or a target magnitude objective. Nonetheless, it is still unclear which set of constraints and problem formulation is the most appropriate in practice. In this paper, we design a general framework for deriving spectrogram inversion algorithm, which is based on formulating optimization problems by combining these objectives either as soft penalties or hard constraints. We solve these by means of algorithms that perform alternating projections on the subsets corresponding to each objective/constraint. Our framework encompasses existing techniques from the literature as well as novel algorithms. We investigate the potential of these approaches for a speech enhancement task. In particular, one of our novel algorithms outperforms other approaches in a realistic setting where the magnitudes are estimated beforehand using a neural network.
Fichier principal
Vignette du fichier
main.pdf (296.91 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04015991 , version 1 (06-03-2023)
hal-04015991 , version 2 (17-10-2023)

Identifiants

  • HAL Id : hal-04015991 , version 1

Citer

Paul Magron, Tuomas Virtanen. Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints. European Signal Processing Conference (EUSIPCO), European Association for Signal Processing (EURASIP), Sep 2023, Helsinki, Finland. ⟨hal-04015991v1⟩
39 Consultations
73 Téléchargements

Partager

Gmail Facebook X LinkedIn More