Accepted at ICASSP 2010 conference
This paper addresses an innovative approach to informed enhancement of damaged sound. It uses sparse approximations with a learned dictionary of atoms modeling the main components of the undamaged source spectra. The decomposition process aims at finding which of the atoms could constitute the decomposition of the undamaged source in order to recover it. The decomposition of the damaged signal is done with a Matching Pursuit algorithm and involves an adaptation of the dictionary learned on undamaged sources. The technique has been evaluated on synthetic signals, and encouraging results are proposed for a real trumpet signal.
Experiments and Results
For Synthetic signals, original signal is a harmonic serial, which fundamental frequency is 400Hz, has 40 partials with exponentially decreasing amplitudes, thus having energy up to 16KHz. The signal is also temporally windowed by a Gaussian window.
The learning process is conducted on a set of similar signals, having only their fundamental frequencies varying.
The results are the following:
For one note:
synthetic_damaged_fc6k_destructif
synthetic_restored_fc6k_destructif
For a mix of two notes:
synthetic_2notes_damaged_fc5k_destructif
synthetic_2notes_recovered_fc5k_destructif
It sounds like a buzz. Damaged signal is the same except for which we intentionally destroyed frequencies above 8KHz, and sounds like the original being heavily filtered. This damaging is destructive, which means all partials above 8KHz are really destroyed, not just lowered.
The enhancement method manages to recreate missing parts of the spectrum, by replacing atoms from the processed dictionary by corresponding full band versions of the same atoms. It can easily be heard that the reconstituted signal is very close to the original one, and that a great part of missing frequencies have been reconstructed.
The results are the following:
For a single trumpet note:
carioca_1note_dicodifferent_damaged_fc6k_destructif
carioca_1note_dicodifferent_recovered_fc6k_destructif
For a full phrase: