Skip to content

Commit

Permalink
update 2024 publications
Browse files Browse the repository at this point in the history
  • Loading branch information
yoyolicoris committed Sep 7, 2024
1 parent b19539a commit 50c73f2
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 0 deletions.
11 changes: 11 additions & 0 deletions _publications/2024-9-1-golf2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: "Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis"
collection: publications
permalink: /publications/2024-9-1-golf2
excerpt:
date: 2024-9-1
venue: 'INTERSPEECH'
paperurl: 'https://www.isca-archive.org/interspeech_2024/yu24b_interspeech.html'
citation: 'Chin-Yun Yu and György Fazekas, &quot;Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis&quot;, <i>Proc. Interspeech</i>, September 2024.'
---
Training the linear prediction (LP) operator end-to-end for audio synthesis in modern deep learning frameworks is slow due to its recursive formulation. In addition, frame-wise approximation as an acceleration method cannot generalise well to test time conditions where the LP is computed sample-wise. Efficient differentiable sample-wise LP for end-to-end training is the key to removing this barrier. We generalise the efficient time-invariant LP implementation from the GOLF vocoder to time-varying cases. Combining this with the classic source-filter model, we show that the improved GOLF learns LP coefficients and reconstructs the voice better than its frame-wise counterparts. Moreover, in our listening test, synthesised outputs from GOLF scored higher in quality ratings than the state-of-the-art differentiable WORLD vocoder.
11 changes: 11 additions & 0 deletions _publications/2024-9-3-diffapf.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: "Differentiable All-pole Filters for Time-varying Audio Systems"
collection: publications
permalink: /publications/2024-9-3-diffapf
excerpt:
date: 2024-9-3
venue: 'International Conference on Digital Audio Effects (DAFx)'
paperurl: 'https://github.com/IoSR-Surrey/DAFx24-Proceedings/raw/main/papers/DAFx24_paper_75.pdf'
citation: 'Chin-Yun Yu, Christopher Mitcheltree, Alistair Carson, Stefan Bilbao, Joshua Reiss and György Fazekas, &quot;Differentiable All-pole Filters for Time-varying Audio Systems&quot;, <i>International Conference on Digital Audio Effects</i>, September 2024.'
---
Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers. However, their recursive structure impedes end-to-end training of these systems using automatic differentiation. Although non-recursive filter approximations like frequency sampling and frame-based processing have been proposed and widely used in previous works, they cannot accurately reflect the gradient of the original system. We alleviate this difficulty by re-expressing a time-varying all-pole filter to backpropagate the gradients through itself, so the filter implementation is not bound to the technical limitations of automatic differentiation frameworks. This implementation can be employed within audio systems containing filters with poles for efficient gradient evaluation. We demonstrate its training efficiency and expressive capabilities for modelling real-world dynamic audio systems on a phaser, time-varying subtractive synthesiser, and feed-forward compressor. We make our code and audio samples available and provide the trained audio effect and synth models in a VST plugin at [this URL](https://diffapf.github.io/web/).

0 comments on commit 50c73f2

Please sign in to comment.