Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More variety with a limited set of audio samples: implement slight random variations during playback #25898

Open
2 tasks done
metasekk opened this issue Dec 21, 2024 · 1 comment
Labels
feature request Used to suggest improvements or new capabilities

Comments

@metasekk
Copy link

metasekk commented Dec 21, 2024

Your idea

Introduce a new optional behaviour in the MPE model to add slight random modulation in volume, pitch, and/or FFT filters to simulate natural fluctuations during playback. Such dynamic variations would mirror the imperfections of real takes. It would diversify the playback at a minimal cost, particularly for libraries with few samples (this potentially concerns all of them - MS Basic of course, but also Muse Sounds, and some VSTi whose playback engines don't have this random parameterization implemented).

I suppose it could take the form of an audio FX, alongside Muse Reverb for instance, but it shouldn't be limited to Muse Sounds, for the reasons noted above. It could be added to every instrument and managed separately for each of them.

For maximum transparency, the UI should allow the user to customize the percentage and type of randomization for every parameter that can be played with to diversify the playback:

  • The "amount" (standard deviation?) of noise added for: volume modulations, pitch modulations, attack and decay, filters...
  • Possibly, a preferred curve for filters, around which random phase and amplitude changes occur.

Problem to be solved

Even large librairies (with many samples for each note/dynamics) will sound unrealistic if a same note is overly repeated, which tends to happen a lot in modern composition. The "light" ones (e.g. MS Basic) do not just sound unrealistic because of the low quality of the samples, but also due to the highly repetitive nature of the playback.

Prior art

Most FX (eg Muse FX) do allow for a greater customization of the sounds using deterministic filters, but to my knowledge, none of them allows for greater diversity using random modulation of the playback parameters.

Algorithmically speaking, I suppose unique seeds would be necessary for each event to be randomised in a consistent (= the same) way everytime it is played.

Additional context

No response

Checklist

  • This request follows the guidelines for reporting issues
  • I have verified that this feature request has not been logged before, by searching the issue tracker for similar requests
@muse-bot muse-bot added the feature request Used to suggest improvements or new capabilities label Dec 21, 2024
@metasekk metasekk changed the title More variety in playback with a limited set of audio samples: implement slight random variations during playback More variety with a limited set of audio samples: implement slight random variations during playback Dec 21, 2024
@bkunda
Copy link

bkunda commented Dec 27, 2024

This is an area we are definitely keen to explore further as our playback system matures.

One issue I've noticed with software that randomizes playback parameters is that the results often lack realism. While skilled musicians never play the same passage in exactly the same way twice, their variations are not random—they're intentional. Subtle changes in tempo or accentuation, for example, are shaped by the musical concept the performer forms in their mind before they actually play or sing a note. These nuances can’t be replicated by simply randomizing parameter values.

So I think there's a way forward here, but it's not necessarily going to lie in randomization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request Used to suggest improvements or new capabilities
Projects
None yet
Development

No branches or pull requests

3 participants