Invented new sound synthesis techniques

For enthusiasts of synths, pianos, organs or keyboard instruments of any sort.

Invented new sound synthesis techniques

Post by doctornash »

I'd like to present a documentary showcasing the results from the past 5 years of my R&D in sound synthesis, compressed into 8 minutes. Features a few new methods of generating and controlling sound which you won't see in 'standard articles/tutorials' on the subject online, in magazines or in texts, or in most (and indeed in some cases ANY) plugins/hardware:
Innovations In Sound Synthesis

All the apps discussed in the video and further details about the theory of each synthesis method they are based on, freely available from here (I'll soon be uploading all the source code to the site as well):
Flexibeatz

...and fittingly, a couple of extra-terrestrials 'performing live' a song with all sounds produced with these 'alien' techniques :) :
Aliens Live
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by muzines »

Interesting stuff.

There isn't much of a developer hang out here, I think the number of us here that really understand these kind of DSP maths is probably a small handful. You might get more of a response and discussion posting to the KVR DSP and Developer forum, perhaps?
User avatar
muzines
Jedi Poster
Posts: 12332 Joined: Tue Jan 10, 2006 12:00 am
..............................mu:zines | music magazine archive | difficultAudio  | Legacy Logic Project Conversion

Re: Invented new sound synthesis techniques

Post by Martin Walker »

Hi Jim,

And welcome to the SOS Forums! 8-)

Many thanks for your post - the video (and associated sound samples) are fascinating.
I love the Stochastic Bezier sounds in particular!

Martin
User avatar
Martin Walker
Moderator
Posts: 22128 Joined: Wed Jan 13, 2010 8:44 am Location: Cornwall, UK

Re: Invented new sound synthesis techniques

Post by shurikt »

Fascinating stuff, Jim. Thanks for sharing!
User avatar
shurikt
Poster
Posts: 57 Joined: Wed Nov 27, 2002 12:00 am Location: Las Vegas

Re: Invented new sound synthesis techniques

Post by damoore »

Very interesting. The Bezier idea in particular. You could use that as the basis for additive synthesis too.
damoore
Frequent Poster
Posts: 981 Joined: Sun Jul 05, 2009 12:00 am Location: New Hampshire

Re: Invented new sound synthesis techniques

Post by doctornash »

Bezier curves are indeed versatile beasts. For example, Phase-Warper allows the x and y co-ordinates of a single ‘bend point’ of a phase-distorting vector to be graphically altered, but now I’m experimenting with using a Bezier curve to distort the phase, yielding a different sonic palette than a‘hinged vector’. So that’s already three uses for a Bezier curve in three different applications – change the position of its control points with probability functions, modulate the control points, and use a Bezier to distort phase :shock:
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by Folderol »

Mmmm. Bezier curves. They even look sexy :tongue:

As you read this post you get the uncanny feeling that it's main purpose is to act as a marker for future reading :roll:
User avatar
Folderol
Forum Aficionado
Posts: 20314 Joined: Sat Nov 15, 2008 12:00 am Location: The Mudway Towns, UK
Seemingly no longer an 'elderly'.
Now a 'Senior'. Is that promotion?

Re: Invented new sound synthesis techniques

Post by ramthelinefeed »

What a splendid video! Very well presented
ramthelinefeed
Frequent Poster
Posts: 2425 Joined: Mon Jun 23, 2003 12:00 am Location: UK
A weasel hath not such a deal of spleen as you are tossed with! 

Re: Invented new sound synthesis techniques

Post by Martin Walker »

Indeed - a large round of applause from everyone is in order ;)

Martin
User avatar
Martin Walker
Moderator
Posts: 22128 Joined: Wed Jan 13, 2010 8:44 am Location: Cornwall, UK

Re: Invented new sound synthesis techniques

Post by doctornash »

Thanks everyone for your support - it does encourage me to continue the research into brand new ways of generating/designing sound. My focus will remain on applying processes and techniques unrelated to traditional synthesis, to the 'micro' (waveform samples) level of sound. I'll also continue to post apps and related theory of anything promising, on my site as I go along (after of course first checking that something similar hadn't already been done - I've withheld the release of 3 apps at various stages of completion so far, after uncovering or being advised of something that was a bit 'too close')
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by doctornash »

As far as I can tell, another sonic first: "Synth Of Sorts" features a sound generation engine based on sorting algorithms. I'm yet to release it but I've uploaded a video of it in action as the second instalment in my 'Innovations In Sound Synthesis' series :D
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by muzines »

Hey, that's a really neat idea! Using sorting algorithms to generate a new waveshape is not in itself that interesting (there are lots of waves to generate sample values, etc), but that you create a wavetable from the *process* of the sort while it's working, and then use that as a regular sweepable wavetable is very cool! 8-)

Many of the results sound quite a lot like Casio's PD synthesis in character, and PD itself used in those synths often starts with bright waves and uses the DCW envelopes to shape down to a sine wave.
User avatar
muzines
Jedi Poster
Posts: 12332 Joined: Tue Jan 10, 2006 12:00 am
..............................mu:zines | music magazine archive | difficultAudio  | Legacy Logic Project Conversion

Re: Invented new sound synthesis techniques

Post by Eddy Deegan »

This was really interesting, thanks for posting this. The bit-twiddler is vaguely similar to something I was trying to do myself in Audulus a little while ago, though your results are way better than mine (I'm no mathematician). I'd really like to see how far some of these methods could be taken in a plugin, or even DSP/FPGA-driven hardware.

The control methods also look to be very suitable for something along the lines of Lemur or other touch-related interfaces. Good stuff!
User avatar
Eddy Deegan
Moderator
Posts: 9736 Joined: Wed Sep 01, 2004 12:00 am Location: Brighton & Hove, UK
Some of my works | The SOS Forum Album projects | My Jamuary 2025 works

Re: Invented new sound synthesis techniques

Post by Folderol »

very interesting.
User avatar
Folderol
Forum Aficionado
Posts: 20314 Joined: Sat Nov 15, 2008 12:00 am Location: The Mudway Towns, UK
Seemingly no longer an 'elderly'.
Now a 'Senior'. Is that promotion?

Re: Invented new sound synthesis techniques

Post by muzines »

Eddy Deegan wrote:I'd really like to see how far some of these methods could be taken in a plugin, or even DSP/FPGA-driven hardware.

Well really, you wouldn't want to be using CPU-intensive methods for generating waveforms in real time - like any digital oscillator, it makes most sense to pre-compute values or use some fast methods to generate samples, so I'd guess that if this were being taken into some practical form (ie, a synth/instrument plugin) it will be using these methods to generate wavetables, which, once generated, could be used like any other digital wavetable.

And indeed, you could already use these methods to generate wavetable files that could be loaded into plugins that support custom wavetables.

I'm sure there are other applications for these methods, too...
User avatar
muzines
Jedi Poster
Posts: 12332 Joined: Tue Jan 10, 2006 12:00 am
..............................mu:zines | music magazine archive | difficultAudio  | Legacy Logic Project Conversion

Re: Invented new sound synthesis techniques

Post by Martin Walker »

doctornash wrote:As far as I can tell, another sonic first: "Synth Of Sorts" features a sound generation engine based on sorting algorithms. I'm yet to release it but I've uploaded a video of it in action as the second instalment in my 'Innovations In Sound Synthesis' series :D

Hey doctornash, that's another fascinating video - well done!

You really do have some fascinating ideas! 8-)

Martin
User avatar
Martin Walker
Moderator
Posts: 22128 Joined: Wed Jan 13, 2010 8:44 am Location: Cornwall, UK

Re: Invented new sound synthesis techniques

Post by Alperian »

Yes. Great Post. It had me looking through Adobe Photoshop and Illustrator for new audio mashing ideas in their filters. I also can see the bezier one being very powerful (yet could we be its master?).
Alperian
Poster
Posts: 60 Joined: Fri Nov 13, 2015 12:00 am Location: Oxfordshire UK

Re: Invented new sound synthesis techniques

Post by doctornash »

I also can see the bezier one being very powerful (yet could we be its master?)

This is a very interesting point. Blowfly in its current form is an example of an 'autonomous instrument' - where one doesn't 'interact' with it in the strict sense of the term. One can 'guide' it by setting rules and boundary conditions as it plays but within that framework, it still 'kind of does its own thing'.

An area of particular interest to me (not least because it has been explored so little) is that of semi-autonomous instruments. An example of this is Chaosorus - which I focus on in this video I just uploaded.

The phase of a sine oscillator is perturbed by two small functions and depending on the parameter values of these functions, a variety of sounds are produced ranging from rhythmic noise to glitch effects to pitch gliding tones and chip-tune like melodies. What makes it semi-autonomous is that although you don't initially know what you'll get across the keyboard for the various parameter values, the same settings will produce the same results, so you can actually compose something with what it produces, and this is what I've tried to show in the video.

In other words at its heart is a process which at a lower level generates self-organized sound, yet at a higher level lets you play and arrange the sound sequences in the traditional composition sense. I think an enabler for creativity is to let go of at least some conscious control one has over the creative process...but not too much :D
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by doctornash »

So, since my coding laptop has suddenly decided it is done with dutifully following instructions, opting for an eternal slumber instead :thumbdown:, I thought I'd take the 'opportunity' to make another edu-demo video (something I quite enjoy but don't normally get enough time to do).
It's likely the last one I'll do from my 'back catalog' before continuing with exploration and development on one of my other machines - it's for 'NeuronoiZ':
Synth based on brain cell voltage waveforms
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by doctornash »

Evolved another sound synthesis technique which I've coined 'NHT' (Nested Hyberbolic and Trigonometric functions) synthesis, and here is a video I just posted explaining what it is, showcasing the free softsynth I developed which implements it, and demonstrating some of the unique and interesting sounds you can make with it :)
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by Agharta »

Very interesting. I watched a few videos and will download some of your software when next at the PC.
Thanks for sharing.
Agharta
Frequent Poster
Posts: 4350 Joined: Sat Oct 30, 2004 12:00 am

Re: Invented new sound synthesis techniques

Post by Martin Walker »

Wow, that's fascinating stuff! :clap:

Nested Hyberbolic and Trigonometric functions synthesis is certainly versatile.

Bravo the mathematician - if only numbers had been so creative when I was still at school ;)

Martin
User avatar
Martin Walker
Moderator
Posts: 22128 Joined: Wed Jan 13, 2010 8:44 am Location: Cornwall, UK

Re: Invented new sound synthesis techniques

Post by Eddy Deegan »

Great stuff... the way that the waveform changes with NHT when you modify the arguments reminds me a bit of FM synthesis for some reason (sort of modifying one wave using another).

The proof of any synthesis model is surely in the listening thereof and the tones emitting from your project are very impressive considering you're building your own engine.

Not directly related to NHT, and I'm no mathematician (a bit of trig, and mental arithmetic is about as far as I can go comfortably) but as you seem to be much more comfortable in number-world, I was wondering if there is any mileage in using differential calculus somehow to generate a set of waveforms from the derivatives of a function across its domain in steps of varying sizes - these then could be merged/modulated/spangulotomised in creative ways to render a timbre. Maybe that's a bit random, and to be honest I don't know enough about it to offer anything more than a naive suggestion but hey :)
Last edited by Eddy Deegan on Tue Aug 29, 2017 8:39 pm, edited 1 time in total.
User avatar
Eddy Deegan
Moderator
Posts: 9736 Joined: Wed Sep 01, 2004 12:00 am Location: Brighton & Hove, UK
Some of my works | The SOS Forum Album projects | My Jamuary 2025 works

Re: Invented new sound synthesis techniques

Post by doctornash »

Here's the latest from my ongoing quest to discover and implement new sound synthesis techniques. The video explains and demonstrates the generation of sound waveforms from the motion of the vertices of rotating 3D-modelled objects. I've called the app 'Rotatosound' (originally thought of 'Rotosound' but that's already the name of a guitar string manufacturer) which implements this 'POVROS' (POlygon Vertex ROtation) sound synthesis method.
doctornash
New here
Posts: 13 Joined: Fri Apr 17, 2015 12:00 am

Re: Invented new sound synthesis techniques

Post by Martin Walker »

Wow - POVROS is certainly different ! 8-)

Martin
User avatar
Martin Walker
Moderator
Posts: 22128 Joined: Wed Jan 13, 2010 8:44 am Location: Cornwall, UK
Post Reply