How to real time, dynamic pitch shifting?

Post fully complete "how to" guides and tutorials here. This is a great place to get feedback on stuff you might put in the wiki.

Moderators: MattKingUSA, khz

Post Reply
ndani
Established Member
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

How to real time, dynamic pitch shifting?

Post by ndani »

Hello everyone!

Autotalent is able to snap the input sound to the closest note, or to a scale, if it is adjusted.
VocProc can do something similar. But as I noticed, it somehow modulates togather the two signals. The output tone depends on the carrier's tone as well.

I'd like to make sing peoples who talk (on videos). But using VocProc, the vocie and carrirer inputs are modulated together somehow, so although the output sound is matching the carrier pitch, it has its "tone" too.

Both autotalent, and VocProc has pitch shifting features, but can only adjusted manually, not by the carrier pitch, witch would be best for me.

And then I realised, "autotune" is not the approperiate term for my goals, since I dont want to "auto" tune anything.

I'd like to pull an input sound to a carrier sound, which can be for example a sine wave.
My goal is to make sing talking people, by a keyboard for example.

Is there any pitch shifting solution which has two inputs? One for the sound to shift, and one for the reference signal to match? Preferrably jack compatible.

Thank you.
User avatar
Capoeira
Established Member
Posts: 1321
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil
Has thanked: 3 times
Been thanked: 2 times

Re: How to real time, dynamic pitch shifting?

Post by Capoeira »

use a real vocoder
there are some, lv2 and ladspa

also recently someone posted a howto-video here, think ot was autoStatic - search for it
User avatar
autostatic
Established Member
Posts: 1994
Joined: Wed Dec 09, 2009 5:26 pm
Location: Beverwijk, The Netherlands
Has thanked: 32 times
Been thanked: 104 times
Contact:

Re: How to real time, dynamic pitch shifting?

Post by autostatic »

Hello ndani,

You could try the LADSPA Vocoder, but it is somewhat similar to the vocoder part of VocProc.

Tiny Tutorial: Vocoding in Qtractor

I think you will need a combination of a vocoder and an autotuner. AutoTalent is unfortunately not so good but Fons Adriaensen just released an autotuner (Zita-AT1) and it is simply top notch, love it. If you're using Ubuntu 10.04 I have packages available in my PPA.

Zita-AT1 Ubuntu packages

Best,

Jeremy
Last edited by autostatic on Tue Oct 26, 2010 9:37 am, edited 7 times in total.
ndani
Established Member
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Post by ndani »

Hello, thanks for the reply.

It needs libzita resampler... Could you put me in direction?

I've found the video that you linked, but it is the method I tried, and don't liked. The input voice and carrier is mixed togather somehow. Makes it too robotic. My goal is something like the Gregory's work: http://www.youtube.com/watch?v=44mqiBrB0zI

"The 'expected' pitch can be controlled by Midi" (Zita AT1)
This sounds promishing...
User avatar
autostatic
Established Member
Posts: 1994
Joined: Wed Dec 09, 2009 5:26 pm
Location: Beverwijk, The Netherlands
Has thanked: 32 times
Been thanked: 104 times
Contact:

Re: How to real time, dynamic pitch shifting?

Post by autostatic »

ndani wrote:It needs libzita resampler... Could you put me in direction?
Yup, I have libzita-resampler packaged too: Zita-Resampler
ndani wrote:I've found the video that you linked, but it is the method I tried, and don't liked.
I understand, the video is about vocoding, not about extreme autotuning that you are after.
ndani wrote:"The 'expected' pitch can be controlled by Midi" (Zita AT1)
This sounds promishing...
It is promising indeed, I've played around with it and it's quite a precise and powerful tool.
ndani
Established Member
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Post by ndani »

Thanks for all your help.
I managed to make it work.
As I see, this zita really would do what I seek for. But not very well at the moment.
Maybe becouse of this: "AT1 does not include formant correction, so it should be used to correct small errors only and not to really transpose a song. "

If the input is a speech and a single note on the midi, it often slips out the tune, jumps octaves up and down.

It just work within one octave I think.

But the concept is right, i think, and its development is just begun.
ndani
Established Member
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Post by ndani »

I experimented a bit more.

The creators supposed, that someone who sings couldn't be as tonedeaf to sing one octave off. :)

In an actual speech the spectrum (or spectra in english?) can be much wider than this, that's make the glithces in the output.

IMHO
User avatar
Capoeira
Established Member
Posts: 1321
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil
Has thanked: 3 times
Been thanked: 2 times

Re: How to real time, dynamic pitch shifting?

Post by Capoeira »

AT1 is verrry nice
Autotalent and another ladspa wich I forgot the name i tried gave me unuable results but AT1 is really functional.
A shame that it can't be used as a effect directly in the DAW
User avatar
raboof
Established Member
Posts: 1855
Joined: Tue Apr 08, 2008 11:58 am
Location: Deventer, NL
Has thanked: 50 times
Been thanked: 74 times
Contact:

Re: How to real time, dynamic pitch shifting?

Post by raboof »

AutoStatic wrote:I have libzita-resampler packaged too: Zita-Resampler
Cool. It entered Debian recently (nov 8), so that might flow into ubuntu too: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=600831
AutoStatic wrote:Fons Adriaensen just released an autotuner (Zita-AT1) and it is simply top notch, love it. If you're using Ubuntu 10.04 I have packages available in my PPA.
Alessio has been working on this one, too - looks like the package is finished and uploaded to the NEW queue, but not accepted into Debian yet (might take a couple of weeks): http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=600827
User avatar
Capoeira
Established Member
Posts: 1321
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil
Has thanked: 3 times
Been thanked: 2 times

Re: How to real time, dynamic pitch shifting?

Post by Capoeira »

Capoeira wrote: A shame that it can't be used as a effect directly in the DAW
works perfect as an insert in Ardour
bigjuergo
Established Member
Posts: 15
Joined: Thu Jan 21, 2016 11:52 am

Re: How to real time, dynamic pitch shifting?

Post by bigjuergo »

I made a tutorial how to use the VocProc, maybe it helps you.

You can make very easy realtime autoshift with any midi instrument.
Best effects with saw signals (read description of the video for more details)
You can also use the VocProc as Autotalent

https://www.youtube.com/watch?v=4pgS29IyKFE
Post Reply