FX Filters that change with the sound of the clip

C

Chris Knight

Member
So let's say I have a clip with a filter on it (contrast, threshold, whatever) I want an attribute of the filter to change according to the trend of the sound that accompanies the clip.

So if I have a clip of a man talking, If he isn't speaking, there is no effect, if he is whispering, there is a little effect, if he's yelling, the effect is very pronounced.

How can I make this happen? What software do I need? I have FCP and Motion. But I can get access to other things through my school if need be.
 
I dont get why you would want to use this?? Does it have to be a program that does this specifically? If not, you can just minimize the effect when he is talking at lower decibels and strengthen it at higher decibels. I dont really understand what it is you are trying o do though.
 
That's actually a cool idea - but I've never seen anything specifically made to do this (not sure how it would work actually).
I think your only solution is to keyframe the effect manually to go along with the audio track.
 
I don't know about motion, but I know AE has some plugins available that are based on audio.. something like trapcode Sound Keys would probably help in what you're doing.. Of course if you have access to a version of After Effects 6 or newer, it's got a built in "Convert Audio to Keyframes" generator. ;)
 
I plan on using the technique for work with experimental film, looking into the manipulation of sound / image relationships. But even so, a more practical application would be using the sound of a light flickering and adjusting the brightness of the clip to sync with the sound effect to create the illusion that the lights are flickering in the room.

I'm going to look into After-Effects and see what I can come up with.
 
After effects has expression controllers that can be used to do this or partially achieve this. You might have to go in and keyframe a slider.
You could use the "turn audio to keyframes" feature to make a track with keyframes or for more precise keyframing you can try trapcode soundkeys.
You can pick whip an expession linking an adjustment layer's opacity (with the effect on it) based off another layers value (the audio keyframe)
 
You must log in or register to reply here.
Back
Top