[Captainoffun22]

Hello

does anyone know anyway to get lip sync like real dlc?

here is a video of a custom that almost looks real

[Nyxyxylyth]

Dryvox.

http://pksage.com/rbndocs/index.php?tit … MIDI_Setup

[Captainoffun22]

I don’t see how the Dryvox does it

but could it be magma?

[Nyxyxylyth]

I don’t see how the Dryvox does it

but could it be magma?

Well, yes – Magma feeds the dryvox through a lip sync engine. As the docs say:

SOLO/HARMONY 1 Dry Vocals: This is a .wav file of your lead vocal part with no effects (“dry”). This file is not included in your final song package, but is required by Magma’s lip-sync engine to accurately render character animations. This file should NOT include any background vocals.

[Captainoffun22]

I don’t see how the Dryvox does it

but could it be magma?

Well, yes – Magma feeds the dryvox through a lip sync engine. As the docs say:

SOLO/HARMONY 1 Dry Vocals: This is a .wav file of your lead vocal part with no effects (“dry”). This file is not included in your final song package, but is required by Magma’s lip-sync engine to accurately render character animations. This file should NOT include any background vocals.

So it is the Magma, so that means Harmonix made it to not do as good as the real thing they use for dlc

so I wonder if there is anyway to improve Magma C3 dryvox code to make it better

[TrojanNemo]

I wonder if there is anyway to improve Magma C3 dryvox code to make it better

 

No. Magma: C3 doesn’t do the dryvox, MagmaCompiler does. We can’t really modify MagmaCompiler, so that’s not going to happen. What you can do, is learn to do a good, clean recording of the vocal lines. You give that Magma and it’s not half bad.

[Captainoffun22]

Sometimes I turn the track up

I might do tests to see how it works

as when there is no pitch

like this bit here

the lip sync is a bit better

so maybe I should do some tests with that idea

[Captainoffun22]

I’m doing testing to see if I can make it like real dlc, just trying everything to see if I can do it

[Nyxyxylyth]

I’m doing testing to see if I can make it like real dlc, just trying everything to see if I can do it

You can’t. Digging through MagmaCompiler.exe with a hex editor shows all sorts of interesting extra features – squinting, frowning, smiling, etc. Harmonix had internal tools to supplement or override the dryvox.

 

It’s interesting that with this year’s new DLC, Harmonix didn’t use any of that, instead relying on the same imperfect lipsync generated with just a dryvox file.

[Captainoffun22]

I was talking about playing with the audio, vocal midi track and just playing around with them.

I did see that the lip sync was not up to normal dlc with this years dlc.

[Captainoffun22]

I got a idea, have not test this yet but, maybe lowing the pitch of the audio.

[Nyxyxylyth]

I got a idea, have not test this yet but, maybe lowing the pitch of the audio.

That doesn’t help.

[Captainoffun22]

OK, I don’t know why but every time there is a bit with lot’s of talking, not singing, the lip sync is always good, is there any way I can turn that into lip sync, my 2nd plan is make it so the game will keep looking at the month for the full song and just keep playing with the dryvox until I can’t get it better

[Nyxyxylyth]

The lip sync engine HMX bought was designed for use with talking, not singing. Audition Mode could lock the camera on the singer’s face, just so you could try and overcome the engine’s inadequacies.

 

Authors have spent thousands of hours trying to get lip sync as good as it can be. There’s no amazing method that makes it work all the time – the engine wasn’t designed for long held notes. Just do the best you can.

[Captainoffun22]

OK, Thanks

[Author]

Posts