Replacing audio in FMVs of Rayman 3

Discuss tools to aid in the modification and running of Rayman games.

Moderator: Modding and utilities team

Forum rules
Please keep the forum rules and guidelines in mind when creating or replying to a topic.
Post Reply
k0lter
Electoon
Posts: 4
Joined: Sat Oct 21, 2023 10:30 pm
Tings: 20

Replacing audio in FMVs of Rayman 3

Post by k0lter »

Hello, I wanted to replace audio of the FMVs in the game, specifically the PS2 ones, and replace the English audio with The Polish one, but when trying to mix the audio from the Polish FMV with the PS2 one with RAD video tools it just says that there's no audio in the video. I've also tried extracting the audio file itself with VGMToolbox and adding it that way but it's just added as an additional audio path.
PluMGMK
Annetta Fish
Posts: 40508
Joined: Fri Jul 31, 2009 9:00 pm
Location: https://www.youtube.com/watch?v=cErgMJSgpv0
Contact:
Tings: 136606

Re: Replacing audio in FMVs of Rayman 3

Post by PluMGMK »

Hello there! :) With reference to this discussion… You need to use the 2001 version of the RAD Tools, otherwise the audio isn't handled properly.
https://web.archive.org/web/20010602065 ... dtools.exe
Does this help?
k0lter
Electoon
Posts: 4
Joined: Sat Oct 21, 2023 10:30 pm
Tings: 20

Re: Replacing audio in FMVs of Rayman 3

Post by k0lter »

Tried it, but still doesn't replace the audio sadly.
deton24
Art Rytus
Posts: 1194
Joined: Fri Jan 14, 2011 1:22 am
Location: Poland
Tings: 8932

Re: Replacing audio in FMVs of Rayman 3

Post by deton24 »

Bik videos of R3 PC in at least English version consist of 5 tracks. You can verify in which track you have what audio track, in e.g. VLC. Start with verifying whether everything is okay there, and correctly replaced.

I think in PC version, English sound track ID is 2.
deton24
Art Rytus
Posts: 1194
Joined: Fri Jan 14, 2011 1:22 am
Location: Poland
Tings: 8932

Re: Replacing audio in FMVs of Rayman 3

Post by deton24 »

Long story short
English is in track #1 in the original PC version.
Polish is in track #1 too (the Polish release doesn't have the original English track).
Audio compression can be set to 1 in the radvideo.exe from the installer above, and it plays correctly in the game.
Below, I will explain extracting WAV audio file from bik, and mixing it in the bik file by replacing track 1 (or any other).
It doesn't solve the issue of probable de-sync of PS2 files with PC audio tracks due to frame rate conversion and changed time duration (setting offset once won't fix the problem) - you'll need to fix it on your own (I encountered that problem years ago with PS2 video files when I tried to add PC audio to them).

General guide to replace audio track in Rayman 3 using the old RAD Video Tools

1. Download https://web.archive.org/web/20010602065 ... dtools.exe
2. Open radvideo.exe
3. HIghlight bik file from Rayman 3\videos folder
4. Click mix in sound
5. mp3 and wav audio files accepted - convert your audio to WAV first
(to convert audio track from existing bik video to wav, you can use Convert a file option, and if you don't write anything in Input from track field, it will use the first existing track in the file)

(also bik formats and video formats are accepted as audio to mix in, but here I'm not sure if choosing simply bik from PS2 will result in a good, working result file, probably not when you need any other audio track to use from such bik than the first)

6. In sound compression, you can write 1 (if the file is not being played correctly in the game, leave default or try out 0)
7. In mix into what track, write 1, as it's the track we're trying to replace in this case. The rest can be left untouched.

Syncing audio in video software

* If you're making your own custom audio track (e.g. fundub), make sure your track is in sync with the original video. To ensure it's correct, convert bik file to any popular video format if it can't be imported to your video editing software, sync the audio there with the video, but without shifting/moving video track, render as audio only (if WAV is available, use it, as any other lossy format can change offset, and you'll need to compensate for it later in Mix in audio settings).
If audio-only render is impossible in your editor, render as MKV and demux the audio track from it with MKVExtractGUI2 with MKV Toolnix v.20 installed in the same folder. Add proper audio extension to the result file if necessary, probably it will lack it.

Or
finding proper offset and setting it in during BIK audio mix in

I have two WAV files to align.
I open WAV from YT fundub clip, downloaded originally as Opus with Jdownloader, and WAV from OG game bik file received from radvideo.exe
(be aware that Opus an AAC on YT have different offset - one has additional silence).
I drag and drop PC and custom audio to e.g. Audacity, and in that example, YT track starts half a second after the original track.
It was exactly 516ms (1s is 1000ms). You can align both by picking Time Shift Tool (F5, the icon with double arrow) and dragging the clip to align peaks.
Now in input options of mix in sound of radvideo.exe, I write in Start input 516, and that's enough to keep the converted Opus to WAV from YT, in sync with the PC video.

Additionally, in mix in sound, you can also provide at what frame it will start to mix, or you can provide milliseconds while using minus in the same field (that's probably for an opposite situation when you'd need to abridge the video if an audio track starts before BIK you try to mix audio in and not after like above).

* If you need to get rid of e.g. English voices in order to make your own fun dub (so to leave only effects and music to paste your own) you can download UVR 5 from github, use MDX-Net and attached HQ_3 model, and on even the oldest 4-core CPU with default settings it should separate the 2:30 file below 30 minutes.


____________________

Here you have an example of the game's bik with replaced audio, with the AI-generated voices for one of the video originally lacking localized audio track in the game
https://drive.google.com/file/d/1ytMEgr ... sp=sharing
Source
https://www.youtube.com/watch?v=6EU9XqtOc28
I've checked that file in-game by replacing ubi.bik, which uses only one track in track 1, so it was using the same track I replaced, and the audio I pasted worked correctly.
Post Reply