https://dl.dropboxusercontent.com/u/48454461/aud/sh2/BGM%2050123%20MIDI%2BSF2.7z
The last couple of updates converts better to VAB, so now I'm somewhat able to rip to PSF1 too. There are still some significant issues though, but here it is:
https://dl.dropboxusercontent.com/u/48454461/aud/sh2/BGM%2050123%20PSF.7z
To be continued, I guess.
http://www.fmjsoft.com/awavestudio.html#news
edited 10:48 PM EST January 20, 2016
I have finished extracting the data through a quickBMS script, so if you wish I can upload 2 .kdt files.
By the way, how can I open .kdt files on Awave Studio? They are only recognized as raw audio data, not MIDI.
edited 8:35 PM EDT March 17, 2016
Are you using the latest version of Awave Studio? KDT sequences are only supported as of version 11.1. I don't know if maybe they only added support for licensed users though. You should be able to open it by just dropping it into the left-hand pane.
I'm trying to download the python script for the MusyX .sdir format from Thousand Year Door...
By the way, here are the .kdt files.
edited 6:04 AM EDT March 18, 2016
AnonRunzes: oh, these aren't standard KDT1 sequences, so that's why they won't load in Awave Studio. They use this "SdDt" format in SH2 and SH3 as well. SH2 doesn't have any BGM filenames, but in SH3 they're named *.TD, not *.KDT...
The first file doesn't contain any KDT1 data whatsoever, but the second one does - just strip the first 64 bytes and you should be able to load it.
Now if I compare the .kdt file that is played on Awave Studio to the .kdt file that is played in-game, I can say that the one that plays in-game is much faster. Take a look.
Maybe I could change the tempo to make it sound exactly like the in-game music version, but any suggestions is welcome at the moment.
edited 10:16 PM EDT March 18, 2016
I could be wrong here though. And if I am I wouldn't mind looking into it. But I can't do much without the driver code (IRX files probably).
EDIT: Well, never mind my ask for the instrument/IRX stuff, I got my hands on the game. But holy crap, IDA actually found function names for the driver in this game! Now I know 0xC8 is definitely pitch bend. Maybe that's what's missing in this case, because there are some pitch bends in that track. I'll see if I can add support in my Python script.
edited 7:56 AM EDT March 19, 2016
People move/delete/stop renewing their plans on dropbox so often that it's probably the last place I would trust my files...
As for further KDT research, I'm sad to say there has been little to no progress despite having code with named functions now. I am just generally confused and frustrated at this point.
There are a few tracks in SH1 which use the 0xC8 (0x64) command (pitch bend, and it does seem like it's actually implemented in SH1 too, judging by comparing the code to the WE5 driver). So I tested C.KDT with a PSF with an original driver, but the command really doesn't seem to have any effect, regardless of the parameter value. I did also try adding pitch bend support to my Python tool and converting the WE5 menu theme, but the pitch bends doesn't sound right.
Also, I realized there's another issue in converting. There's a limit of 16 channels in MIDI, and channel 10 is exclusive to drums/percussion, whereas it isn't in KDT1. This may cause the track using channel 10 to be silent if it is not a drum instrument. And I've seen lots of tracks which use 16 channels so far. So I'm really not sure how to tackle this.
Oh, what else. Apparently all commands except those in the 0xC6 - 0xCE range are channel message events. But what they also have in common is that they don't lead into some nicely named function directly, but they're stored in a table in RAM first, which I assume are shortly after picked up by the appropriate function. So that's going to take a while to understand, especially since I don't have any debugger available.
And yeah, still no effing clue why the tempo isn't right. The code in WE5 looks just the same as in SH2. Maybe there is some more commands which contributes to the tempo. Or maybe the tempo is even manually changed by the game. It does disable/enable channels when you switch menus for example - even before it starts playing too, since the rock track doesn't play on the first screen. Also, I noticed track 4 has some modulation effect or something, so that doesn't sound very accurate currently. But not sure which command that is yet.
If anyone out there is experienced with MIDI et al, please do help if you have any ideas. I am happy to provide my IDA project files, which contains personal comments on stuff.
all the extra tracks in born from a wish have dialog over them?
Apart from that, no additional sequenced tracks were added, so the only thing left to contain additional music is dialogue tracks.
I wrote a Python script a little while ago for extracting all data from SOUND.DAT in any release of SH2. I could throw it up on Github if anyone's interested. Note that SOUND.DAT does not contain any movie stuff though (you can extract movie.mgf and movie2.mgf with PSS Cutter and VGMToolbox).
I wrote a Fluidsynth mod to allow over 16 channels, allocating each track to its own channel.
https://github.com/jimbo1qaz/fluidsynth-plus
You'll have to compile it yourself (which I heard is difficult on Windows).
# PROCEDURE
First, remap your MIDI files so all non-percussion tracks are assigned to other channels (not 10). You may have to duplicate channels. This is perfectly fine (though Anvil Studio may damage the MIDI when you create duplicate channels).
Then compile the custom Fluidsynth and run "fluidsynth -K 64 soundfont... midi".
# EXPLANATION
`fluidsynth -K n` specifies the number of channels. I modified the program to allocate each track to its own channel, when n >= 17 (n <= 256). The channel numbers in the MIDI are ignored, except for channel 9 (conventionally 10) which remains percussion.
edited 1:44 AM EDT June 24, 2016
@jimbo1qaz: Thanks for the tip. It sounds great, but I'm not very good working with toolchains and setting up all the dependencies to be honest. I have GCC 4 (MinGW) installed, and that works for the puny C programs I write... I guess. I'd gladly try out a Windows build if available though. But also, how can it allow over 16 channels if channel messages (0xEx) are effectively limited to 4-bit channel numbers? Am I missing something? Does the program assign re-used channel numbers to something else?
Thanks. ill be able to properly tell with SH3s mall enemies since the goth choir sample gets pitched bend.
I edited the program to make these extra channels accessible from MIDI files.
My program only keeps Channel 9 (conventionally 10). Otherwise, it assigns "channel = track", skipping channel 9.
----
You should install Mingw-w64. It's MUCH newer and better than MinGW.
I haven't tried compiling Fluidsynth on Windows.
Check here (it looks painful): https://sourceforge.net/p/fluidsynth/wiki/BuildingFluidSynth/#windows
edited 3:00 PM EDT June 25, 2016
https://www.youtube.com/watch?v=AWE4gOoQRs8
I uploaded this too:
https://github.com/Nisto/sh2-soundex
https://github.com/Nisto/sh2ex
Currently, it supports the following versions only:
- SLPM-65051 (v1.50)
- SLPM-65631 - Saigo no Uta - Konami Dendou Selection (v1.50)
- SLUS-20228 (v1.20)
- SLUS-20228GH - Greatest Hits (v2.01)
- SLES-50382 - Special Edition / The Collection (v1.10)
But give me a poke if there's a specific version you want me to add support for, and I'll look into it. Provided I can find it...
https://github.com/Nisto/sh2ex
It's not fast, and it's not pretty, but it works.
edited 5:40 PM EDT October 22, 2016
It's funny how you mentioned that tool, because I got an error when running with Python 3.5:
E:\kdt-tool-master>kdt-tool.py
Traceback (most recent call last):
File "E:\kdt-tool-master\kdt-tool.py", line 586, in <module>
main()
File "E:\kdt-tool-master\kdt-tool.py", line 543, in main
path = os.path.realpath(argv[1])
IndexError: list index out of range
Anyways, are you still having that issue with the Winning Eleven 5 menu theme? Let me guess: a few channels are muted as you get through the navigating the menu during the game, just like Ridge Racers(PSP).
edited 11:12 PM EDT October 22, 2016
Yeah, I still have no idea why Winning Eleven 5 converts badly. The game does indeed mute/adjust channel volumes as you navigate menus, but the bigger issue is the tempo. "/
Anyway, you might want to take a look at this. This file came from the PS2 version of Silent Hill 4.
EDIT: https://github.com/Nisto/sh4-sdex
edited 10:02 PM EDT October 23, 2016
I've seen Nisto figured out how to calculate the appropriate offset between the pc and ps2 versions, but I don't understand how to extract the files themselves. Anybody can help?
edited 10:49 AM EDT April 11, 2017
Speaking of the PSF2 set. I already posted it in this thread, but for posterity's sake I'll post SH2 and SH3 here too:
Silent Hill 2 - Saigo no Uta (2002-07-04)(KCE Tokyo)(Konami).7z
Silent Hill 3 (2003-05-23)(KCE Tokyo)(Konami).7z
When Foobar reads PSF2 files it's awfully quiet, is it because of the original files or the converter? If so, do you know a better PSF2->WAV(Or anything) converter?
I cannot find the dialogue files in the zip you posted, are they included? I've found a way to replace them with ADX files on the PC version too.
EDIT:
Managed to extract the dialogue files myself. Now looking into creating the PSF2 files to see if there's any difference in volume by playing with settings..
EDIT 2:
Found out that dialog files are not 1:1 with the PC version like with BGM files. The number of tracks inside voices on the PC version are 159, more than the streams obtained by extracting the european version of the game (122) even combining the PSF2 files labelled MISC and CORE (30). I suppose some of them are either empty, unused, or movie sound files? Strange, since the sound of movies in the PC version is inside the bik files themselves. I've tried to get at least the background music from the european version to test if i could rip it louder, but apparently I can't understand how to use mkpsf2 in VGM toolbox, I suppose i need some extra "IRX" files. I've found SD_CD.IRX and SD_HD.IRX and SDSTR.IRX in the european directors cut version disc, but I don't know which to use. The 7z file you provided me mentions a "sh2.irx" but it is nowhere to be found.
At this point, I don't know what to do. If you could provide me with a direct contact (Skype? IRC?) to help me out I'd be grateful.
edited 10:14 AM EDT April 12, 2017
edited 10:17 AM EDT April 12, 2017
If I remember correctly, one of the trial versions had more dialogue tracks than both of the final releases. I may be wrong, but yeah, it could be that the PC version actually draws from one of them. (EDIT: Indeed, the E3 2001 trial release (SLPM-12345) also has 159 dialogue tracks.)
The sh2.irx file is a custom module I wrote to interact with the sound driver, so you won't find it on any disc. You can get the file out by using PSF2 Unpacker (also present in VGMToolbox). But you're not gonna be able to do much with those files unless you know some assembly language (MIPS R3000 to be exact), sorry to say. Also, you shouldn't try to replace the modules as they will likely not be compatible. I have patched some of the original modules specifically to be compatible with the PSF2 specs and my own module. Besides, all the sound modules are 100% identical between most of the releases, so the settings won't really be any different.
I'm usually on #vgmdb at irc.psigenix.net.
edited 4:58 PM EDT April 12, 2017
Have any breakthroughs been made in converting/using the PS2's sound files for the PC version?
edited 7:52 PM EDT August 17, 2017
Would you have the means of extracting all the bits of audio from the game? Including the music, sound effects, and voice/dialog while retaining their original sample rates and stereo output?
There are a group of other talented programmers/modders out there who are improving the PC version of Silent Hill 2 making it match or better than the PS2 version in numerous ways. You can see a video of some of the fixes here:
https://www.youtube.com/watch?v=878F2cbLAXo
(An improved noise grain filter is also currently being developed and is nearing completion.)
The two major fixes left is porting the PS2's sounds to the PC version and creating soft shadows for the PC build.
For the audio: All versions of SH2 except for the PS2 version have compressed the audio files into a lossy, noise-induced format. This is further explained here:
https://www.youtube.com/watch?v=nna2yt1c9gI&t=403
And while this situation is less than ideal the *tone and pitches* for the audio files in the PC build have also changed during the conversion. You can hear this in action here:
https://www.youtube.com/watch?v=8E5Nt8ahZRk
Without putting you on the spot your research into the sounds of SH2 PS2 are vital into cracking open this egg and getting all music, sounds, effects, and dialog accounted for to transpose to the PC build. Any further help would be greatly, hugely, immensely appreciated by the entire Silent Hill community. (Konami has neglected this series/us fans so it's become down to us to fix what Konami has wronged at this point.)
And, for the soft shadows: Soft shadows will probably be one of the last fixes due to the complex nature of writing new shaders and injecting/overwriting the old ones in the game but we're in the very, very, very early stages of looking in to this:
https://github.com/elishacloud/dxwrapper/issues/6
So we're hoping that with "enhanced audio" and soft shadows for the PC build we can have a true, no-kidding, definitive HD platform for this beloved, neglected classic.
Thank you for all the work and research you've done so far and thank you for any future help and guidance you can lend!
John
edited 12:12 PM EDT August 29, 2017
edited 12:26 PM EDT August 29, 2017
Have you considered Google Drive to upload your files? So long as you have a Google account (through Gmail or otherwise) your files won't disappear unless you delete them. I believe Drive gives you 15GB for free.
But thank you for the advice and tips on your GitHub page.
When you ripped the sounds (SFX) do you recall if they retained their correct sample rates and channels for you? We've ripped the PS2 game (Saigo no Uta) for its SFX and received nearly 2,000 files (with many of them being duplicates though) but we've noticed there are discrepancies with some of the audio files.
I mean no disrespect when I ask this but would you consider re-uploading the files you've already ripped; music (including the three tracks you didn't include due to them having dialog within them) and SFX/dialog (if you have any)?
While we would be willing to learn the in's and out's of all these pieces of software this is a one-off project we're doing solely for the purposes of Silent Hill 2 and no other game. (Because, as previously linked to you, SH2 suffered severe audio degradation on all versions outside of the PS2 ones.)
The process of mapping the PS2 audio files back to the PC ones has proven quite time consuming. Then we will need to edit them to the same length/approximate size as the PC's versions (as the size/length information is hard coded into the game and the audio won't play back otherwise). And naturally we'll need to do extensive play testing once we get to a good spot and iron out the inevitable bugs/errors we come (hear) along the way.
All this to say that if you have many or all of the sound files already converted it would be a tremendous help for us in time alone.
Thank you though once more for your hard work and due diligence for Silent Hill 2 and game audio elsewhere.
edited 12:30 AM EDT September 3, 2017
The game uses standard PS2 sound banks, which does retain the original sample rates. But beware that many sound effects in this game are sequenced, which of course means that the final rate (i.e. what you ultimately hear in-game) may be different for some sound effects, depending on the configuration of the assigned instruments and which keys are actually played. As for the channels; every single sample in the PS2 version are monaural - it's a hardware limitation. They may have used multiple samples (one for left, one for right) to "simulate" stereo though, but I don't recall any occurrences of that.
I'm sorry, but aside from that SFX (read: sample) pack I uploaded, there really isn't any difference between what I've previously posted here and what sh2ex gives you. Just use the tools I referenced in the GitHub Issue to rip the dialogues and movie tracks yourself. The tool is there to be used - otherwise I wouldn't be sharing it with the world! I don't mean to sound harsh, but again, this is not difficult; you really don't need to know the "ins and outs" of Silent Hill 2 or the PS2 to do any of these conversions.
Since I did do a lot of organizing and additional extracting for the BGM/SFX samples, I guess I can upload that again at least. It may be a couple of days before I get to it though; I have a lot on my todo list lately, and I'm just getting to bed.
every single sample in the PS2 version are monaural - it's a hardware limitation. They may have used multiple samples (one for left, one for right) to "simulate" stereo though, but I don't recall any occurrences of that.
>>>>>>
This explains a lot to me, thank you. I'm happy to know we're on the right track then with the SFX we ripped already.
>>>>>>
The tool is there to be used - otherwise I wouldn't be sharing it with the world! I don't mean to sound harsh
>>>>>>
You do not sound harsh at all. I understand where you're coming from. I also didn't realize you're internet speeds weren't the best so I understand better why you wouldn't want to be bothered re-uploading what you've already ripped.
>>>>>>
Since I did do a lot of organizing and additional extracting for the BGM/SFX samples, I guess I can upload that again at least.
>>>>>>
So on that note, I understand if you'd rather not.
Nonetheless thank you continually for the software and programs you have created to get us where we're at now! It's a slow process but we are getting there piece-by-piece!
https://www.dropbox.com/s/qnr4k64wyoqb71f/SLPM-65631_BGM_SFX.7z?dl=0
Grab it while it's hot.
You will need vgmstream (foobar2000, Winamp) to play these files.
Your work and contributions mean a lot. Thank you again.
The new sets should be on psf2.joshw.info when Knurek gets around to transferring them from his FTP.
edited 7:50 AM EST December 22, 2017
https://www.dropbox.com/s/tpdf9uf5rklzoxg/sh2_se_driver.psf2lib?dl=1
edited 3:53 PM EDT May 28, 2018