Depending on how large your multitracked library is it might be a hassle. My approach would be to convert them with Onyx to magma project and replace/remove the audio files in the Reaper project and recreate the con files with just the regular song file (don’t forget to export the new notes.midi). You’ll have to look up how to make custom songs as Reaper needs some dependecies and all of that. Just treat the song as a custom. Just make sure to place the audio file correctly in the timeline so that the audio is not off.
You are about to leave Rhythm Gaming World and access the external songs DB. While no song or file sold for commercially available videogames is hosted there and only fan generated content is allowed, Rhythm Gaming World has no direct control over the database and no files are hosted here. Alright, we had to made you aware of this, now you can visit the database!