Just tested it, no reboot or conversion required.
You could also extract the media folder from the official firmware zips, if they’re not included in the one above.
These are from the S3, but hopefully they include what you’re looking for.
Just put the included alarms folder onto the external storage (you might have to do a reboot or convert the files from .ogg to .mp3).
