Xbox Music Skips with headphones

Hey all, I just thought this was weird and was wondering if any of you had the same issue: When listening to Xbox Music, after a while (or sometimes immediately) the songs start to have trouble buffering, but this problem only happens with headphones plugged in. The problem is non existent when using the built in speakers and Bluetooth. Furthermore, it will skip if system sounds occur (notifications, keyboard taps, etc). This is my 4th Surface RT and ALL have had this problem so I doubt it's a hardware issue. Like I said, it doesn't happen right away, so if you're trying to recreate it you might have to wait a bit. A restart will sometimes fix the problem, but only for a little bit as the problem will come back. Thanks guys!