Smartglass Disconnects...

Does anyone else have issues with Smartglass while playing video to the xbox? I usually will be able to watch 10-20 minutes or so before I get a disconnect from my surface, the video will play on both devices for about 15 seconds and then the xbox will say that the media was stopped and the surface will continue to play. This also happens on my desktop as well and on multiple xboxes with different routers.

Does anyone have any tips to reduce the amount of times this happens (or how to stop it all together)?