Nexus 4 Charger Problem

So I have a Nexus 4 and often have problems charging it - it makes the "connect charger / low battery sound" over and over very fast. I have the phone plugged in but the battery flashes from the "!" to the lighting bolt over and over.

Is it just a case of poor usb cable? Faulty charging port? Or do others have similar problems?