Nexus 7 - Removing icons from home screen bug

I can't seem to be able to remove icons from the homescreen with any consistency. Sometimes I click remove and the icon goes away immediately. Other times I click on remove and it does nothing.

Is this some weird Jelly Bean bug or is something wrong with my Nexus 7?