Desperate: OSX Notification Center madness!

I'm still fairly new to OSX (I upgraded to Mountain Lion) and I really enjoy most of the features. There is one feature which seems to only annoy the crap out of me- Notification Center.

I currently have it set up so that GMail will use desktop notifications (through Chrome). In my preferences I have that set to use Banners which means that they pop up and disappear a bit later. This is exactly what I want it to do. Good so far...

Which brings me to the source of my frustration. If I haven't looked at my browser in a while and want to check my notification center to see a list of my recent email banners and I swipe over into Notification Center I see NOTHING. Why?! I know I can set Chrome to use Alerts but that just means that I have to manually close it every time I get an email and I don't want that. Why shouldn't the notification center show my most recent Banners and I can simply click the 'X' if I want to clear them out?

Any ideas on how to solve this?! If I can't solve this then the entire feature is pretty much useless for me.