Comments closed by default

I can't seem to get comments to be closed by default. Maybe I'm missing something as far as what that setting does under account setting, but I thought it would keep comments hidden underneath an article by default.

 

Anyone have this working?