Live comment alert not respecting my setting

In comment settings, I will change live comment alert to "hide it!", however it doesn't respect my choice and after a few minutes reverts back to showing me new comment notifications. This is incredibly annoying. The thing is, I don't remember having this problem before the software was changed with the new collapsing threads and moderator features. Is this a bug?