Windows 8.1 Update; start screen options broken

In taskbar>properties>navigation there is an option called "When I sign in or close all apps on a screen, go to the desktop instead of Start".

This all seems fine, besides that the option only work 50% for me:

- Sign in works. Unchecked I go to the Start screen, checked to desktop

- Closing all apps doesn't work. Both using the new close button and dragging the window, I always return to the desktop instead of the start screen, even though the checkbox is unchecked.

Am I alone in having this problem? Can anybody check this on their machine?