Restricting [and hiding] Sites from Editors

Hi, I'm posting this problem with memory so there honestly may be some specifics on the exact details, but there's enough to investigate:

I had a user (for myself) that had access to two sites, then wanted to test exclusive access to only one site so I tried the "assign sites" page to unassign pages by unchecking the box next to the site name, but it seemed to keep letting it return when I accepted the changes -- the user still had rights after logging out/logging back in...

I figured maybe the UI was just not so good and I had to use the "restrict" pages form to hide the pages from the user -- rights were removed as expected, but still the site was visible if the user activated the top-right drop-down menu on their editing page...

I had to remove the user and add him again with only rights to one site and not the other and it successfully hid it from the new user. The only reason this is a problem is I don't feel too comfortable with the risk that my clients can may be able to see (even if they can't edit it) my personal site if it doesn't pertain to them.

I am rushing to post this and am not even looking at the problem right now so I realize I may have left out or poorly described some details... I apologize for that.