Sounds like you might have the site marked as a public site. Choose to make it private and see if that works!
