multisite privacy – does not display login page visitors can still access site (wordpress)

I've set the site visibility to only administrators can visit (also tried other settings) but the site still just loads, there is no prompt to login. I've tried from several different computers but it is like the setting is ignored.