Ultimate Facebook plugin comment override not working?

I have the “Override WordPress discussion settings” checkbox checked and WordPress comments still appear. What else do I need to do?