I have created a survey which is Enabled and Public, but visitors who are not logged in see “You don't have permission to respond to this survey.”

I have stopped the Surveys application inheriting permissions from the main website. I can tick Public → Contribute, but when I click Confirm, the page reloads and the Contribute permission is unticked again.

How can I allow people who are not logged in to complete a public survey?