Deleting responses is a bit hidden away in Surveys. You need to go to the responses by user, view the individual users' response, then click the delete button in there.
I don't think there's a way to bulk delete all responses to a survey.
Thanks
Joe