Making changes to a live survey -how does it effect the collected responses?

I have a live survey and have been collecting responses. The project manager wants to delete one question and add 2 more questions. Can someone confirm that if I delete the question, I lose all the collected responses associated with that question? Thanks, Sonia