Self-scrolling in Side by side question type

I have added a multi-select column in my side-by-side question type. But when someone is filling in the response, and tries to select one of the options in that multi-select column, the page automatically shifts all to the right to the first column of that question. Since it is a long question with many column options, this gets irritating. Any idea on how to fix this?