[chore] Split out column mode config into separate component

[chore] Split out column mode config into separate component #2605