The phrase “the wrong side of history” alludes to people who are said to be out of touch, who have not moved with the times.