They kept their chairs and their families didn’t call them crazy and beg them to stop at every holiday gathering