His act? Not so much. It hasn't aged well over the years. Undeniably, some of this has to do with the man himself. He used to be a wild, freethinking hippie, but he has since turned into a heavily conservative right wing bloviator.
Politics aside, his change in worldview has made him seem like a bitter, angry man that is looking for someone to blame. That makes him harder to like overall.