I have only listened to 1 or 2 Joe Rogan podcasts but I thought he was a little more on the common sense side of things than the authoritarian side. The ONLY expert advice that a person needs when deciding to inject a foreign substance in to their bodies is their own advice. If they choose they can seek out information from others but no doctor, politician, pundit, or anyone else can make that decision for them.
It doesn't matter if a million doctors are advocating for someone to take a vaccine the ultimate decision belongs to the individual.
At least 9,245 Americans who have have been vaccinated are now testing positive for COVID-19. That means the vaccines are not as effective as promoted. That being the case then it probably doesn't matter if you take or not. 9,245 is a small number compared to the number of people who have taken the vaccine but it is also not insignificant.