Kinda hard to make out that case when Whoopi Goldberg is being protected despite saying the Nazis weren't white supremacists and saying the Nazis weren't racist because Jewish people are white. Then she doubles down on Colbert and issues only a half apology. If you are going to hold Rogan to account for what his guests might say (so far as far as I'm aware the responsibility he's taken is for not offering more balanced views, debate, and better questioning), you have to hold Goldberg to account for doing something far worse.
It's hard to think of another way to piss off both Jews and Nazis in one breath.