Plus there were always rumors back in the day about just how much Mrs Baba liked him, if you get what I mean, although that was probably more from other gaijin jealous of his Hall of Fame level political abilities.
To be fair, he was pretty good in the ring in his own right. Yes, he had the luxury of working with some of the best wrestlers of all time, but it's not like he was an anchor out there.