He didn't leave because of Brooks. He left for more money and greater flexibility. All things being equal, he would have stayed.
It's rare to have a perfect relationship with a boss. If what is reported was the biggest complaint, that is a good working relationship