It was the 5th inning with 1 out. You can't just take starters out whenever they struggle. He needs to be able to pitch over mistakes, otherwise he's a reliever.
Still - if you want to criticize LaRussa for that, fine. Makes a lot more sense than not yelling at umpires.