If Trump is removed under the 25th amendment, he would be the acting President. Bush Sr and Cheney were both acting Presidents under the 25th Amendment (granted, the voluntary section and not the removal section) and they weren't counted as Presidents, so I don't think Pence would be considered the 46th President unless there is impeachment and removal, or resignation.