Adam Cartwright never left the show "Bonanza." Played by Pernell Roberts, he remained a main character throughout the entire series run (1959–1973).
If you're thinking of a departure, it might be a different character or a misremembered detail.