Michael Jackson did launch a solo career while still a member of the Jackson 5. His first solo single, "Got to Be There," was released in 1971 on Motown, followed by his debut solo album of the same name. He released four solo albums with Motown (1971–1975) before his breakthrough adult solo career began with Off the Wall (1979) on Epic Records.
So while he never "left" the group until its dissolution, his solo recording career began in 1971.