What famous rapper appeared on the Cosby Show an episode that featured Debbie Allen?

The answer is LL Cool J.

LL Cool J appeared in an episode of The Cosby Show that featured Debbie Allen. The episode, titled "The Visit", aired on October 17, 1987. In the episode, LL Cool J plays himself and performs the song "I Need a Beat".