Would yippee be considered an onomatopoeia?

Yes, "yippee" is an onomatopoeia.

Onomatopoeia is a word that imitates or suggests the source of the sound that it describes.