I am an odd sort of equine breed
Prone to do foolish things indeed
I prance about and kick and spin
And make no sense in what I begin.What am I?
Answer: A silly filly.
Filly = young female horse. Silly = foolish. The riddle puns on "filly" sounding like "silly" in the rhyme scheme.