The classic "Paul Revere's Ride" by Henry Wadsworth Longfellow opens:
"Listen, my children, and you shall hear
Of the midnight ride of Paul Revere..."
It doesn't start with "horse," but horses feature centrally. If you meant a poem literally beginning with the word "horse," please clarify the title or author.