No. Many poems do not rhyme. Free verse has no rhyme scheme. Other forms (e.g., sonnets) have specific schemes. Rhyme is optional, not required.