The Yellow Flute is actually located in Route 36. You'll find it in the small patch of tall grass just before the bridge leading to the Goldenrod City.
Make sure to equip it on one of your Pokémon, as it is needed to attract the legendary Pokémon Raikou to the area.