The episode is "My Fair Esther" (note spelling). Fred and Esther do not sing a duet. The plot centers on Fred teaching Esther etiquette, leading to comedic misunderstandings—not musical numbers.
You may be conflating it with another episode or show.