You are thinking of **Episode 21: "Usagi's Baby! A Heartfelt Love!"** (Japanese: Usagi no Akachan! Kokoro no Ai).
Plot: Usagi (Serena) volunteers to babysit **Manami**, the infant younger brother of **Motoki Furuhata** (Andrew in DiC dub), the arcade owner. She struggles comically with diapers, feeding, and crying, but ultimately bonds with the baby. The Daimon **U-Chouten** targets the infant's pure heart.
This is the only episode where Serena/Usagi directly cares for a baby for the full runtime. (She briefly holds Chibiusa in later seasons, but that's her future daughter.)