The song is "Dear Lie" (1999, from FanMail). The music video (directed by Bille Woodruff) opens with a baby crying as Tionne "T-Boz" Watkins sings the first verse in a dim room. The cry underscores the lyric "Dear lie, why do you hurt me?" — framing deception as a crying infant demanding attention.
Other TLC videos with children: "Unpretty" (girls facing mirrors), "Waterfalls" (animation), but "Dear Lie" is the only one with a distinct baby cry sound effect as a structural element.