Valerie Carter and James Taylor were not a duo or romantic couple. She was a backup vocalist on his tours and albums (late '70s–'80s), contributing her powerful, distinctive harmony.
There's no public record of a falling-out. Their collaboration likely tapered naturally as:
Carter guested on later Taylor recordings occasionally. The music industry's fluid nature means session/touring lineups change routinely without drama.