No, the Malfoy family was never formally disgraced or cast out by Voldemort during the Harry Potter series. They remained among his most loyal—and visibly prominent—supporters throughout the Second Wizarding War.
However, their standing declined significantly due to a series of high-profile failures:
By Deathly Hallows, the Malfoys are effectively prisoners in their own home, tolerated only for their utility. Their "loyalty" becomes a trap. Yet Voldemort never publicly strips them of rank or denounces them—they remain Death Eaters to the end, a testament to his pragmatic cruelty rather than their favor.