"I'm not going to miss you, you stupid prat."
This is significant because it shows a rare moment of honesty and (perhaps unintentional) affection from Dudley. It signifies that Dudley, despite his previous bullying, does have some kind of connection with Harry, even if it's only on the level of acknowledging that he'll miss their "weird" relationship.