Maternal grandparents (mother Lily's parents):
Paternal grandparents (father James's parents): Never named or described in canon. James was an only child; his parents were elderly when he was born and died of natural causes (per J.K. Rowling interviews) before Harry's birth.
The "mysterious illness" killing Fleamont & Euphemia is widely theorized as a Voldemort curse targeting the Potter line.