There is no official Harry Potter store in Connecticut.
However, merchandise is widely available at:
For immersive experiences, visit The Wizarding World of Harry Potter at Universal Orlando (Florida) or Warner Bros. Studio Tour London.