No. Glee Season 4 (2012–13) remained in Lima, Ohio.
Season 5 (2013–14) shifted primary setting to New York City as graduates (Rachel, Kurt, Santana, etc.) moved there for college/careers.
So the NYC storyline began in Season 5, not 4. Season 4 split focus between McKinley High and the graduates' early struggles in New York, but the full relocation happened in Season 5. This structural shift reflected the characters' post-graduation transitions and the show's attempt to evolve beyond its high school setting.