You're likely thinking of Eli Roth's Cabin Fever (2002). The unsettling, raspy-voiced character credited as "The Man" is played by Rider Strong. He terrorizes the college students with cryptic warnings and menacing behavior. There is no bunny suit in the film.