The song playing at the end of The Vampire Diaries Season 2, Episode 13 ("Do You Remember the First Time") is "Never Let Me Go" by Florence + the Machine.