Words rhyming with celebrity (/sɪˈlɛbrɪti/) end in -ebrity or -arity:
Best perfect rhymes: festivity, serenity, ferocity, notoriety (4 syllables, stress on 2nd). Society, propriety are close but stress differs slightly.