You can only remove moves by teaching a Pokémon a new move, which will replace the last one learned.
The Move Deleter was introduced in Generation 4 (Diamond, Pearl, and Platinum).