You cannot “turn off the game while deleting” in the way the question implies. Deleting a save is a software operation—a menu confirmation (“Delete save data? Yes/No”) followed by near-instant erasure from the cartridge/SD card.
If power fails during the write cycle (milliseconds), it could corrupt the save sector—potentially bricking the file or, on older cartridges (GB/GBA), damaging the save-battery circuitry. Modern games (3DS/Switch) use journaling file systems to prevent this.
Best practice: Back up via Pokémon Bank / Pokémon HOME or system cloud saves before deleting.