The Knave of Hearts is accused of stealing the Queen of Hearts' tarts, but he maintains his innocence. He's a rather silly character, prone to making nonsensical statements and getting confused easily.
The Knave of Hearts isn't the only Knave in the book; there are also the Knave of Diamonds and the Knave of Clubs. However, the Knave of Hearts is the most prominent and well-known.