There’s no door puzzle. You enter Jabba’s Palace through a large archway on the lower Tatooine desert level—just walk in.
The "Jabba’s Door" is decorative; the playable entrance is the open archway leading directly into the palace interior for missions and free play.