Did Jim Lindsey in the episode Guitar Player really play?

Yes, Jim Lindsey did play the guitar in the episode. He is a professional musician and composer who has worked on numerous television shows and films.