The first comic book sidekick is generally considered to be "The Boy Wonder", better known as Robin, who debuted in Detective Comics #38 in April 1940.
He was the sidekick to Batman, created by Bill Finger and Bob Kane. While there were other characters who assisted heroes before Robin, he was the first to be called a "sidekick" and became the archetype for all those who followed.