No. The publication's official name is Rolling Stone (italicized). The word "magazine" is a generic descriptor, not part of the title.
Correct: Rolling Stone magazine
Incorrect: Rolling Stone Magazine
Same rule applies to The New Yorker magazine, Time magazine, Vogue magazine, etc. Only capitalize "Magazine" if it's part of the registered title (e.g., The Magazine Antiques).