The song with the chorus "I sit around with my head hanging down / Wondering whose loving you..." is "Who's Loving You" by The Miracles (1960).
Written by Smokey Robinson (age 19), it's a masterclass in Motown vulnerability. The narrator sees his ex with someone new, torturing himself with comparative questions: "And if he treats you the same way / As I tried to do."
Chart History: #1 Billboard Hot R&B, #2 Pop (bubbled under Hot 100). #2 UK (1961).
Iconic Covers: Otis Redding (1965, Otis Blue), The Jackson 5 (1969, Michael's lead), Michael Jackson solo (1973, Music & Me), Luther Vandross (1981, Never Too Much), En Vogue (1992), John Legend (2005). Each reinterprets the ache differently.