In the song, "the green gentleman" serves as a euphemism for alcohol and drinking. The lyrics illustrate this metaphor:
He says "I have to go back now 'cause the old lady's home"
She says "oh but it's so early, why don't you have one for the road?"
The "green gentleman" represents the temptation of another drink before leaving.