Gibbs (Mark Harmon) is never called "Gunny" on NCIS.
"Gunny" = Gunnery Sergeant (USMC E-7 rank). Gibbs is a former Marine Gunnery Sergeant, but as an NCIS Special Agent (civilian GS-1811 series), he holds no military rank.
Colleagues call him:
Calling him "Gunny" would be inaccurate for his federal agent role—though fans sometimes use it as a nod to his backstory.