Yes, loosely. Leroy Jethro Gibbs was inspired by John Donald "Jack" Brennan, a former Marine sniper and FBI agent who served in the Hostage Rescue Team.
Creator Donald P. Bellisario drew from Brennan's background – military discipline, investigative skill, personal code – but Gibbs is a fictional composite, not a direct portrayal. The character evolved far beyond the inspiration.