Does Modulation refer to the sharp or flat signs immediately following clef sign at beginning of a musical composition?

No, modulation does not refer to the sharp or flat signs immediately following the clef sign at the beginning of a musical composition. Those are called key signatures and indicate the key of the piece. Modulation refers to the change of key during a musical piece.