The story begins with the narrator approaching the signalman's box and seeing him standing there. The narrator then describes the signalman's appearance and demeanor, but doesn't mention any verbal exchange.
The only dialogue between the two comes later in the story, after the narrator has gone down to the tunnel and the signalman has mentioned seeing an apparition.