You do not "attach a Game Pak" directly to the Nintendo 64 cartridge slot for Pokémon Stadium 2. The N64 cartridge is the Game Pak for Stadium 2 itself.
To use your Game Boy Color Pokémon (Gold, Silver, Crystal) in Stadium 2, you need the N64 Transfer Pak (NUS-019).
The Transfer Pak is the only bridge; there is no direct cartridge-to-cartridge link on N64 hardware.