Both episodes (aired 1959–1960) feature stylized, similar-looking rocket props. Given the tight budgets and production schedules of The Twilight Zone, prop reuse was common. However, without access to studio records or prop logs, it remains fan speculation. They could be separate builds sharing the same design aesthetic.
If you have behind-the-scenes documentation, that would settle it.