No. The recurring "old lady" / landlady Mrs. Bellows was played by Agnes Moorhead (1965–1970).
Joan Plowright (Baroness Olivier) is a distinguished British stage/screen actress (The Entertainer, Enchanted April)—never on I Dream of Jeannie.
Confusion may stem from both being esteemed actresses of the era, or Moorhead's similar "formidable matron" typecasting.