There is no character named "Ms. Lillian" in Mary Downing Hahn's novel The Old Willis Place (2004). The main characters are:
You may be conflating names from another book (e.g., The Doll in the Garden has a Miss Lillian). If you recall more plot details, I can help identify the correct character and book.