In 1858, the house's historical importance was recognized and it was saved from ruin by The Mount Vernon Ladies' Association.