Purchased in 1876 by steamboat captain, Frank Rabb and his brother-in-law, the orginal plantation had 20,305 acres. River mud was used to make many of the bricks used in the house construction. Today the house is closed up with "Private Property" signs in front but there are hopes that it will be restored to its former glory and opened to the public.

In 1957 the Audubon Society acquired part of the sabel palm forest for a bird sanctuary.