St David's Park is a formal English style walled park and dates from the beginning of European settlement in 1804.