Legend has it that Wellington harbour, originally a land-locked lake, was home to two large and very active taniwha (sea monsters). One taniwha forged a passage to the open sea creating the entrance to the harbour. The second, named Whataitai, tried a different route, became stranded and died. It is believed that Tangi-te keo (Mt Victoria) was named after the soul of Whataitai.
Mount Victoria is part of the Wellington Town Belt, land set aside in 1841 by the colonial New Zealand Company for a "public recreation ground for the inhabitants of Wellington".