Elizabeth Castle Outer Ward & canon. Construction of the earliest parts of the castle, the Upper Ward including the Queen Elizabeth Gate, began in 1594. Sir Walter Raleigh, Governor of Jersey between 1600 and 1603, named the castle Elizabeth Castle after Elizabeth I of England. The Lower Ward was constructed, between 1626 and 1636, on the site of the ruined Abbey church.