On the canalside site of 3 previous old fortresses, the only surviving 'Castles of the Counts'......these medieval noblemen had castles built in all the principal cities of Flanders. It was built in 1180 by count Philip of Alsace, inspired by the style of the foreboding castles that he saw while participating in the Crusades. The opening in the form of a cross above the gateway proves that he already had taken part in them when the castle was built.
The counts abandoned Gravensteen in the 14th century, and it served several roles in later times. It was a courthouse, a mint, a prison, and a cotton plant in the 19th century. Small houses were built for the plant workers in its inner court, and Gravensteen was somewhat pillaged as some of its stones were used in the construction of the other buildings. It gradually decayed over time and towards the end of the 19th century the castle was scheduled to be demolished. However, the city purchased the castle in 1885, began renovations and removed the small houses. Today, the Gravensteen has been beautifully restored.