The castle was built between the 12th and 16th centuries.
It served as the residence of the Counts of Geneva and the Dukes of Genevois-Nemours.
Several times the victim of fires, the castle was abandoned in the 17th century
and later repaired to serve as a barracks until 1947.
The town of Annecy acquired the castle in 1953,
restored it with the help of Monuments historiques and installed a museum there.