Although there have been fortifications of one kind or another on Castle Hill, the current building dates from a 16th C rebuilding after the previous one was destroyed in an earthquake in 1511.

It was a royal residence in the 17th and 18th enturies and a prison and barracks in the 19th and early 20th centuries. It is now mainly used for concerts and weddings.