The oldest structure within the compound is a barrack block built in 1864. It is a three-storey building constructed adjacent to Victoria Prison. A storey was later added to the block in 1905. In 1919, Headquarters Block facing Hollywood Road was constructed. Subsequently in 1925, the two-storey Stable Block was constructed at the north-west end of the parade ground and later used as an armoury.The Police Station together with the former Central Magistracy and Victoria Prison form a group of historical architecture representing law and order in Hong Kong.