It runs through the Old Town , with the Edinburgh Castle at one end and Holyroodhouse Palace at the other