The historical Gothic Palace was built by Lithuanian dukes in XIV century and served as their residence, since the city was a capital at the time.