The rule seems to be, if you can see the house over the wall, it's not a ruler palace. If you can't see it, as you can't anywhere around this wall, a ruler probably lives there. There are tons and tons of these. Along the water out by the university there are two or three. You can see one from the beach, but not from the street.