Note the three gates. The middle and largest one was reserved for the emperor and it wasn't until recently that the common person was allowed to go through it.