I remember seeing this 45 years ago when I was first in Quebec City. The ball apparently was mislaid at this site sometime in the mid 1800s. It was not the result of military activity. Over the years the tree grew around it. You can see it on St. Louis street about 3 blocks inside the gates.