From the historical marker:

"The father of our country wears his military uniform but carries a civilian walking cane rather than his sword...
He stands by a farmer's plowshare, a symbol of his love of peace and agriculture.
He rests his hand on a bundle of rods called fasces, a Roman symbol of civil authority.
Here the thirteen rods represents the joining of the original states and the strength gained from that unity."