On a bright Wednesday morning we traveled Union Avenue on foot, enjoying spectacular houses and a look at the famous Saratoga Race Course on our way to visit the gardens at Yaddo, about a mile from the town center.