I'm thinking that they are wondering what your motives are. I had a guy like this go crazy on me in Santa Fe when I tried to take his photo. Found out later that he was selling illegal substances and didn't want anyone to record his image. Plus, I think he wasn't hitting on all cylinders.