The first thing I noticed were his feet and the iron work that is there. My eye is then drawn to the paper and then the white area in the back. I guess it didn't bother me as much until I read your comment about it. Nice candid shot.
This has more impact for two reasons -- there is less clutter in the background and you are much closer to the subject, which increases the sense of intimacy. We are more the voyeur here, and less the observer. But you right about the eye going to the white thing behind the paper. It still conflicts, but less so. It's a matter of degree.
Hmm, a slight improvement, but my eye is still drawn to it. Is that because I already know it is there? Would someone viewing it for the first time notice it as much?