Absolutely, I didn't realize that peaches didn't grow well there. I assumed, since you had a tree.... Well, I wonder if pruning it or fertilizing the soil around it would have helped?
It is the climate, it is not hot enough in summer for the fruit to develop fully - but with global warming you never know what may happen in the future.
The only peach tree we have that is bearing fruit is draping in front of our driveway and is becoming a problem for the car. Is it possible to tie the tree back without hurting this year's peaches?