I completely agree with you. You seem to really care about the upkeep of your caches. He should have emailed you and told you about the change of the trees. If everyone could just drop a cache down where they couldn't find one, geocaching would be a disaster!!!
I'm about to hide my first cache, and I'm glad to have this situation brought up in case it happens to be in the future (hopefully not) =)