Hello Megaben.
I also live in an area that is not visited too often. (Maybe a bit more than yours.) My opinion of those out-of-the-way caches. If they are not getting in anyones way, leave them. The more caches in your area, the more likely that people will go out of their way to find them. Sure you have to check up on them from time to time, just to make sure they are still there. You don't want someone coming all that way just for a DNF. That's my opinion.