I find the case you are making to be quite silly indeed. Is it really a problem that a couple of stones have been shifted in a stone wall out in the middle of the woods that no human being would ever notice? This is hardly a cause for concern and hardly worthy of even a passing thought.
Hobbyists (in any hobby) tend to create superfluous, self-defeating "rules and regulations" when they are too deepy entrenched. This is clearly one of them.