Great topic and I hope you are able to place your cache...
I am hunter that bought a GPS for hunting. Needing practice, I learned of Geocaching, and have found a few and now watch the Forums for tips and other interesting facts.
There are many factors here and the most important is money. Although hunters do not pay all the expenses, most of our license fees goes to the land. With that, we expect we can use it and enjoy. I can understand why people do not want to upset hunters, but the bottom line is people will use the land as they want.
I guess they can stop the placement of a cache. As with the other listed activities, hunting does not overlap the berry pickers, mushroom, bird watching (? maybe), hiking (? maybe).
It is very similar to fisherman and skiers. Many lakes have restricted hours.
As a bow hunter, it is the small game hunters that bother me the most.