At least you agree that when you can grab 20-30 caches a day (which country are you living in that you can grab 20-30 a day?) the number of points per cache should be less than the 1/5 cache taking you days to solve. Do you think it's fair to place yourself in the top25 ranking by grabbing drive- in caches only, I don't think so?
The more simple the rules, the more arbitrary it is of course. However to keep it simple I propose simple rules (for example terrain 1 point per star, difficulty 1 point per star). It doesn't make sense to count every rattlesnake in the surrounding(we even don't have snakes in Holland)or give you extra points if you miss your legs (if you play football you also don't get extra points if you miss your legs......).
If you don't like the competition element for whatever reason, well just play for yourself. It's no obligation at all.
Robin