I've found all of my 64 caches less 2 without a GPS! I find an area where I want to go on the Geacaching Google Map and just find my way usung landmarks from above. Not always an easy task...
I did borrow a GPS once though (and found 2) and was spoiled with power!!! I'll likely buy one soon.