My first experience was a failure as well. That was several months ago. Today some experienced geocachers took my sister and I out to show us the ropes. I'm hooked now! My 4 1/2 year old loves it was well. He calls it treasure hunting.
Don't give up!