I am also new to the game. I wanted to buy a nice gps device to get started with but I just don't have the money for it right now. So to get me started I found an application for my Blackberry Curve. It is Geocache Navigator by Trimble Outdoors.
For the beginner geocacher I think that it is great. I have decided that I must get a quality gps device. I have found that it will be a must. For now though I am enjoying my application that is on my phone.
Just do your research and be careful before you go and buy one of those expensive gps devices that are not what they are cracked up to be. HAVE FUN!!!!