I'm also relatively new to geocaching and a few weeks ago a bought a Garmin Dakota 20... (the little brother of the Oregon series)
It wasn't that expensive and i have a compass, altimeter and i can geocache paperless...
It has a touchscreen and every option available for the game...
Very, very pleased with it!