Hi Matt,
I'm new too, less than a couple weeks. I bought a yellow Garmin eTrex handheld at Walmart for $199 plus tax. It has everything you're looking for... color, uses AA batteries, has a USB cable so you can download coordinates. I love mine, but then again I'm new and don't know any better! They had a cheaper version that was $99 but not color and no USB, so I didn't want that one. They also had a couple that were more expensive. I'm told you can also find these at sporting goods stores, but we had no luck with places like Circuit City, Radio Shak, etc... the people there didn't even know what I was talking about. So we ended up finding them at good ole' Wally World!
Have fun and good luck!