If you are interested in a smartphone for all the other features besides geocaching you may want to look at what Steve Job's has called "the best selling iPhone without a phone plan", the iPod touch. I use the iPod touch for all the apps others use on an iPhone, Android or Blackberry, except if I'm out of a wi-fi hotspot "my email can wait". No phone plan or data plan to worry about. I just use a cheap pay-as-you-go mobile phone. I'm just not deep into geocaching enough to spring for a good dedicated satellite-based GPS receiver at this time. There are some options available to turn an iPod touch into a GPS receiver. Bad Elf, Dual and Magellan are three possible options for converting an iPod touch into a satellite-based GPS receiver. Plus one can still listen to music and podcasts, take pictures, write notes, play games, check email, tweet, etc.
Cheers,
B.