Old units are definitely still viable. I cache with an 11 or 12 year old Garmin GPS12. I wouldn't go much older than that because then you start to get into the 8 channel GPSr's which would be a real challenge to use (there's a cache here that actually uses an old 8 channel unit). I use a PDA for the maps and the cache listings.
van der Decken