I've only just had my GC too so I'm still learning the ropes. I'm not sure if you can directly delete them from the unit itself but once you connect it to your computer, open up the Magellan drive ( mine happened to be (G:) ) and you'll find a Geocache folder. In there you'll find all the caches' you've downloaded.
Hope this helps.