Brian,
You may want to search the site. There's been quite a bit of discussion on recorders. I just purchased a Sony PCM-M10 a few weeks ago and really like the recording quality. It has long battery life and can record in MP3 as well as PCM, and uses 16GB micro SD, so you can record a lot of music regardless of the bit rate. Also, it has the ability to slow down/speed up the recording on playback, which can be handy for learning new rhythms. The Zoom H2 and Olympus LS-10/11 have their fans as well.
Evan
post16179.html?hilit=digital recorder#p16179