What is your budget?
My suggestion would be the
M-Audio Fast Track Pro if you do not have a firewire connection on your computer. This is basically an external sound card meant for recording which connects to your computer via USB. It has two XLR type mic preamps with phantom power, so you can use more expensive condenser mics later, as well as MIDI inputs and outputs so you can connect a keyboard if you wish.
Or, if you have firewire, then I would suggest the
M-Audio Firewire 410 since it has more inputs and outputs, phantom power as well, and connects via firewire, which is a better device to PC connection when recording audio.
Both come with a basic computer recording software, but you will get better results by using the freely available
Audacity
Of course, you will need a microphone. Start out with a
Shure SM57. It's a standard dynamic mic meant for instruments. When you get more money, and more experience recording, and want more options for different sounds, get
Audio-Technica AT3035. It's a large diaphragm condenser mic, and will give you a slightly fuller, richer sound and can be used for decent vocals and other instruments.
And, you'll need a
microphone stand, a 25'
microphone cable, and either some
headphones, or a
pair of speakers (and a pair of 10'
1/4" TRS cables ).
Total cost I figure to be about $405, before shipping, with the Fast Track Pro, the SM57, and the headphones, cables and stand.