Depends on what your price range is. As DJRed said, you'll want to get a 5 piece (kick, floor tom, 2 rack toms, snare) + high hats, ride, and crash. The first upgrade would be a 2nd crash cymbal. That's a pretty standard kit (and what I play on). I just checked out guitar center's used section, and you can pretty much get a set of used drums that are entry level, but not crap, for ~$300.
http://www.guitarcenter.com/...rum-Kit-113652886.gc Peral Vision, Pearl Export, or Pearl Forum are pretty much your starter, but not crap, kits. For the most part, all of the big brands will sell a set of shells with stock heads for about the same price and quality.
This does not include hardware (cymbal stands and snare stand). That will run you ~$60 per stand (crash + ride + high hats + snare = 4x60 = $240) + ~$75 per low end but not crap cymbals (4 x $75 = $300) + an entry level kick pedal ($100) and a throne ($60). So figure on $700 on top of the kit itself. So you can get an entire entry level kit for ~$1000.
Here's a new Pearl Export:
http://www.guitarcenter.com/...h-Hardware-H94538.gc That comes with hardware, so you'd be on the hook for $360 to get cymbals and throne. So again, ~$1000.
Given what DJRed said above about going bigger that that to start to save in the long run. My personal opinion: either spend $1000, or spend $4000. I think anything in between is a bit of a waste.
Electronic kits, on the other hand, start at about $300. I played on one for 2 years before upgrading to an acoustic kit. Because I was a new drummer, I couldn't tell the difference. As an experienced drummer, I can't stand playing on electronic kits.
Its entirely up to you and your circumstances, but if I had a kid wanting to play the drums, I'd probably have him on an electronic kit until he got serious with a band, and then upgrade to a $1000 kit. 90% of the kids under 30 who play amateur gigs are on $1000 kits.
-----------------------------Baron Von Speedypants
-----------------------------RunTraining articles here:
http://forum.slowtwitch.com/...runtraining;#1612485