dhcp=dynamic hosting computer protocol
I know doesnt mean anything to you, what it does is it makes your computer send out a broadcast on the network to any other machine asking for an IP address, which the router should assign to it. The other way is, you pick a permanent static IP and all the router would do is forward the traffic thru itself.
go to start/network connections/local connection/properties.......a new window will popup, click tcp/ip then propeties........it will have a new window showing pick an IP or have it try to find one:
for dhcp choose try to find one
for static or pick your own, enter 192.168.0.1, you will also need the DNS numbers for your ISP, have no clue what those are but a google search should help, or a call to your ISP
chances are good your router will use dhcp