How many hosts are on your LAN, and what kind of traffic are they putting on the WAN? Anyone doing Torrents or filesharing? If there ARE other hosts, try shutting them all down with the exception being the gaming PC, see if that has any effect....
Also, is this only with specific servers, or pretty much every server?
Do a tracert google.com command from the command prompt, and copy the results here...