Yeah, the fuller your hard drive is, the harder it has to work and the longer your seek times will be. Just be sure to keep it defragmented if it starts to fill up.
You are correct in your assumption, my 80GB drive was nearly full a few weeks ago and I could tell my computer was struggling, so I burned a few DVDs and totally formatted my E:\ drive, and it runs much faster now.