If the user isnt to savy you can just remove the icon from the start menu...lol. If you right click on an empty area on the task bar and click properties, start menu, customize, advanced you can control what is displayed there.
Or simply create an account with limited access or as mentioned a local policy via gpedit.msc will do fine.