Also, it leaves traces in the registry as well, either way, that is, if the setup program allows you to remove those.
Your last resort is to delete the files manually, then clear any traces in the registry through tools such as RegCleaner. Clear any traces through the program menu as well.