Use a lint-free cloth (like a coffee filter or lens cleaning cloth) and then saturate it with rubbing alcohol (like b1gapl said, the higher the percentage the better) and then scrub it off. It will come off relatively easy. Make sure you clean the top of the CPU off as well.
Don't worry about getting the alcohol on electrical components and don't worry about drying it up... it evaporates quickly.