The white stuff is indeed thermal paste. If your looking for better paste, get Arctic Silver 5 and stuff that removes existing paste and Surface Purifier (the former two comes together)
Normally, the "stuff" that comes on the heatsink is called a ( THERMAL PAD ). They aren't too bad, from my experience. BUt, if you are planning on Overclocking, Remove it and apply AS5.