I just 'Googled' it, wasn't sure it would throw back relevent info but it did, good old 'Google' what would we do without it.
I fixed it through the Registry:
When Windows starts, it looks for a wallpaper location first in
or somewhere else depending on what other wallpaper-setting applications you've installed. If you delete the data value for the
key you'll get rid of the first wallpaper setting. I just deleted the old wallpaper name and replaced it with my new one.