In Windows Explorer, go to Tools --> Folder Options
Click on the File Types Tab.
Go to the one labeled Folder.
Cick on it, then click on advanced. Make sure it has open or explore as the action, if it has find, remove it and set open or explore as the default.