what does the surface you are using look like? Optical Mice move based on a registered change in the surface. if you are using soemthing that doesn't return the light, flat black for example, will cause unwanted effects.
I have seen several types of material cause issues with optical mice, but most are related in that they are flat (non gloss) and a fabric of some type.
Good luck