you need to NOT be using your client when you try to delete it. wait a couple seconds after shutting down the client and trying to delete it to give the system time to sever the conenctions.
If you still cant do it try booting up in safe mode and deleting it.