yep no way of removing it without a little force, it will make a SNAP sound as it comes unstuck but dont worry, ive done it two or three times in the last 2 years and everything was fine.
You will find getting it back in nicely is actually harder than getting it out!
Little tip, if your taking the motherboard out make sure when your putting everything back that you put this panel back in FIRST, before your motherboard, otherwise it wont fit.