Depending on what AV out you previously used, the PS3 may well not be outputting to HDMI at all, in which case you need to reset to basic output whereby it outputs on which one it detects has a cable in. Then you can up the res etc once it has booted up, I believe you do this by turning it on...