I am not positive because I have not done it myself but that red piece should be preventing the release button to be pressed when the red clip is pushed in so even though you have pulled the red clip out, you should still have to reach under the plug (the side facing away from the camera) and press and hold the release button while pulling the plug.
|