It's too easy to accidentally delete image captions. Please add a confirmation step.

Adding a confirmation step would reduce the risk of accidentally deleting captions (this has already happened a few times). Alternatively, there could be no button at all, and captions could be deleted automatically when there is no text in the caption and the input no longer has focus.