As you know buttons can have both text and images. In your screenshot, you have an image selected and No picture caption selected so will only see an image.
If you only want text, set the image property to (None). If you want both, choose whether the caption should be arranged on the left or right.
Is the wording on the property sheet confusing? In my opinion, yes.