I performed the search on both the setting right next to the word 'contains' and then with all the above mentioned items clicked on while typing the search in the normal search area. Neither worked when I searched for emails with attachments that contain words I know exist.

Search (then)

All Mail (then)

Attachments (then)

Contains