I have seen goats attempt to eat tin cans. That being said, someone I know says there are a few plants that don't interest them much. That means they may still take a nibble out of curiosity, but they won't devour them. Mullein seems to be one, though I would check for the toxicity level of this plant (for goats).