I'm sure there's an element of that - people do sometimes complain about specific things. (Which the photographer can then treat as a technical challenge...)

But quite a few people do seem to dislike pretty much all images of themselves.