I agree with your analysis, and everyone else's comments (I think Elise was spot on).

You're right, it's difficult to say why *these* implications bother you when others don't. The nearest I can come is suggest that it's superficially plausible, so it sounds like you should be doing this, and although you reject it, that it's said impacts your mental state a bit anyway.