Just say it.

Those that matter don't mind

and those that mind don't matter.