It is most likely to cause severe symptoms and obvious damage in pregnancy and to immunocompromised people but it may cause harm to others too.

https://pmc.ncbi.nlm.nih.gov/articles/PMC2526142/

> Most humans (and other beings) aren't pregnant or immunocompromised

So we do not need to vaccinate against rubella either? most people are not disabled so we do not need wheelchair ramps? Most people are not sick at any given time so we do not need hospitals?