Anti-EV people often bring up power plants, not realizing that the modern coal plants are cleaner than the typical car - it's much easier to scrub that exhaust in one place than in a million cars, and more likely to be maintained (assuming the EPA hasn't been gutted). Natural gas? *way* cleaner than ICE. In what world did you think this would be a gotcha?
If you want to talk about EVs being non-environmental, we need to do a full lifecycle comparison -- everything that goes into the EV or ICE car (ICE car wins this part, hands down), plus everything that goes into the cars during their full lifetime of use (EV definitely wins this part, especially since they'll probably last longer mechanically), plus recycling (ICE would win the end-of-life).
I'm not sure what the ultimate comparison sums to. It's tempting to give it to ICE since batteries are so nasty to produce and non-trivial to recycle (though the recycling could ultimately offset a substantial portion of the production, though I don't think it does at this point), but everything involved in the ICE fuel cycle is bad too.