This depends a lot on how much the one already in place pollutes, vs the new one.

For an EV vs a slightly older ICE, on your average western power grid (so not fully renewable, but not fully coal either), it takes just a few years till the EV’s total lifetime emissions are less.