If every sperm has the potential to become a human life .....?

They're not actually humans until they are formed together, so it doesn't matter. That's like saying if we use ethanol for something else, then we should feel bad that it's affecting the cost and usage of gas/petrol. It's just absurd.