Putting numbers on that (for the us) from 2022 [1]:

Electric power—469.9 MMst—91.7%

Industrial total—41.9 MMst—8.2%

    Industrial coke plants—16.0 MMst—3.1%
    Industrial combined heat and power—10.1 MMst—2.0%
    Other industrial—15.8 MMst—3.1%

Commercial—0.8 MMst—0.2%

Getting down to 6% of our current coal use would be amazing. So much lung cancer and asthma would be prevented.

[1] https://www.eia.gov/energyexplained/coal/use-of-coal.php

Replacing all coal for electricity and leaving industry alone would be a gigantic dent in carbon emissions. Just that.

Even if some of that replacement is with gas it still helps. Gas emits about half the carbon per kWh.