Do you have to turn cold water off when a water heater leaks?

Yes, turning the cold water off will stop the leak and reduces chances of water damage. Make sure to turn off power supply to the water heater and drain the tank before replacing it.