The potential of an agent, compound, or substance to cause cell damage or kill cells.