Because black is the colour that ancient people considered the symbol of suffering and sorrow. To wear black to visit a patient is a patient death curse faster.
Since black is the color that ancient people considered a symbol of sorrow to wear black to visit a patient, it is anathema to the patient early death.