No, Honey, you don't have to fear that I would call interfere with your time or that interferes with your valuable time that you will instead live with his wife.
Honey, you should not have to fear that I will call it to interfere with your work time or that disturb your precious time that you was with your wife.