Ina Garten went through a "really difficult" time in her marriage when she was trying to build her business and had to "take a break" from her relationship.