Paul Simon was "exhausted" by his marriage to Carrie Fisher and their differing attitudes to fame.