Khloe and Kourtney Kardashian found it "challenging" to have their mom as their manager in the early days of their careers.