"I do believe I could have done more," Fleiss said about the franchise's lack of diversity in light of the report surrounding his departure after 21 years with the ABC dating mainstay.