Charles and Camilla were "absolutely thrilled" to see Prince Harry, Meghan Markle and their children when they were in the U.K.