Prince William's relationship with the late Queen Elizabeth and Prince Philip got "warmer and warmer" as they got older but it had been quite "formal" when he was a child.