Prince Harry's spokesperson has dismissed claims in a new book that he once had a "physical fight" with his uncle Prince Andrew.