Prime Minister Narendra Modi paid tribute on Friday to Prince Philip who visited the former British colony four times, not always helping to mend ties.