Prime Minister Narendra Modi, President Ram Nath Kovind and Vice President Venkaiah Naidu paid their tribute to Atal Bihari Vajpayee at his residence on Thursday.