If special rights and privileges to the people of Jammu and Kashmir are tinkered with, then there would be no one in the state to hold the tricolour, Chief Minister Mehbooba Mufti on Friday warned.