In a letter to Modi, Swamy said the government required no permission from the Supreme Court to allocate land for constructing the temple as it was taken over by former prime minister P V Narasimha Rao's dispensation in 1993.