Vishwa Hindu Parishad (VHP) working president Pravin Togadia accused Prime Minister Narendra Modi of conspiring with the Ahmedabad Crime Branch to harass him.