After making controversial Pak Hindu remark, Shashi Tharoor alleges that BJP vandals attacked office.