In a setback for Congress MP Rahul Gandhi, the Allahabad High Court has rejected his plea concerning remarks on Sikh turban which he allegedly made in the US.