I have made complete training in UrduHindi Language about Robots Txt File, you can learn free of cost.