Home Minister Ahmad Zahid Hamidi has in a speech said that it's best for police to shoot criminals first and ask questions later.