Former UN secretary-general Kofi Annan said Monday that if African leaders voted to leave the International Criminal Court it would be to protect themselves rather than their people.