There were vocal calls for the former Chelsea boss to return from away supporters after their 4-0 loss to City