Uncertainty over Britain's exit from the European Union has begun to take its toll on business.