Growers banking on the forecasts are now counting their losses, as crops fail due to lack of water