Louis Walsh has admitted Simon Cowell hasn't spoken to him after the entertainment mogul bashed his 'X Factor' co-star on 'Celebrity Big Brother'.