Louis Walsh and Nicole Scherzinger are set to return to 'The X Factor', despite previously being axed twice from the show.