'Don’t listen to Donald Trump': Ex-Republican congressman says 'we should just say it out loud now'