Port Macquarie MP, Leslie Williams' decision comes after Nationals Leader John Barilaro's threat to move his MPs to the crossbench.