Robbie Williams has upset his neighbours over his application to fell a fungus-infested tree at his London mansion.