There's been outrage from protest groups over the felling of a tree some say is culturally significant in Western Victoria.