Bihar Governor Keshari Nath Tripathi said he cannot arbitrarily remove Chief Minister Jitan Ram Manjhi from his post as demanded by the JDU faction led by Nitish Kumar.