The government has agreed to build a bridge connecting Labuan to the mainland on Sabah through a private finance initiative (PFI), says Federal Territories Minister Tan Sri Annuar Musa.