Government is considering doing away with the LPG subsidy for the well-off, Finance Minister Arun Jaitley said.