A 95-year-old former concentration camp guard was taken from his home in Queens early Tuesday morning and deported back to Germany, according to the White House.