He still comes back to visit — and even brought his girlfriend to meet his dad