Brad and Whitney head out for a game of golf before meeting the family