The singer was the latest star to accompany the late-night host on his way to work in a new installment of the popular segment.