A hot air balloon went down in a desert area in north Phoenix Wednesday morning, sparking a small fire.