New Orleans Saints defender Cameron Jordan said he and his team-mates were turned away for wearing leisurewear