Hilary Duff felt "guilt" about having a second child as her son Luca was "sad" about things changing when his sister arrived.