Congress leader and Finance Minister Pranab Mukherjee have expressed concern about the rising infant deaths in West Bengal.