Seems reasonable if the nanny puts him down to sleep and is there to calm him.... she would be the one who would be able to calm him or get him to sleep. It's not the nanny's problem or the child's problem.
I have had the same feelings but has since realised that I am still his mom and I am making a point to make the bedtime for him a special for us to be together.