I got all panicked about raw egg in home made ice cream when I was pregnant. You probably know this already, but the risk is obviously salmonella (which is probably a small risk to start with) and that doesn't directly affect the baby (unlike listeria from cheese etc) - it would just make you ill and that potentially isn't good for baby.

So in essence, to be avoided but probably not too much to worry about if you've already done it as you just forgot (as I did!).