Is it safe to have something plugged into the mains via a DC adaptor that also has batteries in it?

I have a white noise machine and up till now I've always used batteries for it, but I've just found the DC Adaptor that came with it, which means I can now plug it in. Can I leave the batteries in there or should I take them out?