I found that when Willow had her babies the non-eaters would hang out together. Maybe it's that the eaters feel that the non eaters are too weak to be around. Thats the only thing I can think of.