Just a tip in the future, if you're not 100% sure on what kind of worm you've got. Kind of squish the worm a bit and get it to move. Red wigglers have that name because they have a distinct sort of thrashing that's a bit different from how other types of worms move. If you compare them once the difference becomes more noticeable.

I've never fed wigglers, but a year or two ago I fed some mice that had been previously offered to my frog (a supposedly non-toxic species who apparently has toxic skin). Both times he regurged within a day. I feel like, especially with adults, that if there is something their body can't handle toxin-wise they are pretty likely to regurge it. I'd be more worried about very little ones.
The suggestion of feeding other foods to the ones that ate the wigglers sounds like a good idea.