I would think the one big concern would be the water they come from which has a direct bearing on the health of the fish.
Parasites would be another concern which is present in all wild food items.
I think it's a good idea otherwise.