Lead Shot Poisoning due to hunting.?

Hi, I usually use steel shot shells but I have bought some waterfowl lead shot and I know how to clean out all the pellets, but I was wondering if I were to ingest the lead pellets would it hurt me? I'm pretty sure it would just making sure I need to be extra careful on cleaning it up.