Waders will not make you sink (neutral buoyancy), but they will weigh you down as you try to climb back in. It's a risk I find worth taking for the warmth and otherwise waterproofness. If you are worried, wear a chest strap and pfd.
Now can we discuss the ethics of killing calicos?