How about your cylinder chambers?? I have had this happen a lot while wet wiping my Sharps rifle, if I leave a little moisture in my chamber.
My 460 x-frame would do the same thing to my brass every time I cleaned it...because of the trace of oil left behind in the cylinder after cleaning.
Annealing brass will do some really great things...but I can't say that it will help you in this case..?