The type of radiation emitted (x-ray, alpha, beta, gamma, neutron), the radioactive material and how you're exposed to it are sort of key factors in how you'll react, as far as I know.
I had some radioactive material in my lab (uranyl acetate) but the glass bottle it was in was enough to...