Gamma rays will cheerfully go right through centimetres (an inch) or so of solid metal, there’s no need to directly expose the Caesium to the environment!

These radiation sources are usually very solid metal containers with their lids welded permanently shut.

Not to mention that these sources usually contain water-soluble salts of caesium. Hence, hermetically sealing the sources is essential, especially for outdoors use.