If we can limit the discussion to modern RTGs used for exploration probes, there really isn't much in the way of precautions. There are precautions to prevent launch failure, and then contamination of Earth's environment. But obviously you can stand next to them as long as the fuel is in solid ceramic form.

Environmental Health Specialist Jamie Keeley performs an external radiation inspection of the Cassini-Huygens spacecraft's
Radioisotope Thermoelectric Generators. NASA photo from Wiki Commons (click for full resolution photograph)
It's not obvious from pictures like this, but that worker is wearing a radiation dosimetry tube filled with polymer gel which measures occupational dose. Interested in the specifics, I found that Table 2-3 in this link gives the isotope concentration for the Cassini RTG - which is what we need to answer your question.
It contains Pu-236 through Pu-242. Isotopes are almost completely chemically identical, and because of that it's not practical to separate these, and the impurities remain. If isotope separation were trivial, we would leave nothing but Pu-238 but it's not.
Drawing the line between isotopes and activity requires looking them up in your favorite chart of nuclides. Combining the relative activities and the decay branching ratio, you can observe two things that dominate the non-alpha radiation:
- Pu-238 contributes around $9 \times 10^6 Bq$ of spontaneous fission activity
- Pu-241 contributes about $7 \times 10^{11} Bq$ of beta activity
This is pretty comprehensive. There's not much other radiation aside from the (intended) alpha radiation and the two above terms. The main thing this shows is that Cassini's RTG is extremely clean in terms of radiation. Sure, you would probably restrict time your engineers spend next to it, but that's not really because it presents a biological danger, it's just so that you can report a lower workplace radiation dose.
The beta radiation makes it a little further than the alpha radiation, but not by that much on a multi-ton spacecraft. It will affect the electronics almost none. It's pretty much the same for the spontaneous fission. That could create some biological concern. Fission produces a host of particles and the neutrons are particularly problematic. However, their effects will be dwarfed by the overall radiation environment in space.
However, the term nuclear battery could refer to other designs, even including fission reactors. Spacecraft with those do require shielding to be engineered into their design between the reactor and the scientific payload.