@BlakeWalsh started to figure out the answer here and finished here but declined the invitation to post the answer, so I'll finish by posting it by proxy.
Why is gold "gold-colored"?
Several answers (1, 2, 3) to the Physics SE question Why are most metals gray/silver? explain this, and I'll summarize as follows:
In addition to the highly reflective property of the "sea" or "plasma" of conduction electrons of bulk or films of solid or liquid metals, including gold, gold also just happens to have very strong atomic absorption lines in the blue around 460 nm. If you could make gold gas and look at white light through it, the blue would be absorbed by individual gold atoms. This American Chemical Society communities post describes it nicely (clipped from a longer discussion):
If you Google for "NIST Atomic Spectra Database", click "Levels" and put in "Au I" (neutral gold atoms, Au II is for Au+ ions), you get a lot of spectral lines measured in cm-1. The ones you can see by eye are between violet = 25,000 cm-1 = 400 nm (just do 1/x on your calculator) and red = 14,000 cm-1 = 700 nm. You can see the line at 21,435 cm-1 = 466 nm = blue-violet, near the top. That wavelength of light has the right energy to move an electron from its lowest state, where there are 10 electrons in 5d orbitals and one in a 6s orbital (called 5d10 6s1) to a state with 5d9 6s2. If you were to shine visible white light through gold gas or vapor, everything except that blue-violet color would go through. The color that would pass through gold vapor would be reddish-yellow, much like solid gold.
Source click image for full size view
You can see at least a pair of strong transitions around 460 to 480 nm, and these would happen in bulk just as much as in a gas. Even though the skin depth of gold is quite shallow, atomic absorption is strong enough to absorb much of the blue light that the conduction electrons are working so diligently to reflect!
Why not other metals?
From this answer:
For gold (with atomic number 79 and hence a highly charged nucleus) this classical picture translates into relativistic speeds for electrons in s orbitals. As a result, a relativistic contraction applies to the s orbitals of gold, which causes their energy levels to shift closer to those of the d orbitals (which are localized away from the nucleus and classically speaking have lower speeds and therefore less affected by relativity). This shifts the light absorption (for gold primarily due to the 5d→6s transition) from the ultraviolet down to the lower frequency blue range. So gold tends to absorb blue light while it reflects the rest of the visible spectrum. This causes the yellowish hue we call 'golden'.
This answer also links to What Gives Gold that Mellow Glow?
Note that silver has a strong atomic absorption line as well, but it's in the UV were we can't notice it. This is one reason that aluminum is used instead of silver for telescopes that work in the UV as well as the visible, the other being that the native aluminum oxide that forms quickly on aluminum is not a problem compared to the thicker and darker oxides and sulphides that form on silver. (for more on that see When did “resilvering” large telescope mirrors actually refer to aluminization, and why was it necessary? as well as Do primary mirrors in large observatories undergo regular removal and re-coating of the aluminum? Why?)
How a modest difference in reflectivity can mean a huge difference in transmission
The answer has to do with comparing (1-x)-like terms, and with exponential attenuation.
Imagine I had two isotope samples, tenyearium with a half-life of 10 years, and oneyearium with a half-life of 1 years. If I wait 15 years, then most of each isotope sample is gone. 65% of tenyearium has decayed and 99+% of oneyearium has decayed. That's only a 35% difference in the decayed amount.
But this also means that while 35% of the tenyearium has remained only 0.003% of the oneyearium has remained. That means the oneyearium has been attenuated by a factor of over 11,000 more than the tenyearium.
Same with gold. While a think film of gold on an astronaut's visor may attenuate say 50% of the green and blue light, it may have attenuated 90 or 95% of the infrared light.
Differences in attenuation can be far bigger than differences in reflection. Thus the dip in gold's reflectivity probably understates the effectiveness as an attenuator when used in thin film transmission.