The telescope itself will operate in wavelengths from 0.6 µm (orange) to 28.5 µm (mid-infrared), so it reaches a bit into the visible spectrum, but it's still going to be aimed away from Earth, and photograph distant galaxies.
What I'm interested in is, will the satellite contain any cameras that can take common visible light photos of Earth? Just like DSCOVR can take impressive images of Earth and the Moon from $L_1$, will we have similar images from James Webb at $L_2$, of the permanent corona eclipse of the Sun by Earth, or the always-crescent Moon?