The first stage of Ariane V has in fact RCS thrusters, but only for roll control. While the solid boosters are burning, roll control of the whole stack is exercised by differential gimbaling of the EAP solid rocket boosters.
After burn out and separation of the solid busters, there`s a problem: The EPC main stage with its Vulcain engine is a single engine stage. Gimbaling of the Vulcain takes care of yaw and pitch, but not roll. This is dealt with a cluster of GH2 thruster.
Unfortunately, I lack detailed specification on them, but there description as GH2 points to a rather low thrust / performance regime. As the relevant flight regime is already in the thinner parts of the atmosphere (EAP separation occurs at ~75km altitude) and Ariane 5 a very axisymmetric shape at this point only small roll forces need to be compensated
Ariane 5 user`s manual (page 203): https://www.arianespace.com/wp-content/uploads/2016/10/Ariane5-users-manual-Jun2020.pdf