To enjoy the greatest advantage from the Earth's rotation, you want two things:
- Launch from as close to the equator as possible.
- Launch as close to directly east as possible.
The first part is fairly simple. The rotational velocity is proportional to $\cos(latitude)$, so the Guiana Space Centre gets over 99% of the effect, Kennedy Space Centre around 88%, and the Baikonur Cosmodrome around 70%*.
You have made an observation about the second part. Launching into an inclined orbit from the equator does not give you the full advantage of the Earth's rotation, since you are no longer launching directly eastward. Launching from the equator, there would be another scaling factor of $\cos(inclination)$.
So what happens when you try to launch directly eastward from some latitude other than the equator?
You get into an inclined orbit! At the instant of the orbit directly over the launch site, the satellite is moving neither north nor south, it must be at the farthest point from the equatorial plane.
Orbit inclination = Launch latitude, when launching directly eastward, gaining the largest possible advantage from the rotation of the Earth.
Each launch site therefore has their own optimal inclination, matching their latitude, where they can get into space with at little delta-v as possible. Targeting a different inclination will cost some additional delta-v due to them not being able to launch directly eastward.
The inclination of the ISS was picked to be easy to reach from Baikonur. Cosmodromes at other latitudes would need to pay an extra delta-v cost to reach it, as you have noted.

*Or in practive 62% due to having to avoid spent rocket stages landing over China.