The LVLH can be realized using the position and velocity vectors in the ECI frame. Other treatments are possible, but they would involve transformation of the vectors to the right frame. Conversion from ECI seems the most straightfoward, and aligned with the definition you provide above!
Assume the following notation for the LVLH axes vectors, expressed in the ECI frame (notice the "descending" listing):
$$\begin{align}
& \mathbf{o}_{3I}: \text{LVLH Z-axis - Aligned with the spacecraft geocentric position vector}\\
& \mathbf{o}_{2I}: \text{LVLH Y-axis - Aligned with the negative orbit-normal}\\
& \mathbf{o}_{1I}: \text{LVLH X-axis - Completes the right-hand triad}\\
\end{align}$$
Assume the additional notation:
$$\begin{align}
\mathbf {r}_{I}: \text {Spacecraft position vector, expressed in the ECI frame}\\
\mathbf{v}_{I} \equiv \mathbf{\dot r}_{I}: \text {Spacecraft velocity vector, expressed in the ECI frame}
\end{align}$$
The representation of the LVLH frame axes vectors, expresed in ECI frame, is given by:
$$\begin{align}
& \mathbf{o}_{3I} = \mathbf{-{r}}_{I} / \lvert \lvert \mathbf{{r}}_{I} \rvert \rvert\\
& \mathbf{o}_{2I} = \mathbf{-({r}}_{I}\times \mathbf {v}_{I}) / \lvert \lvert \mathbf{{r}}_{I}\times \mathbf{{v}}_{I} \rvert \rvert\\
& \mathbf{o}_{1I} = \mathbf {o}_{2I} \times \mathbf {o}_{3I}\\
\end{align}$$
Finally, the rotation matrix from the LVLH frame (denoted as O) to the ECI frame (denoted as I) is:
$${A}_{IO} = \left[
\begin{array}{ccc}
\mathbf{o}_{1I}&\mathbf{o}_{2I}&\mathbf{o}_{3I}
\end{array}
\right] $$
A graph of the LVLH is shown below. This is in line with the use of the "Geocentric Radius Vector" in the definition of the Orbital Frame as provided by the source from @OrganicMarble (page 17 of the attached document in the comments, also provided here in case the comment is deleted).

Source: Markley, Crassidis: Fundamentals of Attitude Determination and Control, page 36
An alternative method to convert from ECI to the similar (but not identical for all sources) RSW frame is provided in page 169, Section 3.4.3 from Vallado's "Fundamentals of Astrodynamics and Applications". That method perfoms three principal rotations using the orbits keplerian elements, with some hints to the fact that those angles are not necessarily independent, but rather more intuitive.