In addition to the "rough combustion" that Organic Marble mentions, liquid engines also characteristically suffer from pogo oscillation. This is the phenomenon in which the thrust causes acceleration of the rocket, which changes the flow of propellant in the lines fuel and oxidizer lines, which then causes a change in the thrust, which is now a loop.
PooPogo oscillation was a major problem in the development of the Saturn rockets, and I believe the Jupiters before them.