Allowing flexible structures to uplift and rock during earthquakes can significantly reduce the force demands and residual displacements. However, such structures are still susceptible to large deformations and accelerations that can compromise their functionality. In this paper, we examine the dynamic response of elastic rocking oscillators and suggest that their lateral drifts and accelerations can be limited effectively by using inerter devices. To this end, we offer a detailed examination of the effects of structural flexibility on the efficiency of the proposed system. The analytical expressions governing the motion of deformable structures with base uplift are revisited to incorporate the effects of the supplemental rotational inertia. The proposed model is then used to study the structural demands of flexible rocking structures under coherent pulses as well as noncoherent real pulse-like ground motions. Our results show that combining rocking with inerters can be an efficient strategy to control the deformation and acceleration demands in uplifting flexible systems.