We present a rigorous study of framework rigidity in general finite dimensional normed spaces from the perspective of Lie group actions on smooth manifolds. As an application, we prove an extension of Asimow and Roth’s 1978/1979 result establishing the equivalence of local, continuous and infinitesimal rigidity for regular bar-and-joint frameworks in a d-dimensional Euclidean space. Further, we obtain upper bounds for the dimension of the space of trivial motions for a framework and establish the flexibility of small frameworks in general non-Euclidean normed spaces.