Activity recognition is an important component of many pervasive computing applications. Radio-based activity recognition has the advantage that it does not have the privacy concern compared with camera-based solutions, and subjects do not have to carry a device on them. It has been shown channel state information (CSI) can be used for activity recognition in a device-free setting. With the proliferation of wireless devices, it is important to understand how radio frequency interference (RFI) can impact on pervasive computing applications. In this article, we investigate the impact of RFI on device-free CSI-based location-oriented activity recognition. We present data to show that RFI can have a significant impact on the CSI vectors. In the absence of RFI, different activities give rise to different CSI vectors that can be differentiated visually. However, in the presence of RFI, the CSI vectors become much noisier, and activity recognition also becomes harder. Our extensive experiments show that the performance may degrade significantly with RFI. We then propose a number of countermeasures to mitigate the impact of RFI and improve the performance. We are also the first to use complex-valued CSI along with the state-of-the-art Sparse Representation Classification method to enhance the performance in the environment with RFI.