Background: People with intellectual disabilities were disproportionately negatively affected during the COVID‐19 pandemic, but there has been limited research about the perceived longer‐term impact. Methods: Data were collected through a two‐stage narrative interview process with eight adults with intellectual disabilities. Participants told their storey about their lives at the time of the first lockdown in 2020, what their lives were like 3 years later, and what they hoped for the future. A second interview filled any gaps in the narrative. Data were analysed thematically. Results: Four themes were identified: navigating disruptions to meaningful activities; unique challenges associated with residing in group‐living environments; anger at the Government; barriers to moving forward. Conclusions: The themes identified reflect powerful emotional memories of challenging experiences during the COVID‐19 pandemic. Life continues to be difficult for many due to ongoing difficulties in getting the right support.