Alzheimer's disease (AD) is characterized by the accumulation of β-amyloid (Aβ) peptides in the extracellular spaces of the brain as plaques and in the walls of blood vessels as cerebral amyloid angiopathy (CAA). Failure of perivascular drainage of Aβ along cerebrovascular basement membranes contributes to the development of CAA. Mid-life hypercholesterolaemia is a risk factor for the development of AD. Maternal obesity is associated with the development of obesity, hypertension and hypercholesterolaemia in adulthood, suggesting that the risk for AD and CAA may also be influenced by the early-life environment. In the present study, we tested the hypothesis that early-life exposure to a high-fat diet results in changes to the cerebrovasculature and failure of Aβ clearance from the brain. We also assessed whether vascular Aβ deposition is greater in the brains of aged humans with a history of hyperlipidaemia, compared to age-matched controls with normal lipidaemia. Using a mouse model of maternal obesity, we found that exposure to a high-fat diet during gestation and lactation induced changes in multiple components of the neurovascular unit, including a down-regulation in collagen IV, fibronectin and apolipoprotein E, an up-regulation in markers of astrocytes and perivascular macrophages and altered blood vessel morphology in the brains of adult mice. Sustained high-fat diet over the entire lifespan resulted in additional decreases in levels of pericytes and impaired perivascular clearance of Aβ from the brain. In humans, vascular Aβ load was significantly increased in the brains of aged individuals with a history of hypercholesterolaemia. These results support a critical role for early dietary influence on the brain vasculature across the lifespan, with consequences for the development of age-related cerebrovascular and neurodegenerative diseases.