We consider a model of baryogenesis based on adding lepton number-violating quadratic mass terms to the inflaton potential of a nonminimally coupled inflation model. The
L
-violating mass terms generate a lepton asymmetry in a complex inflaton field via the mass term Affleck-Dine mechanism, which is transferred to the Standard Model (SM) sector when the inflaton decays to right-handed (RH) neutrinos. The model is minimal in that it requires only the SM sector, RH neutrinos, and a nonminimally coupled inflaton sector. We find that baryon isocurvature fluctuations can be observable in metric inflation but are negligible in Palatini inflation. The model is compatible with reheating temperatures that may be detectable in the observable primordial gravitational waves predicted by metric inflation